-- Logs begin at Sat 2022-09-17 03:48:16 UTC, end at Sat 2022-09-17 04:56:37 UTC. -- Sep 17 04:19:45.426281 dv-cinder-857993-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 17 04:19:45.433592 dv-cinder-857993-2-smb devstack@keystone.service[81600]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 17 04:19:45.436174 dv-cinder-857993-2-smb devstack@keystone.service[81600]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 17 04:19:45 2022] *** Sep 17 04:19:45.436174 dv-cinder-857993-2-smb devstack@keystone.service[81600]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 17 04:19:45.436174 dv-cinder-857993-2-smb devstack@keystone.service[81600]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 17 04:19:45.436174 dv-cinder-857993-2-smb devstack@keystone.service[81600]: nodename: dv-cinder-857993-2-smb Sep 17 04:19:45.436174 dv-cinder-857993-2-smb devstack@keystone.service[81600]: machine: x86_64 Sep 17 04:19:45.436174 dv-cinder-857993-2-smb devstack@keystone.service[81600]: clock source: unix Sep 17 04:19:45.436174 dv-cinder-857993-2-smb devstack@keystone.service[81600]: pcre jit disabled Sep 17 04:19:45.436174 dv-cinder-857993-2-smb devstack@keystone.service[81600]: detected number of CPU cores: 4 Sep 17 04:19:45.436174 dv-cinder-857993-2-smb devstack@keystone.service[81600]: current working directory: / Sep 17 04:19:45.436756 dv-cinder-857993-2-smb devstack@keystone.service[81600]: detected binary path: /usr/bin/uwsgi-core Sep 17 04:19:45.436756 dv-cinder-857993-2-smb devstack@keystone.service[81600]: your processes number limit is 47680 Sep 17 04:19:45.436756 dv-cinder-857993-2-smb devstack@keystone.service[81600]: your memory page size is 4096 bytes Sep 17 04:19:45.436756 dv-cinder-857993-2-smb devstack@keystone.service[81600]: detected max file descriptor number: 2048 Sep 17 04:19:45.436756 dv-cinder-857993-2-smb devstack@keystone.service[81600]: lock engine: pthread robust mutexes Sep 17 04:19:45.436756 dv-cinder-857993-2-smb devstack@keystone.service[81600]: thunder lock: enabled Sep 17 04:19:45.436756 dv-cinder-857993-2-smb devstack@keystone.service[81600]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 17 04:19:45.436756 dv-cinder-857993-2-smb devstack@keystone.service[81600]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 17 04:19:45.477404 dv-cinder-857993-2-smb devstack@keystone.service[81600]: Python main interpreter initialized at 0x55be304449c0 Sep 17 04:19:45.477404 dv-cinder-857993-2-smb devstack@keystone.service[81600]: python threads support enabled Sep 17 04:19:45.477404 dv-cinder-857993-2-smb devstack@keystone.service[81600]: your server socket listen backlog is limited to 100 connections Sep 17 04:19:45.477404 dv-cinder-857993-2-smb devstack@keystone.service[81600]: your mercy for graceful operations on workers is 90 seconds Sep 17 04:19:45.477778 dv-cinder-857993-2-smb devstack@keystone.service[81600]: mapped 403077 bytes (393 KB) for 2 cores Sep 17 04:19:45.477854 dv-cinder-857993-2-smb devstack@keystone.service[81600]: *** Operational MODE: preforking *** Sep 17 04:19:45.478128 dv-cinder-857993-2-smb devstack@keystone.service[81600]: *** uWSGI is running in multiple interpreter mode *** Sep 17 04:19:45.478128 dv-cinder-857993-2-smb devstack@keystone.service[81600]: spawned uWSGI master process (pid: 81600) Sep 17 04:19:45.478335 dv-cinder-857993-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 17 04:19:45.479414 dv-cinder-857993-2-smb devstack@keystone.service[81600]: spawned uWSGI worker 1 (pid: 81614, cores: 1) Sep 17 04:19:45.479414 dv-cinder-857993-2-smb devstack@keystone.service[81600]: spawned uWSGI worker 2 (pid: 81615, cores: 1) Sep 17 04:19:45.479414 dv-cinder-857993-2-smb devstack@keystone.service[81600]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 17 04:19:49.846259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 04:19:49.846259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: from cryptography.utils import int_from_bytes Sep 17 04:19:49.847055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 04:19:49.847055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: from cryptography.utils import int_from_bytes Sep 17 04:19:49.911294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 04:19:49.911486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 04:19:49.911664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] command line args: [] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 04:19:49.911933 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 04:19:49.912112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ================================================================================ {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 04:19:49.912366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] admin_token = **** {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.912613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] config_dir = [] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.912802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.912985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] config_source = [] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.913191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] debug = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.913392 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.914792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.914792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.914792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.914792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.914792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] list_limit = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.914792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] log_config_append = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.915145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.915145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] log_dir = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.915291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] log_file = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.915539 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.915772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.916018 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.916268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.916447 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.916626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.916870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.917147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.917300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 04:19:49.917300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: from cryptography.utils import int_from_bytes Sep 17 04:19:49.917819 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.917819 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.917944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 04:19:49.917944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: from cryptography.utils import int_from_bytes Sep 17 04:19:49.918041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.918041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.918298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.918543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.918820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.919411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.919598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] publish_errors = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.919837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.920073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.920254 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.920506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.920746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.920985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] standard_threads = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.921240 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.921486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.921665 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.921844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] use_journal = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.922022 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] use_json = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.922200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] use_stderr = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.922378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] use_syslog = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.922611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:49.922871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.923114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.923376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.923618 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.923868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.924109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.924360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.924600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.924849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.925129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.925385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.925623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.925874 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.926111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.926360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.926610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.926850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.927108 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.927365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.927614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.927856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.928111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.928374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.928630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.928881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.929142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.929384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.929618 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.929856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.930109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.930359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.930591 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.930826 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.931305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.931406 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.931602 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.931853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.932091 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.932330 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.932569 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.932803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.933060 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.933297 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.933530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.933771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.934594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.934925 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.935172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.935406 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.935647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.935885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.936136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.936370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.936611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.936850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.937115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.937358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.940915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.940915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.940915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.940915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.940915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.940915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.940915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.940915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.940915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.941655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.941655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.941655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.941655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.941655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.941655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.941655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.941655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.941655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.942222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.942222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.942353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.942523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.942766 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.943014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.943253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.943492 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.943728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.943967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.944205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.944469 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.944712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.944961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.945231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.945472 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.945716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.945956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.946251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.946486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.946721 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.946955 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.947188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.947427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.947660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.947903 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.948142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.948395 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.948634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.948894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.949179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.949425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.950306 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] auth.external = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.950545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.950847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.951084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.951317 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] auth.password = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.951549 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] auth.token = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.951790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.952031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.952279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.952513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.952762 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.953028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.953267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.953505 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] credential.caching = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.953756 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.954006 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.954256 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.954500 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.954747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.954985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.955235 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.955489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.955729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.955983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.956270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.956518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.956783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.957049 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.957311 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.957549 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] federation.caching = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.957786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.958033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.958281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.958511 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.958760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.958998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.959253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.959494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.959877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.960016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.960227 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.960464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity.caching = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.960711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.960960 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.961221 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.961458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.961707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.961940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.962177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.962426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.962678 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.962911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.963141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.963372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.963617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.963865 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.964113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.964368 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.964616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.964887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.965182 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.965490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.965730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.965968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.966200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.966438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.966682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.966921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.967170 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.967401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.967649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.967897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.968131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.968377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.968623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.968853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.969116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.969349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.969587 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.969826 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.970077 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.970318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.970555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.970807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.971197 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.971434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.971705 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.971921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.972171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.972411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.972650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.972891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.973154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.973399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.973661 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.973897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.974146 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.974394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.974641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.974879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.975110 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.975348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.975585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.975822 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.976054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.976301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.976547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.976793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.977062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.977314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.977545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.977794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.978032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.978268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.978504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.978742 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.978988 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.979237 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.979476 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.979732 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.979963 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.980211 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.980447 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.980685 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.980934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.981225 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.981463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.981690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.981926 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.982192 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] resource.caching = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.982419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.982655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.982890 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.983140 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.983391 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.983627 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.983876 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.984113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.984353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.984590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] role.caching = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.984837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] role.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.985093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.985343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.985594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.985839 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.986086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.986332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.986581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.986827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.987073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.987307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.987552 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.987799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.988045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.988292 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.988729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.988968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.994583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.994583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.994583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.994583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.994583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.994583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.994583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.994583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.994583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] token.caching = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.995607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.996091 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.996091 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.996091 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.996264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.997161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.997400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.997696 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.997972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.998107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 04:19:49.998239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.connection = **** {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.998373 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 04:19:49.998501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.998639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] command line args: [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 04:19:49.998766 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.999150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 04:19:49.999278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.999535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ================================================================================ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 04:19:49.999667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.999667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:49.999905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] admin_token = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.000025 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.000157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] config_dir = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.000312 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.000312 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.000543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.000668 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.000803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] config_source = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.000928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.001087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] debug = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.001212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.001337 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.001486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.001608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.001735 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.001735 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.001960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.002085 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.002221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.002353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.002353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.002587 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.002707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.002707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 04:19:50.002937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.002937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_config_append = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.003169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.003322 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_dir = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.003591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_file = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.003951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.004319 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.004692 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.005092 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.005367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.005639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.006006 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.006378 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.006732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.007083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.007434 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.007784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.008148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.008512 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.008929 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.009689 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.009966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] publish_errors = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.010324 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.010693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.011017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.011450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.011874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.012863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] standard_threads = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.013334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.013725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.014056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.014346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_journal = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.014654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_json = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.014987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_stderr = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.015308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_syslog = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.015754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 04:19:50.016252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.016638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.017408 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.017801 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.018255 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.018719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.019194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.019613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.020052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.020467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.020937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.029311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.029311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.029311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.029311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.029311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.029311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.029311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.029311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.029311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.030028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.030028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.030028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.030028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.030028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.030028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.030028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.030028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.030028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.030658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.030658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.030658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.030658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.030895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.031329 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.031771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.032227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.032658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.032824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.033092 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.033187 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.033325 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.033548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.033991 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.034438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.034834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.035257 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.035657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.036116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.036542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.036983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.037449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.037879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.038310 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.038767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.039203 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.039667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.040086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.040514 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.040927 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.041382 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.041713 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.041834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.042301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.042752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.043206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.043899 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.044108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.044446 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.044866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.045303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.045722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.046204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.046631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.047092 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.047574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.048043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.048512 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.048982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.049498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.049969 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.057673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.058078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.058505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.059504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.059964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.060456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.060941 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.061445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.061921 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.062417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.062884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.063363 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.063829 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.064251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.064656 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.external = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.065120 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.065655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.066114 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.066576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.password = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.067037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.token = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.067511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.067980 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.068477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.068942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.069463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.069951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.070411 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.070882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.071374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.071864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.072327 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.072771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.073246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.073691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.074159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.075217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.075678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.076169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.076685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.077165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.077653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.077791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.078026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.078105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.078586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.079025 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.079545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.079714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.079982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.080229 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.080490 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.080739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.081018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.081270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.081536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.081782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.082044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.082292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.082546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.082797 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.083113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.083286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.083540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.083778 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.084031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.084279 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.084536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.084774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.085030 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.085269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.085518 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.085770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.086020 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.091653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.091653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.091653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.091653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.091653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.091653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.091653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.091653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.091653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.092930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.093184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.093403 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.093658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.093912 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.094157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.094394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.094636 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.094869 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.095115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.095378 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.095615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.095867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.096118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.096415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.096607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.096928 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.097198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.097440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.097681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.098022 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.098279 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.098532 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.098825 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.099122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.099376 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.099664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.100006 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.100259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.100912 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.101194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.101440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.101693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.102083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.102405 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.102654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.102893 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.103147 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.103388 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.103631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.103853 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.104110 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.104353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.104587 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.104828 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.105096 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.105354 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.105607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.107401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.107686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.107948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.109642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.109642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.109642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.109642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.109642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] role.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.109642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] role.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.109642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.110430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.110430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.110430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.110775 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.110916 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.111149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.111401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.111650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.111887 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.112139 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.112395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.112639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.112890 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.113364 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.113602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.113851 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.114193 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.114452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.114708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.114945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.115206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.115460 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.115704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.115939 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.116175 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.116406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.116661 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.116918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.117197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.117440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.117679 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.117911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.118149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.118386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.118636 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.118874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.119126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.119384 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.119621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.119867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.120113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.120362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.120649 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.120889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.121184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.122370 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.122660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.122897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.123145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.123414 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.123678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.123925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.124175 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.124417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.124659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.124898 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.125196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.125609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.126035 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.126292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.126506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.126725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.126953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.127353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.127508 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.127655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.127896 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.128139 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.128376 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 04:19:50.128545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 04:19:50.144543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.155633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.155871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.156100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.164939 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.185267 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.185502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.194312 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.194548 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.224201 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.268112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.268350 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.361099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.361282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.361466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.361686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.361907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.362126 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.388869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.389098 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.389333 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.389563 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.389834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.390061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.390285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.407238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.421402 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.421634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.421866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.422088 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.422310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.422536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.422757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.444201 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.444409 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 04:19:50.444759 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.444960 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 04:19:50.445085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.445268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.445349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.445493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.445572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.445718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.445809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.445943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.446022 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.446166 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.455793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.456076 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.456355 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.456638 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.458865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.459094 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.459319 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.459541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.459758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.459971 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.460184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.463581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.468078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.468552 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.468737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.469043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.470041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.470041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.470427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.470874 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.471328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.471773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.472245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.472704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.472782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.473036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.473268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.473493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.473711 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.473927 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.474224 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 04:19:50.485206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.485415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 04:19:50.485910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.486039 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 04:19:50.486269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.486535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.486799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.487057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.497058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.497321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.497593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.497877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.497960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.499364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.499657 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.504307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.504597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.504886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.510375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.510375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.510375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.510375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.510375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.510375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.510375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.511007 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.511007 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.511209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.511287 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.511435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.511581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.511727 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.517936 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.518238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.518531 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.518820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.519098 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.519376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.519650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.519924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.536021 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.536235 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.536522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.537519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.537821 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.541053 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.542391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.542679 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.542960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.544466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.544770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.549057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.550052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.550345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.552132 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.554607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.554984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.555280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.555360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.555577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.555745 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.555866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.555947 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.556162 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.556446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.556731 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.558023 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.558320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.558610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.572493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.572789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.573088 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.573360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.574230 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.574543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.578419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.580412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.581533 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.581834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.581937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.583432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.583710 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.586312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.586405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.586677 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.586972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.587271 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.587663 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.589487 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.593356 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.593676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.593991 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.594405 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.594700 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.595003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.599686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.599980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.600269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.600631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.601120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.601426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.601714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.611239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.611479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.611748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.612010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.617722 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.618910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.620589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.620669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.622373 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.622654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.623782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.625237 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.625320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.625588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.625875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.626172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.626464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.626711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.626999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.627396 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.633770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.635220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.638157 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.638244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.638515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.638595 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.638804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.638887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.639091 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.639170 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.639387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.639686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.639955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.647296 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.647590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.647874 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.655338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.657029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.657029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.657237 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.657318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.657318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.657318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.657318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.657318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.657637 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.657823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.658188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.658465 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.658736 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.659016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.659096 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.661974 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.663459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.664922 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.665233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.665527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.672540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.674104 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.676974 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.677292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.677581 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.677878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.686043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.686340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.686628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.693604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 04:19:50.693871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55be304449c0 pid: 81614 (default app) Sep 17 04:19:50.693967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.694172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.694454 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.694743 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.695021 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.695302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.695585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.695859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.696140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.696437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.696705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.697055 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.697204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b88269-774f-4736-91ae-ff0bcec2d6f3 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:19:50.697313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 04:19:50.697492 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b88269-774f-4736-91ae-ff0bcec2d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:19:50.697766 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b88269-774f-4736-91ae-ff0bcec2d6f3 None None] PATH_INFO: `/v3` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:19:50.701888 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Sat Sep 17 04:19:50 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:19:50.732846 dv-cinder-857993-2-smb devstack@keystone.service[81615]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55be304449c0 pid: 81615 (default app) Sep 17 04:19:58.407029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec023c3-884a-4157-8703-522981912e11 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:19:58.407546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec023c3-884a-4157-8703-522981912e11 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:19:58.407653 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec023c3-884a-4157-8703-522981912e11 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:19:58.408875 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:19:58.416894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bbd26-3f52-4418-9236-0951289303f4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:19:58.417361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bbd26-3f52-4418-9236-0951289303f4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:19:58.417456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bbd26-3f52-4418-9236-0951289303f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:19:58.487499 dv-cinder-857993-2-smb devstack@keystone.service[81615]: INFO dbcounter [None req-fd2bbd26-3f52-4418-9236-0951289303f4 None None] Registered counter for database keystone Sep 17 04:19:58.509106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG oslo_db.sqlalchemy.engines [None req-fd2bbd26-3f52-4418-9236-0951289303f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 04:19:58.515420 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writer thread running {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 04:19:58.701612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG passlib.handlers.bcrypt [None req-fd2bbd26-3f52-4418-9236-0951289303f4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81615) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 17 04:19:58.701927 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG passlib.handlers.bcrypt [None req-fd2bbd26-3f52-4418-9236-0951289303f4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81615) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 17 04:19:58.759944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-fd2bbd26-3f52-4418-9236-0951289303f4 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:19:58.761573 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fd2bbd26-3f52-4418-9236-0951289303f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:19:58.887623 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1/3] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:19:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 17 04:19:59.363952 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec023c3-884a-4157-8703-522981912e11 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:19:59.433291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: INFO dbcounter [None req-fec023c3-884a-4157-8703-522981912e11 None None] Registered counter for database keystone Sep 17 04:19:59.453150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG oslo_db.sqlalchemy.engines [None req-fec023c3-884a-4157-8703-522981912e11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 04:19:59.459245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writer thread running {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 04:19:59.577774 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec023c3-884a-4157-8703-522981912e11 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:19:59.581986 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad02435-0a41-40b7-b308-209b6edb0f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:19:59.582601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad02435-0a41-40b7-b308-209b6edb0f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:19:59.582876 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad02435-0a41-40b7-b308-209b6edb0f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:19:59.583146 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad02435-0a41-40b7-b308-209b6edb0f96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:19:59.592720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad02435-0a41-40b7-b308-209b6edb0f96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:19:59.645090 dv-cinder-857993-2-smb devstack@keystone.service[81614]: WARNING keystone.common.rbac_enforcer.enforcer [None req-aad02435-0a41-40b7-b308-209b6edb0f96 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 17 04:19:59.645440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad02435-0a41-40b7-b308-209b6edb0f96 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:19:59.655659 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 3/4] 10.222.0.50 () {58 vars in 1324 bytes} [Sat Sep 17 04:19:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 04:19:59.661625 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bbd26-3f52-4418-9236-0951289303f4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:19:59.677554 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bbd26-3f52-4418-9236-0951289303f4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:19:59.681943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9753173-a487-43d8-b98a-d66a7a654b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:19:59.683060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9753173-a487-43d8-b98a-d66a7a654b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:19:59.683380 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9753173-a487-43d8-b98a-d66a7a654b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:19:59.683602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9753173-a487-43d8-b98a-d66a7a654b9b admin admin] PATH_INFO: `/v3/projects/18915dddeacb48718863511fb593fb67` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:19:59.685079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9753173-a487-43d8-b98a-d66a7a654b9b admin admin] RBAC: Authorizing `identity:get_project(project_id=18915dddeacb48718863511fb593fb67)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:19:59.738086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b9753173-a487-43d8-b98a-d66a7a654b9b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 17 04:19:59.738421 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9753173-a487-43d8-b98a-d66a7a654b9b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:19:59.742956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 2/5] 10.222.0.50 () {56 vars in 1207 bytes} [Sat Sep 17 04:19:59 2022] GET /identity/v3/projects/18915dddeacb48718863511fb593fb67 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:01.849129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2e3f-e437-4221-908d-3b6e62dfc56e None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:01.849753 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2e3f-e437-4221-908d-3b6e62dfc56e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:01.849753 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2e3f-e437-4221-908d-3b6e62dfc56e None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:01.853724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 4/6] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:01.859708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1b3e8-60dd-4638-aab6-cadcc55d8c4c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:01.860100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1b3e8-60dd-4638-aab6-cadcc55d8c4c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:01.860246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1b3e8-60dd-4638-aab6-cadcc55d8c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:01.879919 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-54b1b3e8-60dd-4638-aab6-cadcc55d8c4c None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:01.881438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-54b1b3e8-60dd-4638-aab6-cadcc55d8c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:01.889124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 3/7] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 17 04:20:02.169866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a2e3f-e437-4221-908d-3b6e62dfc56e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:02.181981 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a2e3f-e437-4221-908d-3b6e62dfc56e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:02.186180 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411f804-dbc3-48f2-a312-d6f6f69072a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:02.186778 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411f804-dbc3-48f2-a312-d6f6f69072a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:02.187054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411f804-dbc3-48f2-a312-d6f6f69072a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:02.187326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411f804-dbc3-48f2-a312-d6f6f69072a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:02.194748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411f804-dbc3-48f2-a312-d6f6f69072a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:02.196500 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411f804-dbc3-48f2-a312-d6f6f69072a1 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:02.205570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 5/8] 10.222.0.50 () {58 vars in 1324 bytes} [Sat Sep 17 04:20:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 04:20:02.210727 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1b3e8-60dd-4638-aab6-cadcc55d8c4c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:02.220207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1b3e8-60dd-4638-aab6-cadcc55d8c4c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:02.224466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ac310-bddd-41da-9fb6-6a775fb827c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:02.225114 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ac310-bddd-41da-9fb6-6a775fb827c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:02.225393 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ac310-bddd-41da-9fb6-6a775fb827c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:02.225663 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ac310-bddd-41da-9fb6-6a775fb827c3 admin admin] PATH_INFO: `/v3/users/f003550e956b429a97e0675a2bc86b98` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:02.226957 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ac310-bddd-41da-9fb6-6a775fb827c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=f003550e956b429a97e0675a2bc86b98)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:02.228760 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ac310-bddd-41da-9fb6-6a775fb827c3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:02.230291 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 4/9] 10.222.0.50 () {56 vars in 1198 bytes} [Sat Sep 17 04:20:02 2022] GET /identity/v3/users/f003550e956b429a97e0675a2bc86b98 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:04.467843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92feb9-5147-4438-aa2f-47f3c0580beb None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:04.468347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92feb9-5147-4438-aa2f-47f3c0580beb None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:04.468438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d63af3-c099-4438-90d6-d3ca332ca2ef None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:04.468784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92feb9-5147-4438-aa2f-47f3c0580beb None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:04.468860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d63af3-c099-4438-90d6-d3ca332ca2ef None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:04.468860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d63af3-c099-4438-90d6-d3ca332ca2ef None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:04.469764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:04.470143 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 5/11] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:20:04.474628 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b54da-155b-469f-9570-5af9cf8d6bb3 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:04.474911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b54da-155b-469f-9570-5af9cf8d6bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:04.475043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daf970-f874-4bcd-a8e7-d3c67da565b0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:04.475188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b54da-155b-469f-9570-5af9cf8d6bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:04.475318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daf970-f874-4bcd-a8e7-d3c67da565b0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:04.475588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daf970-f874-4bcd-a8e7-d3c67da565b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:04.493628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f2daf970-f874-4bcd-a8e7-d3c67da565b0 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:04.494810 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f2daf970-f874-4bcd-a8e7-d3c67da565b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:04.517317 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG passlib.handlers.bcrypt [None req-2d2b54da-155b-469f-9570-5af9cf8d6bb3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81614) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 17 04:20:04.517708 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG passlib.handlers.bcrypt [None req-2d2b54da-155b-469f-9570-5af9cf8d6bb3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81614) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 17 04:20:04.567000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2d2b54da-155b-469f-9570-5af9cf8d6bb3 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:04.568477 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2d2b54da-155b-469f-9570-5af9cf8d6bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:04.575556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:20:04.665798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:04.844415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2daf970-f874-4bcd-a8e7-d3c67da565b0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:04.869006 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:04.929490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b54da-155b-469f-9570-5af9cf8d6bb3 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:04.951392 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2daf970-f874-4bcd-a8e7-d3c67da565b0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:04.984601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609c1cc-4780-41fa-8133-4db5801070cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:04.985267 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609c1cc-4780-41fa-8133-4db5801070cb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:04.985549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609c1cc-4780-41fa-8133-4db5801070cb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:04.985822 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609c1cc-4780-41fa-8133-4db5801070cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:04.997819 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609c1cc-4780-41fa-8133-4db5801070cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7609c1cc-4780-41fa-8133-4db5801070cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:05.006290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:05.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:05.008355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:05.008355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:05.008355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:05.008355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:05.008355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:05.008355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:05.008355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:05.008355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:05.008355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:05.008355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:05.008355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:05.008355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:05.008355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 7/14] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:20:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:20:05.013180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609c1cc-4780-41fa-8133-4db5801070cb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:05.033202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b54da-155b-469f-9570-5af9cf8d6bb3 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:05.035470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:05.070067 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a6d67-429f-46c2-ba68-042ea1be036e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:05.070928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6d67-429f-46c2-ba68-042ea1be036e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:05.071284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6d67-429f-46c2-ba68-042ea1be036e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:05.071561 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6d67-429f-46c2-ba68-042ea1be036e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:05.096110 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:05.113339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609c1cc-4780-41fa-8133-4db5801070cb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:05.138835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a6d67-429f-46c2-ba68-042ea1be036e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:05.140342 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a6d67-429f-46c2-ba68-042ea1be036e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:05.147019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cce49-4323-4576-b287-c288b8625032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:05.147663 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cce49-4323-4576-b287-c288b8625032 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:05.147943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cce49-4323-4576-b287-c288b8625032 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:05.148210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cce49-4323-4576-b287-c288b8625032 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:05.148891 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cce49-4323-4576-b287-c288b8625032 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:05.149222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cce49-4323-4576-b287-c288b8625032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:05.150624 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cce49-4323-4576-b287-c288b8625032 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:05.163299 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 8/15] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:05.168954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cce49-4323-4576-b287-c288b8625032 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:05.239418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 8/16] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 04:20:05.244984 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a6d67-429f-46c2-ba68-042ea1be036e None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:05.247681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:05.269177 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cce49-4323-4576-b287-c288b8625032 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:05.303226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e211b-6422-4d6b-8ce2-8ef7f2c2bb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:05.303889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e211b-6422-4d6b-8ce2-8ef7f2c2bb14 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:05.304192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e211b-6422-4d6b-8ce2-8ef7f2c2bb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:05.304467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e211b-6422-4d6b-8ce2-8ef7f2c2bb14 None admin] PATH_INFO: `/v3/users/f003550e956b429a97e0675a2bc86b98` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:05.305622 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e211b-6422-4d6b-8ce2-8ef7f2c2bb14 None admin] RBAC: Authorizing `identity:get_user(user_id=f003550e956b429a97e0675a2bc86b98)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:05.307089 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e211b-6422-4d6b-8ce2-8ef7f2c2bb14 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:05.309253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 9/17] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:05 2022] GET /identity/v3/users/f003550e956b429a97e0675a2bc86b98 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:05.314568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e211b-6422-4d6b-8ce2-8ef7f2c2bb14 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:05.328673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:05.342414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a6d67-429f-46c2-ba68-042ea1be036e None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:05.375929 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c1e10-a119-4a65-b763-4de53719edbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:05.376710 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c1e10-a119-4a65-b763-4de53719edbf None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:05.377018 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c1e10-a119-4a65-b763-4de53719edbf None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:05.377286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c1e10-a119-4a65-b763-4de53719edbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:05.396277 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c1e10-a119-4a65-b763-4de53719edbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:05.397763 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c1e10-a119-4a65-b763-4de53719edbf None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:05.412984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e211b-6422-4d6b-8ce2-8ef7f2c2bb14 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-6c9c1e10-a119-4a65-b763-4de53719edbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:20:05.415386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:05.416322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:20:05.417141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:20:05.417141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:20:05.417141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:20:05.417141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 9/18] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:20:05.422981 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c1e10-a119-4a65-b763-4de53719edbf None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:05.448373 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e851cf-f92d-43e1-b638-082e2d06a014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:05.449237 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e851cf-f92d-43e1-b638-082e2d06a014 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:05.449584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e851cf-f92d-43e1-b638-082e2d06a014 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:05.449871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e851cf-f92d-43e1-b638-082e2d06a014 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:05.451063 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e851cf-f92d-43e1-b638-082e2d06a014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:05.452535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e851cf-f92d-43e1-b638-082e2d06a014 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:05.454124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 10/19] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:05.459794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e851cf-f92d-43e1-b638-082e2d06a014 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:05.480901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:05.525824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c1e10-a119-4a65-b763-4de53719edbf None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:05.542580 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:05.559571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b416b7e-399e-4724-af9f-937ba2de03a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:05.560175 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b416b7e-399e-4724-af9f-937ba2de03a2 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:05.561916 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b416b7e-399e-4724-af9f-937ba2de03a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:05.561916 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b416b7e-399e-4724-af9f-937ba2de03a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:05.561916 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b416b7e-399e-4724-af9f-937ba2de03a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:05.561916 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b416b7e-399e-4724-af9f-937ba2de03a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:05.562475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e851cf-f92d-43e1-b638-082e2d06a014 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:05.563029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b416b7e-399e-4724-af9f-937ba2de03a2 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:05.580101 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 10/20] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:05.597102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25177576-309a-4d55-93d5-a5fe680264aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:05.597739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25177576-309a-4d55-93d5-a5fe680264aa None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:05.598024 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25177576-309a-4d55-93d5-a5fe680264aa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:05.598300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25177576-309a-4d55-93d5-a5fe680264aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:05.599055 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25177576-309a-4d55-93d5-a5fe680264aa None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.domain.id=default, user.id=f003550e956b429a97e0675a2bc86b98) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:05.599364 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25177576-309a-4d55-93d5-a5fe680264aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:05.600884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25177576-309a-4d55-93d5-a5fe680264aa None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:05.609509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 11/21] 10.222.0.50 () {56 vars in 1322 bytes} [Sat Sep 17 04:20:05 2022] GET /identity/v3/role_assignments?user.id=f003550e956b429a97e0675a2bc86b98&scope.domain.id=default&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:08.052217 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19ac4b-11de-47cc-8a2c-9351cc5238fc None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:08.053440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19ac4b-11de-47cc-8a2c-9351cc5238fc None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:08.053948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19ac4b-11de-47cc-8a2c-9351cc5238fc None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:08.055557 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 11/22] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:08.062624 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401840-509d-4843-968c-bb6bbb451c7c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:08.063099 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401840-509d-4843-968c-bb6bbb451c7c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:08.063190 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401840-509d-4843-968c-bb6bbb451c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:08.089287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-35401840-509d-4843-968c-bb6bbb451c7c None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:08.091148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-35401840-509d-4843-968c-bb6bbb451c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:08.195327 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 12/23] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:08.318922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b99efd-d361-475b-998b-9085a1385166 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:08.318922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b99efd-d361-475b-998b-9085a1385166 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:08.318922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b99efd-d361-475b-998b-9085a1385166 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:08.320557 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 12/24] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:08.327198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642102d0-190b-4e98-a3cc-ee442f3531c0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:08.327714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642102d0-190b-4e98-a3cc-ee442f3531c0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:08.328172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642102d0-190b-4e98-a3cc-ee442f3531c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:08.357821 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-642102d0-190b-4e98-a3cc-ee442f3531c0 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:08.359452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-642102d0-190b-4e98-a3cc-ee442f3531c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:08.442399 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 13/25] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:08.478265 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b103f-64f2-4d69-b65f-6c18353c96b1 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:08.478706 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b103f-64f2-4d69-b65f-6c18353c96b1 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:08.479075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b103f-64f2-4d69-b65f-6c18353c96b1 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:08.480983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 13/26] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:08.486831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f092b4-d0e6-4327-9aec-c5ee690d46a4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:08.487120 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f092b4-d0e6-4327-9aec-c5ee690d46a4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:08.487402 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f092b4-d0e6-4327-9aec-c5ee690d46a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:08.499622 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:08.516498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-73f092b4-d0e6-4327-9aec-c5ee690d46a4 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:08.517738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-73f092b4-d0e6-4327-9aec-c5ee690d46a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:08.616284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 14/27] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:08.639922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b103f-64f2-4d69-b65f-6c18353c96b1 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:08.817671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b103f-64f2-4d69-b65f-6c18353c96b1 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:08.830265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c87877-10ab-4ce0-8179-6f9db3d3614c None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:08.830265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c87877-10ab-4ce0-8179-6f9db3d3614c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:08.830265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c87877-10ab-4ce0-8179-6f9db3d3614c None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:08.830879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 15/28] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:08.836956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285c60e-fb95-4265-a927-8459fa9f33c1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:08.837474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285c60e-fb95-4265-a927-8459fa9f33c1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:08.837952 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285c60e-fb95-4265-a927-8459fa9f33c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:08.853339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:08.869808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89891a8c-a3ca-4f29-ba98-d63a26619fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:08.870820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89891a8c-a3ca-4f29-ba98-d63a26619fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:08.871290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89891a8c-a3ca-4f29-ba98-d63a26619fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:08.871752 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89891a8c-a3ca-4f29-ba98-d63a26619fb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:08.874144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2285c60e-fb95-4265-a927-8459fa9f33c1 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:08.875602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2285c60e-fb95-4265-a927-8459fa9f33c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:08.905880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89891a8c-a3ca-4f29-ba98-d63a26619fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-89891a8c-a3ca-4f29-ba98-d63a26619fb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:08.912034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:08.912844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:08.913686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:08.913686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:08.913686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:08.913686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:08.913686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:08.913686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:08.913686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:08.913686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:08.913686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:08.913686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:08.913686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:08.913686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:20:08.913686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 14/29] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:08.919716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89891a8c-a3ca-4f29-ba98-d63a26619fb9 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:09.006647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 16/30] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:09.013560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285c60e-fb95-4265-a927-8459fa9f33c1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:09.126660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89891a8c-a3ca-4f29-ba98-d63a26619fb9 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:09.131525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:09.176314 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285c60e-fb95-4265-a927-8459fa9f33c1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:09.221604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5ef5e-380e-4332-bc5e-f8a05bf67c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:09.222463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ef15d-16b0-493e-a138-451aeb290829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:09.223235 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5ef5e-380e-4332-bc5e-f8a05bf67c19 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:09.224103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5ef5e-380e-4332-bc5e-f8a05bf67c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:09.224501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ef15d-16b0-493e-a138-451aeb290829 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:09.224982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5ef5e-380e-4332-bc5e-f8a05bf67c19 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:09.225417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ef15d-16b0-493e-a138-451aeb290829 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:09.226221 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5ef5e-380e-4332-bc5e-f8a05bf67c19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:09.226633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ef15d-16b0-493e-a138-451aeb290829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:09.227605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5ef5e-380e-4332-bc5e-f8a05bf67c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:09.229207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5ef5e-380e-4332-bc5e-f8a05bf67c19 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:09.243404 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 15/31] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:09.244428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5ef5e-380e-4332-bc5e-f8a05bf67c19 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:09.257663 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ef15d-16b0-493e-a138-451aeb290829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:09.259454 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ef15d-16b0-493e-a138-451aeb290829 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ce6ef15d-16b0-493e-a138-451aeb290829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:20:09.298736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:09.299843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:20:09.300852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:20:09.300852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:20:09.300852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:09.302543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 17/32] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:20:09.304541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ef15d-16b0-493e-a138-451aeb290829 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:09.333023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:09.410986 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5ef5e-380e-4332-bc5e-f8a05bf67c19 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:09.438691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ef15d-16b0-493e-a138-451aeb290829 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:09.456230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba4dba-42ed-413e-960c-06f73f0e55d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:09.456854 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba4dba-42ed-413e-960c-06f73f0e55d6 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:09.457177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba4dba-42ed-413e-960c-06f73f0e55d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:09.457457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba4dba-42ed-413e-960c-06f73f0e55d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:09.457977 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:09.459425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba4dba-42ed-413e-960c-06f73f0e55d6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:09.460618 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba4dba-42ed-413e-960c-06f73f0e55d6 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:09.477817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b8213-ffbb-4b68-a8d4-ace01ff201ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:09.478776 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b8213-ffbb-4b68-a8d4-ace01ff201ab None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:09.479207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b8213-ffbb-4b68-a8d4-ace01ff201ab None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:09.479700 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b8213-ffbb-4b68-a8d4-ace01ff201ab None admin] PATH_INFO: `/v3/users/f003550e956b429a97e0675a2bc86b98` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:09.482143 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b8213-ffbb-4b68-a8d4-ace01ff201ab None admin] RBAC: Authorizing `identity:get_user(user_id=f003550e956b429a97e0675a2bc86b98)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:09.483854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b8213-ffbb-4b68-a8d4-ace01ff201ab None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:09.489044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 18/33] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:09 2022] GET /identity/v3/users/f003550e956b429a97e0675a2bc86b98 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:09.490696 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b8213-ffbb-4b68-a8d4-ace01ff201ab None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:09.623564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b8213-ffbb-4b68-a8d4-ace01ff201ab None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:09.661272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db0ce2-75c8-4356-a9f5-2a590a8d9c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:09.662273 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db0ce2-75c8-4356-a9f5-2a590a8d9c19 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:09.662766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db0ce2-75c8-4356-a9f5-2a590a8d9c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:09.663371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db0ce2-75c8-4356-a9f5-2a590a8d9c19 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:09.664274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db0ce2-75c8-4356-a9f5-2a590a8d9c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:09.664835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db0ce2-75c8-4356-a9f5-2a590a8d9c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:09.666672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db0ce2-75c8-4356-a9f5-2a590a8d9c19 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:09.685349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 16/34] 10.222.0.50 () {60 vars in 1131 bytes} [Sat Sep 17 04:20:09 2022] POST /identity/v3/roles => generated 219 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:20:09.686564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba4dba-42ed-413e-960c-06f73f0e55d6 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:09.689135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 19/35] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:09.690330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db0ce2-75c8-4356-a9f5-2a590a8d9c19 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:09.764460 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:09.810581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:09.815401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba4dba-42ed-413e-960c-06f73f0e55d6 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:09.852338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db0ce2-75c8-4356-a9f5-2a590a8d9c19 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:09.866233 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264debf5-5958-43f2-82f4-911083d99579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:09.867457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264debf5-5958-43f2-82f4-911083d99579 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:09.867890 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264debf5-5958-43f2-82f4-911083d99579 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:09.868314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264debf5-5958-43f2-82f4-911083d99579 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:09.869454 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264debf5-5958-43f2-82f4-911083d99579 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:09.871956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264debf5-5958-43f2-82f4-911083d99579 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:09.897086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aac95d-e6b1-4dfa-ba85-7bae4c1af6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:09.898104 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac95d-e6b1-4dfa-ba85-7bae4c1af6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:09.898394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac95d-e6b1-4dfa-ba85-7bae4c1af6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:09.898672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac95d-e6b1-4dfa-ba85-7bae4c1af6d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:09.900258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aac95d-e6b1-4dfa-ba85-7bae4c1af6d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:09.902276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aac95d-e6b1-4dfa-ba85-7bae4c1af6d6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:09.908650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 20/36] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:09.908650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aac95d-e6b1-4dfa-ba85-7bae4c1af6d6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:09.950602 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 17/37] 10.222.0.50 () {60 vars in 1131 bytes} [Sat Sep 17 04:20:09 2022] POST /identity/v3/roles => generated 225 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:20:09.957066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf658e-c13b-42ad-b1dd-067d707d3ac3 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:09.957066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf658e-c13b-42ad-b1dd-067d707d3ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:09.957066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf658e-c13b-42ad-b1dd-067d707d3ac3 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:09.957066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 18/38] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:09.957066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf658e-c13b-42ad-b1dd-067d707d3ac3 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:10.037448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aac95d-e6b1-4dfa-ba85-7bae4c1af6d6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:10.055841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:10.083720 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78323eb-02a6-45fb-8d54-b9378888933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:10.085751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78323eb-02a6-45fb-8d54-b9378888933b None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:10.086280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78323eb-02a6-45fb-8d54-b9378888933b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:10.086799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78323eb-02a6-45fb-8d54-b9378888933b None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:10.087702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78323eb-02a6-45fb-8d54-b9378888933b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:10.090090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78323eb-02a6-45fb-8d54-b9378888933b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:10.102857 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf658e-c13b-42ad-b1dd-067d707d3ac3 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:10.145610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f5db-b7a6-42db-82f2-e1b544dcfa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:10.146956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f5db-b7a6-42db-82f2-e1b544dcfa64 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:10.147446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f5db-b7a6-42db-82f2-e1b544dcfa64 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:10.147729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f5db-b7a6-42db-82f2-e1b544dcfa64 None admin] PATH_INFO: `/v3/domains/default/users/f003550e956b429a97e0675a2bc86b98/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:10.150381 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498f5db-b7a6-42db-82f2-e1b544dcfa64 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f003550e956b429a97e0675a2bc86b98, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:10.151932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498f5db-b7a6-42db-82f2-e1b544dcfa64 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:10.237252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 19/39] 10.222.0.50 () {58 vars in 1361 bytes} [Sat Sep 17 04:20:09 2022] PUT /identity/v3/domains/default/users/f003550e956b429a97e0675a2bc86b98/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:20:10.238421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433de7-ff25-4271-8920-d888f6aa0ed6 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:10.238770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433de7-ff25-4271-8920-d888f6aa0ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:10.239095 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433de7-ff25-4271-8920-d888f6aa0ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:10.259442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-86433de7-ff25-4271-8920-d888f6aa0ed6 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:10.261046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-86433de7-ff25-4271-8920-d888f6aa0ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:10.278089 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:10.339436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 20/40] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:10.339436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489de6a-5c1c-4e27-bfae-f9bfbc8be5fe None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:10.339436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489de6a-5c1c-4e27-bfae-f9bfbc8be5fe None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:10.339436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489de6a-5c1c-4e27-bfae-f9bfbc8be5fe None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:10.339436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 21/41] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:10.351497 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c945f-072f-46be-bb66-7be1cb9898b4 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:10.351823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c945f-072f-46be-bb66-7be1cb9898b4 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:10.352066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c945f-072f-46be-bb66-7be1cb9898b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:10.376675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2c1c945f-072f-46be-bb66-7be1cb9898b4 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:10.378195 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2c1c945f-072f-46be-bb66-7be1cb9898b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:10.434786 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 21/42] 10.222.0.50 () {60 vars in 1141 bytes} [Sat Sep 17 04:20:09 2022] POST /identity/v3/projects => generated 301 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:20:10.468067 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 22/43] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:10.650604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78323eb-02a6-45fb-8d54-b9378888933b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:10.748507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c945f-072f-46be-bb66-7be1cb9898b4 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:10.759789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78323eb-02a6-45fb-8d54-b9378888933b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:10.803475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3914d-17fc-4d59-a247-bedaa29d680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:10.804102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3914d-17fc-4d59-a247-bedaa29d680b None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:10.804386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3914d-17fc-4d59-a247-bedaa29d680b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:10.804661 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3914d-17fc-4d59-a247-bedaa29d680b None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:10.805395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3914d-17fc-4d59-a247-bedaa29d680b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:10.806920 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3914d-17fc-4d59-a247-bedaa29d680b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:10.839787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:10.860131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c945f-072f-46be-bb66-7be1cb9898b4 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:10.894876 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8cb10-c6c8-4c04-979e-0051247737c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:10.895561 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8cb10-c6c8-4c04-979e-0051247737c7 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:10.895845 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8cb10-c6c8-4c04-979e-0051247737c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:10.896116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8cb10-c6c8-4c04-979e-0051247737c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:10.897233 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8cb10-c6c8-4c04-979e-0051247737c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:10.898690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8cb10-c6c8-4c04-979e-0051247737c7 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:10.900284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 23/44] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:10.906153 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8cb10-c6c8-4c04-979e-0051247737c7 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:10.919521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 22/45] 10.222.0.50 () {60 vars in 1131 bytes} [Sat Sep 17 04:20:10 2022] POST /identity/v3/roles => generated 223 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:20:11.018202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8cb10-c6c8-4c04-979e-0051247737c7 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:11.055343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae20ef0-a772-4e83-a8e2-3cd3b5ec5dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:11.055975 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae20ef0-a772-4e83-a8e2-3cd3b5ec5dbf None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:11.056254 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae20ef0-a772-4e83-a8e2-3cd3b5ec5dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:11.056526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae20ef0-a772-4e83-a8e2-3cd3b5ec5dbf None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:11.057215 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae20ef0-a772-4e83-a8e2-3cd3b5ec5dbf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:11.059450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae20ef0-a772-4e83-a8e2-3cd3b5ec5dbf None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:11.155085 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:11.168848 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 24/46] 10.222.0.50 () {60 vars in 1141 bytes} [Sat Sep 17 04:20:10 2022] POST /identity/v3/projects => generated 312 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:20:12.464039 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a770e7a-50bf-4292-8647-f4b223b02d7c None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:12.464789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a770e7a-50bf-4292-8647-f4b223b02d7c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:12.465117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a770e7a-50bf-4292-8647-f4b223b02d7c None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:12.466519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 23/47] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:12.471869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3f685-c804-4d4e-9de6-eb5acb0c13fd None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:12.472279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3f685-c804-4d4e-9de6-eb5acb0c13fd None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:12.472417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3f685-c804-4d4e-9de6-eb5acb0c13fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:12.490336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-43a3f685-c804-4d4e-9de6-eb5acb0c13fd None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:12.491495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-43a3f685-c804-4d4e-9de6-eb5acb0c13fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:12.556189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 25/48] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:12.821659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a770e7a-50bf-4292-8647-f4b223b02d7c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:12.848149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:12.924440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a770e7a-50bf-4292-8647-f4b223b02d7c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:12.958049 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094193-8c6d-4e57-8408-021fc96bff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:12.958674 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094193-8c6d-4e57-8408-021fc96bff42 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:12.958955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094193-8c6d-4e57-8408-021fc96bff42 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:12.959227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094193-8c6d-4e57-8408-021fc96bff42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:12.970200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64094193-8c6d-4e57-8408-021fc96bff42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-64094193-8c6d-4e57-8408-021fc96bff42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:12.975058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:12.975860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:12.976604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:12.976604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:12.976604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:12.976604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:12.976604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:12.976604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:12.976604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:12.976604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:12.976604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:12.976604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:12.976604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:12.976604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:12.976604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 24/49] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:20:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:12.983838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3f685-c804-4d4e-9de6-eb5acb0c13fd None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:13.090961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3f685-c804-4d4e-9de6-eb5acb0c13fd None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:13.116715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:13.124474 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fe17b-ec00-497b-88fb-73c9d90d4f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:13.125113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fe17b-ec00-497b-88fb-73c9d90d4f39 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:13.125423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fe17b-ec00-497b-88fb-73c9d90d4f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:13.125707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fe17b-ec00-497b-88fb-73c9d90d4f39 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:13.126369 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fe17b-ec00-497b-88fb-73c9d90d4f39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:13.126670 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fe17b-ec00-497b-88fb-73c9d90d4f39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:13.128057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fe17b-ec00-497b-88fb-73c9d90d4f39 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:13.137089 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 26/50] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:13.142776 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094193-8c6d-4e57-8408-021fc96bff42 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:13.229601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:13.245650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094193-8c6d-4e57-8408-021fc96bff42 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:13.279513 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b35ef6-56e3-4d31-bd35-34b7ef04aebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:13.280142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35ef6-56e3-4d31-bd35-34b7ef04aebb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:13.280419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35ef6-56e3-4d31-bd35-34b7ef04aebb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:13.280694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35ef6-56e3-4d31-bd35-34b7ef04aebb None admin] PATH_INFO: `/v3/users/f003550e956b429a97e0675a2bc86b98` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:13.281849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b35ef6-56e3-4d31-bd35-34b7ef04aebb None admin] RBAC: Authorizing `identity:get_user(user_id=f003550e956b429a97e0675a2bc86b98)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:13.283309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b35ef6-56e3-4d31-bd35-34b7ef04aebb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:13.284905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 25/51] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:13 2022] GET /identity/v3/users/f003550e956b429a97e0675a2bc86b98 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:13.290311 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fe17b-ec00-497b-88fb-73c9d90d4f39 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:13.311885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df19f-c62d-4c52-9b48-7201b88576d9 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:13.312169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df19f-c62d-4c52-9b48-7201b88576d9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:13.312445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df19f-c62d-4c52-9b48-7201b88576d9 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:13.313837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 26/52] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:20:13.318763 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21fba2-da99-4806-8f6c-3723230a7bf2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:13.323026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21fba2-da99-4806-8f6c-3723230a7bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:13.323026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21fba2-da99-4806-8f6c-3723230a7bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:13.338427 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9c21fba2-da99-4806-8f6c-3723230a7bf2 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:13.340774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9c21fba2-da99-4806-8f6c-3723230a7bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:13.395507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fe17b-ec00-497b-88fb-73c9d90d4f39 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:13.412495 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 27/53] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:20:13.431055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cec22-802a-42ed-a8a9-120ff790c384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:13.431689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cec22-802a-42ed-a8a9-120ff790c384 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:13.432012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cec22-802a-42ed-a8a9-120ff790c384 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:13.432286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cec22-802a-42ed-a8a9-120ff790c384 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:13.433530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cec22-802a-42ed-a8a9-120ff790c384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:13.434969 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cec22-802a-42ed-a8a9-120ff790c384 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:13.436521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 27/54] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:13.442373 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21fba2-da99-4806-8f6c-3723230a7bf2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:13.526139 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:13.545233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21fba2-da99-4806-8f6c-3723230a7bf2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:13.579683 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a74e9-2ff1-425a-ae1e-7117531ad309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:13.580290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a74e9-2ff1-425a-ae1e-7117531ad309 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:13.580574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a74e9-2ff1-425a-ae1e-7117531ad309 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:13.580901 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a74e9-2ff1-425a-ae1e-7117531ad309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:13.581695 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a74e9-2ff1-425a-ae1e-7117531ad309 None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.domain.id=default, user.id=f003550e956b429a97e0675a2bc86b98) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:13.582011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a74e9-2ff1-425a-ae1e-7117531ad309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:13.583465 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a74e9-2ff1-425a-ae1e-7117531ad309 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:13.601030 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 28/55] 10.222.0.50 () {56 vars in 1322 bytes} [Sat Sep 17 04:20:13 2022] GET /identity/v3/role_assignments?user.id=f003550e956b429a97e0675a2bc86b98&scope.domain.id=default&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:13.681172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cec22-802a-42ed-a8a9-120ff790c384 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:13.847186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:13.887704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cec22-802a-42ed-a8a9-120ff790c384 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:13.920339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd30ee-9363-425e-9655-a7d8efc4c793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:13.920954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd30ee-9363-425e-9655-a7d8efc4c793 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:13.921259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd30ee-9363-425e-9655-a7d8efc4c793 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:13.921530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd30ee-9363-425e-9655-a7d8efc4c793 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:13.922606 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd30ee-9363-425e-9655-a7d8efc4c793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:13.924052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd30ee-9363-425e-9655-a7d8efc4c793 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:13.925629 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 28/56] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:13.931324 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a74e9-2ff1-425a-ae1e-7117531ad309 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:14.028418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a74e9-2ff1-425a-ae1e-7117531ad309 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:14.061211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37606e41-40e6-4fd7-90d9-c9da730940fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:14.061805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37606e41-40e6-4fd7-90d9-c9da730940fb None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:14.062087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37606e41-40e6-4fd7-90d9-c9da730940fb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:14.062359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37606e41-40e6-4fd7-90d9-c9da730940fb None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:14.063000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37606e41-40e6-4fd7-90d9-c9da730940fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:14.064427 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37606e41-40e6-4fd7-90d9-c9da730940fb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:14.148534 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:14.155629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 29/57] 10.222.0.50 () {60 vars in 1140 bytes} [Sat Sep 17 04:20:13 2022] POST /identity/v3/projects => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:20:16.297079 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac338c4d-dd95-4046-b8a4-eee807678697 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:16.297607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac338c4d-dd95-4046-b8a4-eee807678697 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:16.297607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac338c4d-dd95-4046-b8a4-eee807678697 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:16.298976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 29/58] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:16.304234 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f0e3b-67e1-42dc-8359-f42f5d439046 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:16.304638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f0e3b-67e1-42dc-8359-f42f5d439046 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:16.304819 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f0e3b-67e1-42dc-8359-f42f5d439046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:16.322825 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-de5f0e3b-67e1-42dc-8359-f42f5d439046 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:16.324672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-de5f0e3b-67e1-42dc-8359-f42f5d439046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:16.389140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 30/59] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:16.661656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac338c4d-dd95-4046-b8a4-eee807678697 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:16.761874 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac338c4d-dd95-4046-b8a4-eee807678697 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:16.786668 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:16.795430 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4613e-1976-4ae8-90c5-452a45a584ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:16.796037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4613e-1976-4ae8-90c5-452a45a584ee None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:16.799334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4613e-1976-4ae8-90c5-452a45a584ee None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:16.799334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4613e-1976-4ae8-90c5-452a45a584ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:16.799334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4613e-1976-4ae8-90c5-452a45a584ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:16.799334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4613e-1976-4ae8-90c5-452a45a584ee None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:16.800681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 30/60] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:16.806069 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f0e3b-67e1-42dc-8359-f42f5d439046 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:16.901611 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f0e3b-67e1-42dc-8359-f42f5d439046 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:16.926826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:16.934710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315d4c5-e6ad-480d-b820-bd093837f35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:16.935313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315d4c5-e6ad-480d-b820-bd093837f35e None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:16.938976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315d4c5-e6ad-480d-b820-bd093837f35e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:16.938976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315d4c5-e6ad-480d-b820-bd093837f35e None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:16.938976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315d4c5-e6ad-480d-b820-bd093837f35e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:16.938976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315d4c5-e6ad-480d-b820-bd093837f35e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:17.033361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 31/61] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:20:16 2022] POST /identity/v3/users => generated 275 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:20:20.226283 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4067f-737a-4d58-966f-69078a71555a None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:20.227292 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4067f-737a-4d58-966f-69078a71555a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:20.227907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4067f-737a-4d58-966f-69078a71555a None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:20.230537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 31/62] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:20.242912 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ac7c5-1f24-4ea0-890b-5fad27d6f9f0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:20.243827 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ac7c5-1f24-4ea0-890b-5fad27d6f9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:20.244290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ac7c5-1f24-4ea0-890b-5fad27d6f9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:20.272907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d28ac7c5-1f24-4ea0-890b-5fad27d6f9f0 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:20.274474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d28ac7c5-1f24-4ea0-890b-5fad27d6f9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:20.327609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee727a-d185-4a18-9ce6-5644db7466de None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:20.328244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee727a-d185-4a18-9ce6-5644db7466de None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:20.328709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee727a-d185-4a18-9ce6-5644db7466de None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:20.330547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 32/63] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:20.335134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f9404-e764-4696-aac2-ed60c0c69cac None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:20.335647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f9404-e764-4696-aac2-ed60c0c69cac None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:20.336111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f9404-e764-4696-aac2-ed60c0c69cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:20.366566 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c53f9404-e764-4696-aac2-ed60c0c69cac None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:20.369859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c53f9404-e764-4696-aac2-ed60c0c69cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:20.396895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 32/64] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:20.474593 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 33/65] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:20.775126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a7046-48f4-41a2-9bee-07cd69df9976 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:20.775761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a7046-48f4-41a2-9bee-07cd69df9976 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:20.776853 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a7046-48f4-41a2-9bee-07cd69df9976 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:20.778458 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 33/66] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:20.783846 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59fd1c-8b06-492d-9541-1fbbe3fc2e2d None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:20.784419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59fd1c-8b06-492d-9541-1fbbe3fc2e2d None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:20.784885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59fd1c-8b06-492d-9541-1fbbe3fc2e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:20.786356 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a7046-48f4-41a2-9bee-07cd69df9976 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:20.823764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-8a59fd1c-8b06-492d-9541-1fbbe3fc2e2d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:20.824974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8a59fd1c-8b06-492d-9541-1fbbe3fc2e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:20.907030 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 34/67] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:20.908254 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59fd1c-8b06-492d-9541-1fbbe3fc2e2d None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:20.914495 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a7046-48f4-41a2-9bee-07cd69df9976 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:20.930126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:20.954573 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf7dc3-8f41-4085-9d18-5f50ba3a4a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:20.955492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf7dc3-8f41-4085-9d18-5f50ba3a4a0f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:20.955920 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf7dc3-8f41-4085-9d18-5f50ba3a4a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:20.956336 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf7dc3-8f41-4085-9d18-5f50ba3a4a0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:20.969341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf7dc3-8f41-4085-9d18-5f50ba3a4a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-90cf7dc3-8f41-4085-9d18-5f50ba3a4a0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:20.974937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:20.980823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:20.981630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:20.981630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:20.981630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:20.981630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:20.981630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:20.981630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:20.981630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:20.981630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:20.981630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:20.981630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:20.981630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:20.981630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:20.982203 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:20.982268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 34/68] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:20:20.982268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ace64-08c7-419b-b274-bfea7fe69d80 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:20.982268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ace64-08c7-419b-b274-bfea7fe69d80 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:20.982268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ace64-08c7-419b-b274-bfea7fe69d80 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:20.984088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 35/69] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:20.985048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ace64-08c7-419b-b274-bfea7fe69d80 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:21.032537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59fd1c-8b06-492d-9541-1fbbe3fc2e2d None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:21.072687 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a08bf-b7e0-48e0-8942-ea568c645e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:21.074391 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a08bf-b7e0-48e0-8942-ea568c645e78 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:21.074880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a08bf-b7e0-48e0-8942-ea568c645e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:21.075374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a08bf-b7e0-48e0-8942-ea568c645e78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:21.088371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a08bf-b7e0-48e0-8942-ea568c645e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-748a08bf-b7e0-48e0-8942-ea568c645e78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:21.095914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:21.096823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:21.097940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:21.097940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:21.097940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:21.097940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:21.097940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:21.097940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:21.097940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:21.097940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:21.097940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:21.097940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:21.097940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:21.097940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:20:21.100246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 35/70] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:20:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:21.101937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cabd9-304c-487b-9b30-d42460bbe148 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:21.102434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cabd9-304c-487b-9b30-d42460bbe148 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:21.102906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cabd9-304c-487b-9b30-d42460bbe148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:21.118990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ace64-08c7-419b-b274-bfea7fe69d80 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:21.129313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-0a5cabd9-304c-487b-9b30-d42460bbe148 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:21.130514 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-0a5cabd9-304c-487b-9b30-d42460bbe148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:21.163326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e35a7-6819-4ec0-9c09-4cb5e5ed029b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:21.167411 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e35a7-6819-4ec0-9c09-4cb5e5ed029b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:21.168076 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e35a7-6819-4ec0-9c09-4cb5e5ed029b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:21.168570 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e35a7-6819-4ec0-9c09-4cb5e5ed029b None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:21.169489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e35a7-6819-4ec0-9c09-4cb5e5ed029b None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:21.169992 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e35a7-6819-4ec0-9c09-4cb5e5ed029b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:21.171672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e35a7-6819-4ec0-9c09-4cb5e5ed029b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:21.181021 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 36/71] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:21.182210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e35a7-6819-4ec0-9c09-4cb5e5ed029b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:21.218626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:21.220980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 36/72] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:21.221876 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cabd9-304c-487b-9b30-d42460bbe148 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:21.268017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:21.289149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e35a7-6819-4ec0-9c09-4cb5e5ed029b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:21.322652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606f3f5-fe67-4d25-a65e-9db233bc7894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:21.323306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606f3f5-fe67-4d25-a65e-9db233bc7894 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:21.323588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606f3f5-fe67-4d25-a65e-9db233bc7894 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:21.323866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606f3f5-fe67-4d25-a65e-9db233bc7894 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:21.324531 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606f3f5-fe67-4d25-a65e-9db233bc7894 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:21.324838 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606f3f5-fe67-4d25-a65e-9db233bc7894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:21.326143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cabd9-304c-487b-9b30-d42460bbe148 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:21.326304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606f3f5-fe67-4d25-a65e-9db233bc7894 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:21.341032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 37/73] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:21.341032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606f3f5-fe67-4d25-a65e-9db233bc7894 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:21.361563 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62865a96-7197-4cd6-843b-b9b59a9617fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:21.362221 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865a96-7197-4cd6-843b-b9b59a9617fa None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:21.362507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865a96-7197-4cd6-843b-b9b59a9617fa None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:21.362783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865a96-7197-4cd6-843b-b9b59a9617fa None admin] PATH_INFO: `/v3/users/c10bdf610c574721a52a78348cf248de` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:21.377578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62865a96-7197-4cd6-843b-b9b59a9617fa None admin] RBAC: Authorizing `identity:get_user(user_id=c10bdf610c574721a52a78348cf248de)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:21.379033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62865a96-7197-4cd6-843b-b9b59a9617fa None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:21.380796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 37/74] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:21 2022] GET /identity/v3/users/c10bdf610c574721a52a78348cf248de => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:21.382009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf10e1e-765a-4c24-8610-569102e79514 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:21.382330 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf10e1e-765a-4c24-8610-569102e79514 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:21.382573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf10e1e-765a-4c24-8610-569102e79514 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:21.383902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 38/75] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:21.385869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf10e1e-765a-4c24-8610-569102e79514 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:21.453214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:21.457064 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606f3f5-fe67-4d25-a65e-9db233bc7894 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:21.492918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89af0a0-15c0-482b-8c05-e494eba32e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:21.493586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89af0a0-15c0-482b-8c05-e494eba32e4e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:21.493870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89af0a0-15c0-482b-8c05-e494eba32e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:21.494146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89af0a0-15c0-482b-8c05-e494eba32e4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:21.497068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf10e1e-765a-4c24-8610-569102e79514 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:21.498591 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:21.505468 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89af0a0-15c0-482b-8c05-e494eba32e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-c89af0a0-15c0-482b-8c05-e494eba32e4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:21.511830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:21.512765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:21.513682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:21.513682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:21.513682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:21.513682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:21.513682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:21.513682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:21.513682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:21.513682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:21.513682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:21.513682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:21.513682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:21.513682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:21.515224 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 38/76] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:21.516343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89af0a0-15c0-482b-8c05-e494eba32e4e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:21.533082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad742e10-7afc-4aa4-a5f1-968b0dbf8ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:21.533711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad742e10-7afc-4aa4-a5f1-968b0dbf8ffc None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:21.533992 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad742e10-7afc-4aa4-a5f1-968b0dbf8ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:21.534268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad742e10-7afc-4aa4-a5f1-968b0dbf8ffc None admin] PATH_INFO: `/v3/users/f003550e956b429a97e0675a2bc86b98` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:21.535423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad742e10-7afc-4aa4-a5f1-968b0dbf8ffc None admin] RBAC: Authorizing `identity:get_user(user_id=f003550e956b429a97e0675a2bc86b98)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:21.536880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad742e10-7afc-4aa4-a5f1-968b0dbf8ffc None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:21.538475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 39/77] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:21 2022] GET /identity/v3/users/f003550e956b429a97e0675a2bc86b98 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:21.539691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690a9d9-be32-4894-a210-56ea09520872 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:21.539928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690a9d9-be32-4894-a210-56ea09520872 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:21.540202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690a9d9-be32-4894-a210-56ea09520872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:21.559773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-b690a9d9-be32-4894-a210-56ea09520872 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:21.560946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b690a9d9-be32-4894-a210-56ea09520872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:21.625454 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89af0a0-15c0-482b-8c05-e494eba32e4e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:21.626947 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 40/78] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:21.627767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690a9d9-be32-4894-a210-56ea09520872 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:21.672312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef035622-9553-4f21-a98f-355d76446187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:21.672957 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035622-9553-4f21-a98f-355d76446187 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:21.673265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035622-9553-4f21-a98f-355d76446187 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:21.673548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035622-9553-4f21-a98f-355d76446187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:21.702073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:21.732120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:21.735652 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690a9d9-be32-4894-a210-56ea09520872 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:21.743277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef035622-9553-4f21-a98f-355d76446187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:21.744796 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef035622-9553-4f21-a98f-355d76446187 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:21.772948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371512c-9cab-4a1a-b6d1-4380f5c90bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:21.773818 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371512c-9cab-4a1a-b6d1-4380f5c90bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:21.774239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371512c-9cab-4a1a-b6d1-4380f5c90bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:21.774651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371512c-9cab-4a1a-b6d1-4380f5c90bc7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:21.785545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371512c-9cab-4a1a-b6d1-4380f5c90bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-5371512c-9cab-4a1a-b6d1-4380f5c90bc7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:21.790614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:21.792111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:21.793028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:21.793028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:21.793028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:21.793028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:21.793028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:21.793028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:21.793028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:21.793028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:21.793028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:21.793028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:21.793028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:20:21.793028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:20:21.794193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 41/79] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:20:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:21.794984 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371512c-9cab-4a1a-b6d1-4380f5c90bc7 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:21.851923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 39/80] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:21.852839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef035622-9553-4f21-a98f-355d76446187 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:21.904095 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371512c-9cab-4a1a-b6d1-4380f5c90bc7 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:21.916020 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:21.939100 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b174-2048-4c3b-b661-397dad5e27b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:21.939707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b174-2048-4c3b-b661-397dad5e27b8 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:21.940138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b174-2048-4c3b-b661-397dad5e27b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:21.940415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b174-2048-4c3b-b661-397dad5e27b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:21.941102 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11b174-2048-4c3b-b661-397dad5e27b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:21.941408 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11b174-2048-4c3b-b661-397dad5e27b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:21.942795 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11b174-2048-4c3b-b661-397dad5e27b8 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:21.950615 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 42/81] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:21.951396 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b174-2048-4c3b-b661-397dad5e27b8 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:21.959680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef035622-9553-4f21-a98f-355d76446187 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:21.977442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:21.994068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb5fd3-54b7-4463-9c4b-84f2ee81201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:21.998930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb5fd3-54b7-4463-9c4b-84f2ee81201e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:21.998930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb5fd3-54b7-4463-9c4b-84f2ee81201e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:21.998930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb5fd3-54b7-4463-9c4b-84f2ee81201e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:22.053910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b174-2048-4c3b-b661-397dad5e27b8 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:22.061717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb5fd3-54b7-4463-9c4b-84f2ee81201e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:22.063189 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb5fd3-54b7-4463-9c4b-84f2ee81201e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:22.086289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f5883-1538-45fd-b857-9bab222a00df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:22.086886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f5883-1538-45fd-b857-9bab222a00df None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:22.087168 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f5883-1538-45fd-b857-9bab222a00df None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:22.087440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f5883-1538-45fd-b857-9bab222a00df None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:22.088096 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f5883-1538-45fd-b857-9bab222a00df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:22.088924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f5883-1538-45fd-b857-9bab222a00df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:22.090579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f5883-1538-45fd-b857-9bab222a00df None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:22.098236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 43/82] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:20:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:22.099015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f5883-1538-45fd-b857-9bab222a00df None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:22.121440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:22.164038 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 40/83] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:22.164884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb5fd3-54b7-4463-9c4b-84f2ee81201e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:22.190150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:22.205640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f5883-1538-45fd-b857-9bab222a00df None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:22.238868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afccb18-6103-4338-be1f-e8cfe20d4654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:22.239508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afccb18-6103-4338-be1f-e8cfe20d4654 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:22.240060 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afccb18-6103-4338-be1f-e8cfe20d4654 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:22.240850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afccb18-6103-4338-be1f-e8cfe20d4654 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:22.242067 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afccb18-6103-4338-be1f-e8cfe20d4654 None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:22.243524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afccb18-6103-4338-be1f-e8cfe20d4654 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:22.245190 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 44/84] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:22 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:22.245973 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afccb18-6103-4338-be1f-e8cfe20d4654 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:22.268559 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb5fd3-54b7-4463-9c4b-84f2ee81201e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:22.302225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e669189-2010-4107-ace7-35facfcef438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:22.302838 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e669189-2010-4107-ace7-35facfcef438 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:22.303122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e669189-2010-4107-ace7-35facfcef438 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:22.303394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e669189-2010-4107-ace7-35facfcef438 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:22.304559 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e669189-2010-4107-ace7-35facfcef438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:22.306018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e669189-2010-4107-ace7-35facfcef438 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:22.307619 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 41/85] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:22.309849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e669189-2010-4107-ace7-35facfcef438 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:22.336650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:22.347603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afccb18-6103-4338-be1f-e8cfe20d4654 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:22.380338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9edeee-9d5d-4500-9746-dcaf7386eb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:22.380960 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9edeee-9d5d-4500-9746-dcaf7386eb98 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:22.381272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9edeee-9d5d-4500-9746-dcaf7386eb98 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:22.381545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9edeee-9d5d-4500-9746-dcaf7386eb98 None admin] PATH_INFO: `/v3/users/c10bdf610c574721a52a78348cf248de` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:22.382676 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9edeee-9d5d-4500-9746-dcaf7386eb98 None admin] RBAC: Authorizing `identity:get_user(user_id=c10bdf610c574721a52a78348cf248de)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:22.384118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9edeee-9d5d-4500-9746-dcaf7386eb98 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:22.386242 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 45/86] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:22 2022] GET /identity/v3/users/c10bdf610c574721a52a78348cf248de => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:22.386998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9edeee-9d5d-4500-9746-dcaf7386eb98 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:22.408319 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e669189-2010-4107-ace7-35facfcef438 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:22.412265 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:22.443640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c4bda-b0d1-4efc-8bca-13d759e56c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:22.444273 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c4bda-b0d1-4efc-8bca-13d759e56c1f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:22.444554 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c4bda-b0d1-4efc-8bca-13d759e56c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:22.444835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c4bda-b0d1-4efc-8bca-13d759e56c1f None admin] PATH_INFO: `/v3/users/c10bdf610c574721a52a78348cf248de` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:22.446010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c4bda-b0d1-4efc-8bca-13d759e56c1f None admin] RBAC: Authorizing `identity:get_user(user_id=c10bdf610c574721a52a78348cf248de)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:22.447560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c4bda-b0d1-4efc-8bca-13d759e56c1f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:22.449196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 42/87] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:22 2022] GET /identity/v3/users/c10bdf610c574721a52a78348cf248de => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:22.453798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c4bda-b0d1-4efc-8bca-13d759e56c1f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:22.491423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9edeee-9d5d-4500-9746-dcaf7386eb98 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:22.524738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230370b-83e7-48bf-ada3-6d09acac2747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:22.525394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230370b-83e7-48bf-ada3-6d09acac2747 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:22.525679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230370b-83e7-48bf-ada3-6d09acac2747 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:22.525983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230370b-83e7-48bf-ada3-6d09acac2747 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:22.527101 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230370b-83e7-48bf-ada3-6d09acac2747 None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:22.528551 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230370b-83e7-48bf-ada3-6d09acac2747 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:22.530202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 46/88] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:22 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:22.530946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230370b-83e7-48bf-ada3-6d09acac2747 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:22.547182 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:22.553791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c4bda-b0d1-4efc-8bca-13d759e56c1f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:22.588084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6926fd-94a0-4f7a-b751-862d47706252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:22.588642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6926fd-94a0-4f7a-b751-862d47706252 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:22.588923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6926fd-94a0-4f7a-b751-862d47706252 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:22.589221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6926fd-94a0-4f7a-b751-862d47706252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:22.589945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6926fd-94a0-4f7a-b751-862d47706252 None admin] RBAC: Adding query filter params (role.id=28ebd5e6ebbc404e87ed29420b2f4254, scope.project.id=157a31991261402d8b74b6c5316fcb03, user.id=c10bdf610c574721a52a78348cf248de) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:22.590252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6926fd-94a0-4f7a-b751-862d47706252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:22.591694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6926fd-94a0-4f7a-b751-862d47706252 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:22.596894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 43/89] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:22 2022] GET /identity/v3/role_assignments?user.id=c10bdf610c574721a52a78348cf248de&scope.project.id=157a31991261402d8b74b6c5316fcb03&role.id=28ebd5e6ebbc404e87ed29420b2f4254 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:22.597691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6926fd-94a0-4f7a-b751-862d47706252 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:22.624354 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:22.638221 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230370b-83e7-48bf-ada3-6d09acac2747 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:22.679877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2540071-655e-4b4c-b9b5-32be21e762f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:22.680501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2540071-655e-4b4c-b9b5-32be21e762f9 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:22.680781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2540071-655e-4b4c-b9b5-32be21e762f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:22.681089 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2540071-655e-4b4c-b9b5-32be21e762f9 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:22.681764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2540071-655e-4b4c-b9b5-32be21e762f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:22.684180 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2540071-655e-4b4c-b9b5-32be21e762f9 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:22.720153 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6926fd-94a0-4f7a-b751-862d47706252 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:22.756784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32511c55-a44c-49bc-bd50-ad1d6c48874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:22.757439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32511c55-a44c-49bc-bd50-ad1d6c48874e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:22.757723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32511c55-a44c-49bc-bd50-ad1d6c48874e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:22.757994 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32511c55-a44c-49bc-bd50-ad1d6c48874e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:22.787498 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 47/90] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:20:22 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:20:22.788352 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2540071-655e-4b4c-b9b5-32be21e762f9 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:22.793685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:22.856266 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32511c55-a44c-49bc-bd50-ad1d6c48874e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:22.858192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32511c55-a44c-49bc-bd50-ad1d6c48874e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:22.939868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2540071-655e-4b4c-b9b5-32be21e762f9 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:22.989735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 44/91] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:22.990313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32511c55-a44c-49bc-bd50-ad1d6c48874e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:22.994341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de32a-6b60-44e6-a628-92ce3d1f3558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:22.995894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de32a-6b60-44e6-a628-92ce3d1f3558 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:22.996348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de32a-6b60-44e6-a628-92ce3d1f3558 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:22.996761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de32a-6b60-44e6-a628-92ce3d1f3558 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:23.015723 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:23.063280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:23.083660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152de32a-6b60-44e6-a628-92ce3d1f3558 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:23.086660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152de32a-6b60-44e6-a628-92ce3d1f3558 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:23.114205 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32511c55-a44c-49bc-bd50-ad1d6c48874e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:23.154360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05b69e-be20-4a5d-8852-e624a9784b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:23.155120 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05b69e-be20-4a5d-8852-e624a9784b73 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:23.155497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05b69e-be20-4a5d-8852-e624a9784b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:23.155863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05b69e-be20-4a5d-8852-e624a9784b73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:23.157056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05b69e-be20-4a5d-8852-e624a9784b73 None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=157a31991261402d8b74b6c5316fcb03, user.id=f003550e956b429a97e0675a2bc86b98) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:23.157259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05b69e-be20-4a5d-8852-e624a9784b73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:23.158905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05b69e-be20-4a5d-8852-e624a9784b73 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:23.166204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 45/92] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:22 2022] GET /identity/v3/role_assignments?user.id=f003550e956b429a97e0675a2bc86b98&scope.project.id=157a31991261402d8b74b6c5316fcb03&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:23.167893 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05b69e-be20-4a5d-8852-e624a9784b73 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:23.232982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 48/93] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:23.242312 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de32a-6b60-44e6-a628-92ce3d1f3558 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:23.305210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:23.308590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05b69e-be20-4a5d-8852-e624a9784b73 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:23.334026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:23.348322 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb3850-332a-420b-a1a3-4d05c17f6b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:23.349005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb3850-332a-420b-a1a3-4d05c17f6b93 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:23.349301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb3850-332a-420b-a1a3-4d05c17f6b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:23.349577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb3850-332a-420b-a1a3-4d05c17f6b93 None admin] PATH_INFO: `/v3/projects/60f49905e8e34d66a8786ca2a47c6896` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:23.355863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb3850-332a-420b-a1a3-4d05c17f6b93 None admin] RBAC: Authorizing `identity:get_project(project_id=60f49905e8e34d66a8786ca2a47c6896)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:23.355863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb3850-332a-420b-a1a3-4d05c17f6b93 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:23.355863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 46/94] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:23 2022] GET /identity/v3/projects/60f49905e8e34d66a8786ca2a47c6896 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:23.367783 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb3850-332a-420b-a1a3-4d05c17f6b93 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:23.375836 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de32a-6b60-44e6-a628-92ce3d1f3558 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:23.433429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54326bd1-c65a-448a-8a5e-b20a5543fa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:23.434188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54326bd1-c65a-448a-8a5e-b20a5543fa3a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:23.434539 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54326bd1-c65a-448a-8a5e-b20a5543fa3a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:23.434881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54326bd1-c65a-448a-8a5e-b20a5543fa3a None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:23.436098 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54326bd1-c65a-448a-8a5e-b20a5543fa3a None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:23.437664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54326bd1-c65a-448a-8a5e-b20a5543fa3a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:23.439367 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 49/95] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:23 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:23.449016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54326bd1-c65a-448a-8a5e-b20a5543fa3a None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:23.560239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb3850-332a-420b-a1a3-4d05c17f6b93 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:23.627298 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e702bb-9452-44cf-8d4d-4dc881b69f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:23.627834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e702bb-9452-44cf-8d4d-4dc881b69f2b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:23.628111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e702bb-9452-44cf-8d4d-4dc881b69f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:23.628376 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e702bb-9452-44cf-8d4d-4dc881b69f2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:23.629180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e702bb-9452-44cf-8d4d-4dc881b69f2b None admin] RBAC: Adding query filter params (role.id=28ebd5e6ebbc404e87ed29420b2f4254, scope.project.id=60f49905e8e34d66a8786ca2a47c6896, user.id=c10bdf610c574721a52a78348cf248de) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:23.629486 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e702bb-9452-44cf-8d4d-4dc881b69f2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:23.630935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e702bb-9452-44cf-8d4d-4dc881b69f2b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:23.637982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54326bd1-c65a-448a-8a5e-b20a5543fa3a None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:23.642864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 47/96] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:23 2022] GET /identity/v3/role_assignments?user.id=c10bdf610c574721a52a78348cf248de&scope.project.id=60f49905e8e34d66a8786ca2a47c6896&role.id=28ebd5e6ebbc404e87ed29420b2f4254 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:23.662506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:23.677917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b85ee-18c2-49b6-b324-4f79d7331678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:23.678543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b85ee-18c2-49b6-b324-4f79d7331678 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:23.678820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b85ee-18c2-49b6-b324-4f79d7331678 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:23.679090 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b85ee-18c2-49b6-b324-4f79d7331678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:23.679825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b85ee-18c2-49b6-b324-4f79d7331678 None admin] RBAC: Adding query filter params (role.id=22f7e3b007984ad79378413e11b1a86f, scope.project.id=157a31991261402d8b74b6c5316fcb03, user.id=c10bdf610c574721a52a78348cf248de) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:23.680134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b85ee-18c2-49b6-b324-4f79d7331678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:23.681625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b85ee-18c2-49b6-b324-4f79d7331678 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:23.690610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 50/97] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:23 2022] GET /identity/v3/role_assignments?user.id=c10bdf610c574721a52a78348cf248de&scope.project.id=157a31991261402d8b74b6c5316fcb03&role.id=22f7e3b007984ad79378413e11b1a86f => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:25.412816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1100f9-1511-464e-ada8-e8d8df69727f None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:25.413334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1100f9-1511-464e-ada8-e8d8df69727f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:25.413334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1100f9-1511-464e-ada8-e8d8df69727f None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:25.414981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 48/98] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:25.421161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d34283-556f-42e4-9243-9f403b494954 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:25.421611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d34283-556f-42e4-9243-9f403b494954 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:25.421686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d34283-556f-42e4-9243-9f403b494954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:25.446099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c2d34283-556f-42e4-9243-9f403b494954 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:25.447350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c2d34283-556f-42e4-9243-9f403b494954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:25.544580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 51/99] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:26.083430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1100f9-1511-464e-ada8-e8d8df69727f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:26.173523 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:26.230677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1100f9-1511-464e-ada8-e8d8df69727f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:26.273716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef281eb8-8651-4806-a4b3-fb4b7081def1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:26.274364 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef281eb8-8651-4806-a4b3-fb4b7081def1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:26.274647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef281eb8-8651-4806-a4b3-fb4b7081def1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:26.274922 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef281eb8-8651-4806-a4b3-fb4b7081def1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:26.290015 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef281eb8-8651-4806-a4b3-fb4b7081def1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ef281eb8-8651-4806-a4b3-fb4b7081def1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:26.295390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:26.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:26.296967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:26.296967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:26.296967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:26.296967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:26.296967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:26.296967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:26.296967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:26.296967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:26.296967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:26.296967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:26.296967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:26.296967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:26.296967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 49/100] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:26.303728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d34283-556f-42e4-9243-9f403b494954 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:26.515766 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d34283-556f-42e4-9243-9f403b494954 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:26.526573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:26.538077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a0816-952b-4e86-8e73-5f4e4c5bfb35 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:26.538578 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a0816-952b-4e86-8e73-5f4e4c5bfb35 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:26.542047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a0816-952b-4e86-8e73-5f4e4c5bfb35 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:26.542047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 50/101] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:20:26.546240 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adb204-1b2b-4994-a9f5-46ca0c06c51b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:26.546526 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adb204-1b2b-4994-a9f5-46ca0c06c51b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:26.546808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adb204-1b2b-4994-a9f5-46ca0c06c51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:26.565475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0e40f-558a-4efe-b7ca-6a2ecd377824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:26.566178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0e40f-558a-4efe-b7ca-6a2ecd377824 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:26.566464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0e40f-558a-4efe-b7ca-6a2ecd377824 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:26.566737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0e40f-558a-4efe-b7ca-6a2ecd377824 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:26.567425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0e40f-558a-4efe-b7ca-6a2ecd377824 None admin] RBAC: Adding query filter params (name=member) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:26.567730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0e40f-558a-4efe-b7ca-6a2ecd377824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:26.569197 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0e40f-558a-4efe-b7ca-6a2ecd377824 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:26.583680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-41adb204-1b2b-4994-a9f5-46ca0c06c51b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:26.585028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-41adb204-1b2b-4994-a9f5-46ca0c06c51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:26.589246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 52/102] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:26.590219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d5b30-818a-4611-b8f9-9da78960fbfc None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:26.590557 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d5b30-818a-4611-b8f9-9da78960fbfc None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:26.590853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d5b30-818a-4611-b8f9-9da78960fbfc None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:26.592106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 53/103] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:26.597131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d5b30-818a-4611-b8f9-9da78960fbfc None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:26.699814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 51/104] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:20:26.701137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d9b54-3f0a-4140-9201-a48226ecf7a5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:26.701432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d9b54-3f0a-4140-9201-a48226ecf7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:26.701704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d9b54-3f0a-4140-9201-a48226ecf7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:26.730987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-470d9b54-3f0a-4140-9201-a48226ecf7a5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:26.732173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-470d9b54-3f0a-4140-9201-a48226ecf7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:26.738955 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d5b30-818a-4611-b8f9-9da78960fbfc None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:26.773819 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:26.778382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001f126-61fd-42c8-9e17-3c7f53d748bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:26.779432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001f126-61fd-42c8-9e17-3c7f53d748bd None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:26.779927 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001f126-61fd-42c8-9e17-3c7f53d748bd None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:26.780392 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001f126-61fd-42c8-9e17-3c7f53d748bd None admin] PATH_INFO: `/v3/users/c10bdf610c574721a52a78348cf248de` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:26.781733 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001f126-61fd-42c8-9e17-3c7f53d748bd None admin] RBAC: Authorizing `identity:get_user(user_id=c10bdf610c574721a52a78348cf248de)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:26.783369 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001f126-61fd-42c8-9e17-3c7f53d748bd None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:26.789668 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 54/105] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:26 2022] GET /identity/v3/users/c10bdf610c574721a52a78348cf248de => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:26.791155 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672dfeb-6f03-404a-9af5-8708a812f185 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:26.801378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672dfeb-6f03-404a-9af5-8708a812f185 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:26.801378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672dfeb-6f03-404a-9af5-8708a812f185 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:26.801378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 55/106] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:26.801378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404ccd5-9382-4931-bc27-47701e28dfeb None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:26.801378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404ccd5-9382-4931-bc27-47701e28dfeb None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:26.801378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404ccd5-9382-4931-bc27-47701e28dfeb None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:26.801378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 56/107] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:26.801811 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404ccd5-9382-4931-bc27-47701e28dfeb None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:26.805597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 52/108] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:26.807474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a0be7-7e8a-49ad-9f3d-c4ab3a715719 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:26.807668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a0be7-7e8a-49ad-9f3d-c4ab3a715719 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:26.807944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a0be7-7e8a-49ad-9f3d-c4ab3a715719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:26.827187 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-090a0be7-7e8a-49ad-9f3d-c4ab3a715719 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:26.828419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-090a0be7-7e8a-49ad-9f3d-c4ab3a715719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:26.844481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:26.901651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 53/109] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:26.902966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31e3a6-da1a-4947-a369-a4cab57c9a72 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:26.903251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31e3a6-da1a-4947-a369-a4cab57c9a72 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:26.903526 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31e3a6-da1a-4947-a369-a4cab57c9a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:26.918655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404ccd5-9382-4931-bc27-47701e28dfeb None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:26.923329 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-cf31e3a6-da1a-4947-a369-a4cab57c9a72 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:26.924561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cf31e3a6-da1a-4947-a369-a4cab57c9a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:26.955732 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4efca-8042-4bed-92ac-74de1d865bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:26.956742 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4efca-8042-4bed-92ac-74de1d865bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:26.957324 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4efca-8042-4bed-92ac-74de1d865bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:26.957787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4efca-8042-4bed-92ac-74de1d865bf1 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:26.959106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4efca-8042-4bed-92ac-74de1d865bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:26.960857 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4efca-8042-4bed-92ac-74de1d865bf1 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:26.962693 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 57/110] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:26 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:26.969346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4efca-8042-4bed-92ac-74de1d865bf1 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:27.062493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 54/111] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:27.069593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31e3a6-da1a-4947-a369-a4cab57c9a72 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:27.085037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4efca-8042-4bed-92ac-74de1d865bf1 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:27.101023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:27.141661 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3f883-6535-4a55-9ef6-ec4da224bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:27.142794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3f883-6535-4a55-9ef6-ec4da224bc45 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:27.143278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3f883-6535-4a55-9ef6-ec4da224bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:27.143721 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3f883-6535-4a55-9ef6-ec4da224bc45 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03/users/c10bdf610c574721a52a78348cf248de/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:27.146041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3f883-6535-4a55-9ef6-ec4da224bc45 None admin] RBAC: Authorizing `identity:create_grant(project_id=157a31991261402d8b74b6c5316fcb03, user_id=c10bdf610c574721a52a78348cf248de, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:27.147668 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3f883-6535-4a55-9ef6-ec4da224bc45 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:27.174943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:27.237343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 58/112] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:20:26 2022] PUT /identity/v3/projects/157a31991261402d8b74b6c5316fcb03/users/c10bdf610c574721a52a78348cf248de/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:20:27.239189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19550ba-a50d-43e2-ad78-f6d75bc32ab4 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:27.239649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19550ba-a50d-43e2-ad78-f6d75bc32ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:27.240076 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19550ba-a50d-43e2-ad78-f6d75bc32ab4 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:27.248282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 59/113] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:27.252625 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31e3a6-da1a-4947-a369-a4cab57c9a72 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:27.253768 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fcd77-c0e4-4142-94b5-6afc513280dc None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:27.254189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fcd77-c0e4-4142-94b5-6afc513280dc None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:27.254658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fcd77-c0e4-4142-94b5-6afc513280dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:27.285239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2b4fcd77-c0e4-4142-94b5-6afc513280dc None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:27.286877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2b4fcd77-c0e4-4142-94b5-6afc513280dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:27.301756 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155e95e-c7f6-4357-b8dc-e24533d41516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:27.303651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155e95e-c7f6-4357-b8dc-e24533d41516 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:27.303990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155e95e-c7f6-4357-b8dc-e24533d41516 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:27.304313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155e95e-c7f6-4357-b8dc-e24533d41516 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:27.305994 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155e95e-c7f6-4357-b8dc-e24533d41516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:27.308100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155e95e-c7f6-4357-b8dc-e24533d41516 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:27.310105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 55/114] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:27.310993 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155e95e-c7f6-4357-b8dc-e24533d41516 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:27.381466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 60/115] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:20:27.388058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fcd77-c0e4-4142-94b5-6afc513280dc None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:27.448924 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155e95e-c7f6-4357-b8dc-e24533d41516 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:27.459961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:27.489628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87592df-8baf-4b10-82b1-1aced7614125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:27.490261 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87592df-8baf-4b10-82b1-1aced7614125 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:27.490535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87592df-8baf-4b10-82b1-1aced7614125 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:27.490823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87592df-8baf-4b10-82b1-1aced7614125 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:27.505995 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87592df-8baf-4b10-82b1-1aced7614125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-f87592df-8baf-4b10-82b1-1aced7614125 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:27.511576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:27.512475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:27.513353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:27.513353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:27.513353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:27.513353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:27.513353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:27.513353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:27.513353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:27.513353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:27.513353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:27.513353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:27.513353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:27.513353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:27.513353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 56/116] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:20:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:27.513992 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87592df-8baf-4b10-82b1-1aced7614125 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:27.519872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:27.527424 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fcd77-c0e4-4142-94b5-6afc513280dc None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:27.566944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f7add-8087-48a6-97d4-d98d10c6e315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:27.567894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f7add-8087-48a6-97d4-d98d10c6e315 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:27.568405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f7add-8087-48a6-97d4-d98d10c6e315 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:27.568817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f7add-8087-48a6-97d4-d98d10c6e315 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:27.582856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f7add-8087-48a6-97d4-d98d10c6e315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-a84f7add-8087-48a6-97d4-d98d10c6e315 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:27.588588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:27.590675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:27.591429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:27.591429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:27.591429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:27.591429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:27.591429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:27.591429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:27.591429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:27.591429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:27.591429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:27.591429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:27.591429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:27.591429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:20:27.592621 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 61/117] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:27.593790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f7add-8087-48a6-97d4-d98d10c6e315 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:27.642717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87592df-8baf-4b10-82b1-1aced7614125 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:27.688116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9afe58-b4f6-4800-8dcc-4521ff411148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:27.688733 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9afe58-b4f6-4800-8dcc-4521ff411148 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:27.689045 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9afe58-b4f6-4800-8dcc-4521ff411148 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:27.689311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9afe58-b4f6-4800-8dcc-4521ff411148 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:27.690058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9afe58-b4f6-4800-8dcc-4521ff411148 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:27.692260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9afe58-b4f6-4800-8dcc-4521ff411148 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:27.715232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f7add-8087-48a6-97d4-d98d10c6e315 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:27.749608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e6058-65a8-41bc-9f25-68cf9bcd4ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:27.750237 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e6058-65a8-41bc-9f25-68cf9bcd4ebf None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:27.750516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e6058-65a8-41bc-9f25-68cf9bcd4ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:27.750787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e6058-65a8-41bc-9f25-68cf9bcd4ebf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:27.760803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e6058-65a8-41bc-9f25-68cf9bcd4ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-634e6058-65a8-41bc-9f25-68cf9bcd4ebf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:27.765898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:27.766760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:27.767518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:27.767518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:27.767518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:27.767518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:27.767518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:27.767518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:27.767518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:27.767518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:27.767518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:27.767518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:27.767518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:20:27.767518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:20:27.767518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 62/118] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:20:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:27.768144 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e6058-65a8-41bc-9f25-68cf9bcd4ebf None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:27.785265 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:27.788834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 57/119] 10.222.0.50 () {60 vars in 1141 bytes} [Sat Sep 17 04:20:27 2022] POST /identity/v3/projects => generated 302 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:20:27.797666 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9afe58-b4f6-4800-8dcc-4521ff411148 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:27.820180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:27.902239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e6058-65a8-41bc-9f25-68cf9bcd4ebf None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:27.930173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9afe58-b4f6-4800-8dcc-4521ff411148 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:27.955368 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87aeac-1bae-4676-86c2-f1905d648aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:27.955996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87aeac-1bae-4676-86c2-f1905d648aba None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:27.956272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87aeac-1bae-4676-86c2-f1905d648aba None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:27.956542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87aeac-1bae-4676-86c2-f1905d648aba None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:27.957251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87aeac-1bae-4676-86c2-f1905d648aba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:27.957554 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87aeac-1bae-4676-86c2-f1905d648aba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:27.958983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87aeac-1bae-4676-86c2-f1905d648aba None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:27.970401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 63/120] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:27.971428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87aeac-1bae-4676-86c2-f1905d648aba None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:27.972049 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ac3f6-b04f-40a9-b824-e61e722ee897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:27.972965 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ac3f6-b04f-40a9-b824-e61e722ee897 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:27.974288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ac3f6-b04f-40a9-b824-e61e722ee897 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:27.974899 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ac3f6-b04f-40a9-b824-e61e722ee897 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:27.976726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ac3f6-b04f-40a9-b824-e61e722ee897 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:27.977075 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ac3f6-b04f-40a9-b824-e61e722ee897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:27.978712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ac3f6-b04f-40a9-b824-e61e722ee897 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:27.991901 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 58/121] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:27.998186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ac3f6-b04f-40a9-b824-e61e722ee897 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:28.085385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:28.098294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:28.108110 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87aeac-1bae-4676-86c2-f1905d648aba None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:28.126043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ac3f6-b04f-40a9-b824-e61e722ee897 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:28.152603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed6fbd-4bbb-4218-afe3-3860c84eff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:28.153889 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed6fbd-4bbb-4218-afe3-3860c84eff68 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:28.154538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed6fbd-4bbb-4218-afe3-3860c84eff68 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:28.155017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed6fbd-4bbb-4218-afe3-3860c84eff68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:28.163209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98357280-9918-4cc5-8d6f-4f3c07dc78b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:28.163926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357280-9918-4cc5-8d6f-4f3c07dc78b3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:28.164358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357280-9918-4cc5-8d6f-4f3c07dc78b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:28.164553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357280-9918-4cc5-8d6f-4f3c07dc78b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:28.165648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98357280-9918-4cc5-8d6f-4f3c07dc78b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:28.165915 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98357280-9918-4cc5-8d6f-4f3c07dc78b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:28.167753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98357280-9918-4cc5-8d6f-4f3c07dc78b3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:28.170703 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed6fbd-4bbb-4218-afe3-3860c84eff68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:28.176681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 59/122] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:20:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:28.177439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98357280-9918-4cc5-8d6f-4f3c07dc78b3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-43ed6fbd-4bbb-4218-afe3-3860c84eff68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:28.178435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:28.179255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:28.180007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:28.180007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:28.180007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:28.180007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:28.180007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:28.180007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:28.180007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:28.180007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:28.180007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:28.180007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:28.180007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:28.180007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:20:28.184053 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 64/123] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:28.189966 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed6fbd-4bbb-4218-afe3-3860c84eff68 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:28.295313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98357280-9918-4cc5-8d6f-4f3c07dc78b3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:28.321089 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed6fbd-4bbb-4218-afe3-3860c84eff68 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:28.347070 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16547e0-4db5-4bb3-9356-0a241c79b4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:28.348595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16547e0-4db5-4bb3-9356-0a241c79b4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:28.349050 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16547e0-4db5-4bb3-9356-0a241c79b4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:28.349735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16547e0-4db5-4bb3-9356-0a241c79b4a1 None admin] PATH_INFO: `/v3/users/f003550e956b429a97e0675a2bc86b98` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:28.351352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16547e0-4db5-4bb3-9356-0a241c79b4a1 None admin] RBAC: Authorizing `identity:get_user(user_id=f003550e956b429a97e0675a2bc86b98)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:28.355258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16547e0-4db5-4bb3-9356-0a241c79b4a1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:28.357822 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 60/124] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:28 2022] GET /identity/v3/users/f003550e956b429a97e0675a2bc86b98 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:28.359069 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16547e0-4db5-4bb3-9356-0a241c79b4a1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:28.361471 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c85d25-4973-4d40-b5d1-ffee5ef8f3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:28.365239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c85d25-4973-4d40-b5d1-ffee5ef8f3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:28.365239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c85d25-4973-4d40-b5d1-ffee5ef8f3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:28.365239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c85d25-4973-4d40-b5d1-ffee5ef8f3c7 None admin] PATH_INFO: `/v3/users/f803219b46c448619873abec62914fbf` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:28.367446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:28.372368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:28.381194 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c85d25-4973-4d40-b5d1-ffee5ef8f3c7 None admin] RBAC: Authorizing `identity:get_user(user_id=f803219b46c448619873abec62914fbf)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:28.382991 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c85d25-4973-4d40-b5d1-ffee5ef8f3c7 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:28.385276 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 65/125] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:28 2022] GET /identity/v3/users/f803219b46c448619873abec62914fbf => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:28.386243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c85d25-4973-4d40-b5d1-ffee5ef8f3c7 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:28.484106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16547e0-4db5-4bb3-9356-0a241c79b4a1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:28.514230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c85d25-4973-4d40-b5d1-ffee5ef8f3c7 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:28.528598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80576f2-c346-4540-b478-d105a86bca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:28.529294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80576f2-c346-4540-b478-d105a86bca23 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:28.529577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80576f2-c346-4540-b478-d105a86bca23 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:28.529858 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80576f2-c346-4540-b478-d105a86bca23 None admin] PATH_INFO: `/v3/users/c10bdf610c574721a52a78348cf248de` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:28.531109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80576f2-c346-4540-b478-d105a86bca23 None admin] RBAC: Authorizing `identity:get_user(user_id=c10bdf610c574721a52a78348cf248de)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:28.532762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80576f2-c346-4540-b478-d105a86bca23 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:28.534538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 61/126] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:28 2022] GET /identity/v3/users/c10bdf610c574721a52a78348cf248de => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:28.535455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80576f2-c346-4540-b478-d105a86bca23 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:28.555772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc7a3c-971a-46af-ae91-ac57727465fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:28.558107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc7a3c-971a-46af-ae91-ac57727465fa None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:28.558717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc7a3c-971a-46af-ae91-ac57727465fa None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:28.559179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc7a3c-971a-46af-ae91-ac57727465fa None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:28.560042 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc7a3c-971a-46af-ae91-ac57727465fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:28.560536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc7a3c-971a-46af-ae91-ac57727465fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:28.562288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc7a3c-971a-46af-ae91-ac57727465fa None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:28.572284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 66/127] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:28.573444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc7a3c-971a-46af-ae91-ac57727465fa None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:28.626936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:28.636225 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:28.655574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80576f2-c346-4540-b478-d105a86bca23 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:28.687175 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc7a3c-971a-46af-ae91-ac57727465fa None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:28.693535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55a145-76d3-4eb3-94eb-fa4d5549a938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:28.694180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55a145-76d3-4eb3-94eb-fa4d5549a938 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:28.694465 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55a145-76d3-4eb3-94eb-fa4d5549a938 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:28.694747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55a145-76d3-4eb3-94eb-fa4d5549a938 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:28.695900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55a145-76d3-4eb3-94eb-fa4d5549a938 None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:28.697451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55a145-76d3-4eb3-94eb-fa4d5549a938 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:28.701070 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 62/128] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:28 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:28.701942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55a145-76d3-4eb3-94eb-fa4d5549a938 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:28.727260 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8607568-8e2d-48f9-b32a-60e48b0a6817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:28.728278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8607568-8e2d-48f9-b32a-60e48b0a6817 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:28.728846 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8607568-8e2d-48f9-b32a-60e48b0a6817 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:28.729347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8607568-8e2d-48f9-b32a-60e48b0a6817 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:28.804648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8607568-8e2d-48f9-b32a-60e48b0a6817 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:28.806536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8607568-8e2d-48f9-b32a-60e48b0a6817 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:28.817794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55a145-76d3-4eb3-94eb-fa4d5549a938 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:28.855497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52a790-812c-4005-a4a3-dab9209feca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:28.856069 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a790-812c-4005-a4a3-dab9209feca9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:28.856342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a790-812c-4005-a4a3-dab9209feca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:28.856611 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a790-812c-4005-a4a3-dab9209feca9 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:28.857757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52a790-812c-4005-a4a3-dab9209feca9 None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:28.859519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52a790-812c-4005-a4a3-dab9209feca9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:28.861067 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 63/129] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:28 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:28.861902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52a790-812c-4005-a4a3-dab9209feca9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:28.870246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:28.876126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:28.918563 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 67/130] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:28.923182 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8607568-8e2d-48f9-b32a-60e48b0a6817 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:28.974766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52a790-812c-4005-a4a3-dab9209feca9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:29.011302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b0e79-0a55-4d52-8e2d-7e051aa3d182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:29.012261 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b0e79-0a55-4d52-8e2d-7e051aa3d182 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:29.012788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b0e79-0a55-4d52-8e2d-7e051aa3d182 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:29.013317 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b0e79-0a55-4d52-8e2d-7e051aa3d182 None admin] PATH_INFO: `/v3/users/c10bdf610c574721a52a78348cf248de` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:29.014899 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b0e79-0a55-4d52-8e2d-7e051aa3d182 None admin] RBAC: Authorizing `identity:get_user(user_id=c10bdf610c574721a52a78348cf248de)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:29.016753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b0e79-0a55-4d52-8e2d-7e051aa3d182 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:29.018655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 64/131] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:28 2022] GET /identity/v3/users/c10bdf610c574721a52a78348cf248de => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:29.019755 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b0e79-0a55-4d52-8e2d-7e051aa3d182 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:29.025165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8607568-8e2d-48f9-b32a-60e48b0a6817 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:29.063900 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea3568-5c9b-4308-96db-181d612768cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:29.064532 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea3568-5c9b-4308-96db-181d612768cf None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:29.064818 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea3568-5c9b-4308-96db-181d612768cf None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:29.065469 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea3568-5c9b-4308-96db-181d612768cf None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03/users/f003550e956b429a97e0675a2bc86b98/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:29.067850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea3568-5c9b-4308-96db-181d612768cf None admin] RBAC: Authorizing `identity:create_grant(project_id=157a31991261402d8b74b6c5316fcb03, user_id=f003550e956b429a97e0675a2bc86b98, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:29.069118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea3568-5c9b-4308-96db-181d612768cf None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:29.107634 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:29.130189 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b0e79-0a55-4d52-8e2d-7e051aa3d182 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:29.160118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 68/132] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:20:28 2022] PUT /identity/v3/projects/157a31991261402d8b74b6c5316fcb03/users/f003550e956b429a97e0675a2bc86b98/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:20:29.164016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea3568-5c9b-4308-96db-181d612768cf None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:29.176423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3029b3-5d68-4502-9339-4a4d2072d210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:29.177587 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3029b3-5d68-4502-9339-4a4d2072d210 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:29.177587 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3029b3-5d68-4502-9339-4a4d2072d210 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:29.177859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3029b3-5d68-4502-9339-4a4d2072d210 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03/users/c10bdf610c574721a52a78348cf248de/roles/22f7e3b007984ad79378413e11b1a86f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:29.180245 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3029b3-5d68-4502-9339-4a4d2072d210 None admin] RBAC: Authorizing `identity:create_grant(project_id=157a31991261402d8b74b6c5316fcb03, user_id=c10bdf610c574721a52a78348cf248de, role_id=22f7e3b007984ad79378413e11b1a86f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:29.182972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3029b3-5d68-4502-9339-4a4d2072d210 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:29.199282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:29.284208 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 65/133] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:20:29 2022] PUT /identity/v3/projects/157a31991261402d8b74b6c5316fcb03/users/c10bdf610c574721a52a78348cf248de/roles/22f7e3b007984ad79378413e11b1a86f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:20:29.285223 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3029b3-5d68-4502-9339-4a4d2072d210 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:29.289921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea3568-5c9b-4308-96db-181d612768cf None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:29.334081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed1a1d-6148-404b-a138-4f1fb8682436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:29.335202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed1a1d-6148-404b-a138-4f1fb8682436 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:29.335700 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed1a1d-6148-404b-a138-4f1fb8682436 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:29.336183 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed1a1d-6148-404b-a138-4f1fb8682436 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:29.337992 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed1a1d-6148-404b-a138-4f1fb8682436 None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:29.340136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed1a1d-6148-404b-a138-4f1fb8682436 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:29.342684 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 69/134] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:29 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:29.350584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed1a1d-6148-404b-a138-4f1fb8682436 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:29.453314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:29.472352 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed1a1d-6148-404b-a138-4f1fb8682436 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:29.476714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3029b3-5d68-4502-9339-4a4d2072d210 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:29.511817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f388ac2-f273-4c17-991c-1e56736ea565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:29.512816 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f388ac2-f273-4c17-991c-1e56736ea565 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:29.513380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f388ac2-f273-4c17-991c-1e56736ea565 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:29.513890 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f388ac2-f273-4c17-991c-1e56736ea565 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:29.515192 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f388ac2-f273-4c17-991c-1e56736ea565 None admin] RBAC: Adding query filter params (role.id=8072bf5817774f5786c71af7d54b87b5, scope.project.id=157a31991261402d8b74b6c5316fcb03, user.id=f803219b46c448619873abec62914fbf) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:29.515726 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f388ac2-f273-4c17-991c-1e56736ea565 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:29.517479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f388ac2-f273-4c17-991c-1e56736ea565 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:29.523838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 70/135] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:29 2022] GET /identity/v3/role_assignments?user.id=f803219b46c448619873abec62914fbf&scope.project.id=157a31991261402d8b74b6c5316fcb03&role.id=8072bf5817774f5786c71af7d54b87b5 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:29.555774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466e1cf-11e5-47fc-8a5e-a986dcbe6155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:29.556446 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466e1cf-11e5-47fc-8a5e-a986dcbe6155 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:29.557381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466e1cf-11e5-47fc-8a5e-a986dcbe6155 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:29.557656 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466e1cf-11e5-47fc-8a5e-a986dcbe6155 None admin] PATH_INFO: `/v3/projects/60f49905e8e34d66a8786ca2a47c6896` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:29.562059 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466e1cf-11e5-47fc-8a5e-a986dcbe6155 None admin] RBAC: Authorizing `identity:get_project(project_id=60f49905e8e34d66a8786ca2a47c6896)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:29.563704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466e1cf-11e5-47fc-8a5e-a986dcbe6155 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:29.565757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 66/136] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:29 2022] GET /identity/v3/projects/60f49905e8e34d66a8786ca2a47c6896 => generated 312 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:29.571790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f388ac2-f273-4c17-991c-1e56736ea565 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:29.726161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f388ac2-f273-4c17-991c-1e56736ea565 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:29.731846 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aace74b-ec1f-4c8a-b014-a3ad7d53f872 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:29.732765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aace74b-ec1f-4c8a-b014-a3ad7d53f872 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:29.733295 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aace74b-ec1f-4c8a-b014-a3ad7d53f872 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:29.735008 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 67/137] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:20:29.743152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6869f-a09e-4821-a570-32b48719b4e7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:29.743839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6869f-a09e-4821-a570-32b48719b4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:29.744889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6869f-a09e-4821-a570-32b48719b4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:29.761522 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:29.770323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-70a6869f-a09e-4821-a570-32b48719b4e7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:29.771873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-70a6869f-a09e-4821-a570-32b48719b4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:29.827016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960776e6-9ac5-40d0-8ff5-3d4caff4e46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:29.827684 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960776e6-9ac5-40d0-8ff5-3d4caff4e46a None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:29.827967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960776e6-9ac5-40d0-8ff5-3d4caff4e46a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:29.828247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960776e6-9ac5-40d0-8ff5-3d4caff4e46a None admin] PATH_INFO: `/v3/projects/60f49905e8e34d66a8786ca2a47c6896/users/c10bdf610c574721a52a78348cf248de/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:29.834299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960776e6-9ac5-40d0-8ff5-3d4caff4e46a None admin] RBAC: Authorizing `identity:create_grant(project_id=60f49905e8e34d66a8786ca2a47c6896, user_id=c10bdf610c574721a52a78348cf248de, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:29.835769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960776e6-9ac5-40d0-8ff5-3d4caff4e46a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:29.857233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 68/138] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:20:29.948046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 71/139] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:20:29 2022] PUT /identity/v3/projects/60f49905e8e34d66a8786ca2a47c6896/users/c10bdf610c574721a52a78348cf248de/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:20:30.183525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6869f-a09e-4821-a570-32b48719b4e7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:30.308167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6869f-a09e-4821-a570-32b48719b4e7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:30.325909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86569084-90c9-443d-960a-a1d4f8b4b593 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:30.326253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86569084-90c9-443d-960a-a1d4f8b4b593 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:30.326537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86569084-90c9-443d-960a-a1d4f8b4b593 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:30.327912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 72/140] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:30.333542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01600d64-f889-4634-bbed-5364293a9b8e None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:30.334102 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01600d64-f889-4634-bbed-5364293a9b8e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:30.334578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01600d64-f889-4634-bbed-5364293a9b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:30.354000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dd117-a3a2-4826-a93c-1e2970939845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:30.354735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd117-a3a2-4826-a93c-1e2970939845 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:30.357876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd117-a3a2-4826-a93c-1e2970939845 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:30.357876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd117-a3a2-4826-a93c-1e2970939845 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:30.358300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:30.360401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-01600d64-f889-4634-bbed-5364293a9b8e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:30.362030 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-01600d64-f889-4634-bbed-5364293a9b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:30.364511 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:30.369562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dd117-a3a2-4826-a93c-1e2970939845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1d0dd117-a3a2-4826-a93c-1e2970939845 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:30.375346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:30.376272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:30.377047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:30.377047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:30.377047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:30.377047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:30.377047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:30.377047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:30.377047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:30.377047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:30.377047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:30.377047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:30.377047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:30.377047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:30.377616 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 69/141] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:30.382791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dd117-a3a2-4826-a93c-1e2970939845 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:30.443567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 73/142] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:20:30.488497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dd117-a3a2-4826-a93c-1e2970939845 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:30.524277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649ae6a-ac19-489a-a6af-0b9192a7bc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:30.524901 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649ae6a-ac19-489a-a6af-0b9192a7bc1b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:30.525728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649ae6a-ac19-489a-a6af-0b9192a7bc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:30.526008 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649ae6a-ac19-489a-a6af-0b9192a7bc1b None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:30.526681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649ae6a-ac19-489a-a6af-0b9192a7bc1b None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:30.526983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649ae6a-ac19-489a-a6af-0b9192a7bc1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:30.528524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649ae6a-ac19-489a-a6af-0b9192a7bc1b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:30.537274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 70/143] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:30.543329 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01600d64-f889-4634-bbed-5364293a9b8e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:30.664915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01600d64-f889-4634-bbed-5364293a9b8e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:30.711739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3cb25-1807-4e8e-b4d5-d52092179dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:30.712295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3cb25-1807-4e8e-b4d5-d52092179dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:30.712576 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3cb25-1807-4e8e-b4d5-d52092179dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:30.712910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3cb25-1807-4e8e-b4d5-d52092179dd1 None admin] PATH_INFO: `/v3/users/c10bdf610c574721a52a78348cf248de` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:30.717656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3cb25-1807-4e8e-b4d5-d52092179dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=c10bdf610c574721a52a78348cf248de)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:30.719113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3cb25-1807-4e8e-b4d5-d52092179dd1 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:30.720690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 74/144] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:30 2022] GET /identity/v3/users/c10bdf610c574721a52a78348cf248de => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:30.726483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649ae6a-ac19-489a-a6af-0b9192a7bc1b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:30.767464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3cb25-1807-4e8e-b4d5-d52092179dd1 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:30.776636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:30.848685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:30.879610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3cb25-1807-4e8e-b4d5-d52092179dd1 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:30.924185 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649ae6a-ac19-489a-a6af-0b9192a7bc1b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:30.959869 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263400fe-5382-4b9c-929b-5e9b0e2c9893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:30.960793 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263400fe-5382-4b9c-929b-5e9b0e2c9893 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:30.961258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263400fe-5382-4b9c-929b-5e9b0e2c9893 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:30.961697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263400fe-5382-4b9c-929b-5e9b0e2c9893 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:30.970358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db175568-e49e-4386-8699-9ce8dde5c08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:30.970940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db175568-e49e-4386-8699-9ce8dde5c08d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:30.971216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db175568-e49e-4386-8699-9ce8dde5c08d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:30.971481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db175568-e49e-4386-8699-9ce8dde5c08d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:30.972593 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db175568-e49e-4386-8699-9ce8dde5c08d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:30.974070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db175568-e49e-4386-8699-9ce8dde5c08d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:30.980734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 75/145] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:30.981820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db175568-e49e-4386-8699-9ce8dde5c08d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:31.077098 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263400fe-5382-4b9c-929b-5e9b0e2c9893 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:31.078842 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263400fe-5382-4b9c-929b-5e9b0e2c9893 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:31.163734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:31.196357 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:31.241658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 71/146] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:31.247622 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263400fe-5382-4b9c-929b-5e9b0e2c9893 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:31.255739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db175568-e49e-4386-8699-9ce8dde5c08d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:31.299804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719cee4-f01a-450f-849d-89e89a26208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:31.300490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719cee4-f01a-450f-849d-89e89a26208e None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:31.300770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719cee4-f01a-450f-849d-89e89a26208e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:31.301065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719cee4-f01a-450f-849d-89e89a26208e None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:31.305012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719cee4-f01a-450f-849d-89e89a26208e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:31.305012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719cee4-f01a-450f-849d-89e89a26208e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:31.435891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 76/147] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:20:30 2022] POST /identity/v3/users => generated 283 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:20:31.451126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263400fe-5382-4b9c-929b-5e9b0e2c9893 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:31.498462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58567b35-2acf-494d-86a7-b60630399b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:31.499033 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58567b35-2acf-494d-86a7-b60630399b26 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:31.499309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58567b35-2acf-494d-86a7-b60630399b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:31.499631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58567b35-2acf-494d-86a7-b60630399b26 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:31.501991 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58567b35-2acf-494d-86a7-b60630399b26 None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:31.503474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58567b35-2acf-494d-86a7-b60630399b26 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:31.505165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 72/148] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:31 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:31.511792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719cee4-f01a-450f-849d-89e89a26208e None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:31.649027 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719cee4-f01a-450f-849d-89e89a26208e None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:31.701123 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:31.714850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64a9e3-3e50-4e56-b576-53bde00d6903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:31.719625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64a9e3-3e50-4e56-b576-53bde00d6903 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:31.719625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64a9e3-3e50-4e56-b576-53bde00d6903 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:31.719625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64a9e3-3e50-4e56-b576-53bde00d6903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:31.719625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64a9e3-3e50-4e56-b576-53bde00d6903 None admin] RBAC: Adding query filter params (role.id=28ebd5e6ebbc404e87ed29420b2f4254, scope.project.id=157a31991261402d8b74b6c5316fcb03, user.id=c10bdf610c574721a52a78348cf248de) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:31.719625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64a9e3-3e50-4e56-b576-53bde00d6903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:31.719625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64a9e3-3e50-4e56-b576-53bde00d6903 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:31.725830 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 77/149] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:31 2022] GET /identity/v3/role_assignments?user.id=c10bdf610c574721a52a78348cf248de&scope.project.id=157a31991261402d8b74b6c5316fcb03&role.id=28ebd5e6ebbc404e87ed29420b2f4254 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:32.371537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cec0c-8e33-4fa9-8835-268523ba6755 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:32.372184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cec0c-8e33-4fa9-8835-268523ba6755 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:32.372184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cec0c-8e33-4fa9-8835-268523ba6755 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:32.373461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 73/150] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:32.379062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc015-3188-4c06-a700-3e8107ccfb81 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:32.379346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc015-3188-4c06-a700-3e8107ccfb81 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:32.379620 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc015-3188-4c06-a700-3e8107ccfb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:32.399251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c98bc015-3188-4c06-a700-3e8107ccfb81 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:32.400488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c98bc015-3188-4c06-a700-3e8107ccfb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:32.479035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 78/151] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:32.774539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cec0c-8e33-4fa9-8835-268523ba6755 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:32.809549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:32.824469 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54f69e-863a-412a-9e23-9c09bf8265a3 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:32.826054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54f69e-863a-412a-9e23-9c09bf8265a3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:32.826054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54f69e-863a-412a-9e23-9c09bf8265a3 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:32.826439 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 79/152] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:20:32.832371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe138c-2260-48a0-b5f8-f0000eecb332 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:32.832688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe138c-2260-48a0-b5f8-f0000eecb332 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:32.832918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe138c-2260-48a0-b5f8-f0000eecb332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:32.868128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2efe138c-2260-48a0-b5f8-f0000eecb332 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:32.869575 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2efe138c-2260-48a0-b5f8-f0000eecb332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:32.955459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cec0c-8e33-4fa9-8835-268523ba6755 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:33.007984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f354e-9040-4e01-9a1e-f191763640ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:33.008645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f354e-9040-4e01-9a1e-f191763640ff None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:33.008906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f354e-9040-4e01-9a1e-f191763640ff None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:33.010428 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f354e-9040-4e01-9a1e-f191763640ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:33.020691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 80/153] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 17 04:20:33.022260 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e524b62-21d3-4b46-a8bb-6c6065f18782 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:33.022735 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e524b62-21d3-4b46-a8bb-6c6065f18782 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:33.023228 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e524b62-21d3-4b46-a8bb-6c6065f18782 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:33.024947 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 81/154] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:33.028366 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f354e-9040-4e01-9a1e-f191763640ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:33.031601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307df2f-37d8-466d-a373-d92670dd436c None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:33.031995 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307df2f-37d8-466d-a373-d92670dd436c None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:33.032373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307df2f-37d8-466d-a373-d92670dd436c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-515f354e-9040-4e01-9a1e-f191763640ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:33.034231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:33.035176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:33.035963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:33.035963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:33.035963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:33.035963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:33.035963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:33.035963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:33.035963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:33.035963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:33.035963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:33.035963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:33.035963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:20:33.035963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:33.038380 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 74/155] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:20:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:33.043458 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40992f-bef3-4dca-88d4-6764a875ee50 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:33.043458 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40992f-bef3-4dca-88d4-6764a875ee50 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:33.043458 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40992f-bef3-4dca-88d4-6764a875ee50 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:33.044456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 75/156] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:33.045023 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40992f-bef3-4dca-88d4-6764a875ee50 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:33.061534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-3307df2f-37d8-466d-a373-d92670dd436c None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:33.062871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-3307df2f-37d8-466d-a373-d92670dd436c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:33.133734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:33.168587 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 82/157] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:20:33.171498 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb208-7861-4e9b-88f1-e4e249875ea1 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:33.171498 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb208-7861-4e9b-88f1-e4e249875ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:33.171498 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb208-7861-4e9b-88f1-e4e249875ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:33.192380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-204fb208-7861-4e9b-88f1-e4e249875ea1 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:33.193925 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-204fb208-7861-4e9b-88f1-e4e249875ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:33.211492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:33.253693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40992f-bef3-4dca-88d4-6764a875ee50 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:33.267350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 83/158] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:33.315085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27818d86-46a1-4d60-9e00-97082ccdc75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:33.315778 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818d86-46a1-4d60-9e00-97082ccdc75a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:33.316052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818d86-46a1-4d60-9e00-97082ccdc75a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:33.316319 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818d86-46a1-4d60-9e00-97082ccdc75a None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:33.317153 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27818d86-46a1-4d60-9e00-97082ccdc75a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:33.317453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27818d86-46a1-4d60-9e00-97082ccdc75a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:33.320120 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27818d86-46a1-4d60-9e00-97082ccdc75a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:33.329349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 76/159] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:20:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:33.335539 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fb208-7861-4e9b-88f1-e4e249875ea1 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:33.416897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27818d86-46a1-4d60-9e00-97082ccdc75a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:33.472943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fb208-7861-4e9b-88f1-e4e249875ea1 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:33.494752 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:33.521347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6837a1-0a9a-48c1-90d7-c1dfc55efb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:33.522353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6837a1-0a9a-48c1-90d7-c1dfc55efb75 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:33.522879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6837a1-0a9a-48c1-90d7-c1dfc55efb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:33.523370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6837a1-0a9a-48c1-90d7-c1dfc55efb75 None admin] PATH_INFO: `/v3/users/c10bdf610c574721a52a78348cf248de` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:33.524739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6837a1-0a9a-48c1-90d7-c1dfc55efb75 None admin] RBAC: Authorizing `identity:get_user(user_id=c10bdf610c574721a52a78348cf248de)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:33.526625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6837a1-0a9a-48c1-90d7-c1dfc55efb75 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:33.528448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 84/160] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:33 2022] GET /identity/v3/users/c10bdf610c574721a52a78348cf248de => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:33.537145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6837a1-0a9a-48c1-90d7-c1dfc55efb75 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:33.661527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27818d86-46a1-4d60-9e00-97082ccdc75a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:33.702341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f0c14-2ab8-45f3-824d-23a4544973e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:33.702983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f0c14-2ab8-45f3-824d-23a4544973e6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:33.703264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f0c14-2ab8-45f3-824d-23a4544973e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:33.703535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f0c14-2ab8-45f3-824d-23a4544973e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:33.716422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f0c14-2ab8-45f3-824d-23a4544973e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-557f0c14-2ab8-45f3-824d-23a4544973e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:33.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:33.723805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:33.725207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:33.725207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:33.725207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:33.725207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:33.725207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:33.725207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:33.725207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:33.725207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:33.725207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:33.725207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:33.725207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:33.725207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:33.725207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 77/161] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:20:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:20:33.725856 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f0c14-2ab8-45f3-824d-23a4544973e6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:33.737702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6837a1-0a9a-48c1-90d7-c1dfc55efb75 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:33.740406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:33.815270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c7cb6-f596-4100-8466-e4aaed7607c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:33.816314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c7cb6-f596-4100-8466-e4aaed7607c9 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:33.817541 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c7cb6-f596-4100-8466-e4aaed7607c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:33.818199 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c7cb6-f596-4100-8466-e4aaed7607c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:33.840139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c7cb6-f596-4100-8466-e4aaed7607c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-5f8c7cb6-f596-4100-8466-e4aaed7607c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:33.846115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:33.846974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:33.847748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:33.847748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:33.847748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:33.847748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:33.847748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:33.847748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:33.847748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:33.847748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:33.847748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:33.847748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:33.847748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:33.847748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:20:33.850537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 85/162] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:20:33.851731 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c7cb6-f596-4100-8466-e4aaed7607c9 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:33.902911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f0c14-2ab8-45f3-824d-23a4544973e6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:33.906625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:33.971229 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c7cb6-f596-4100-8466-e4aaed7607c9 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:34.000867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd7cae-3d18-4c7d-9ee7-7a79d9eb0eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:34.001852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd7cae-3d18-4c7d-9ee7-7a79d9eb0eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:34.001852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd7cae-3d18-4c7d-9ee7-7a79d9eb0eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:34.002228 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd7cae-3d18-4c7d-9ee7-7a79d9eb0eb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:34.010063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec9ad5-c4da-4f6a-9664-4328bcba9bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:34.011845 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec9ad5-c4da-4f6a-9664-4328bcba9bbe None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:34.012346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec9ad5-c4da-4f6a-9664-4328bcba9bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:34.012791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec9ad5-c4da-4f6a-9664-4328bcba9bbe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:34.031454 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec9ad5-c4da-4f6a-9664-4328bcba9bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-ceec9ad5-c4da-4f6a-9664-4328bcba9bbe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:34.043715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:34.044784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:34.045572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:34.045572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:34.045572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:34.045572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:34.045572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:34.045572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:34.045572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:34.045572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:34.045572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:34.045572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:34.045572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:34.045572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:20:34.047966 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 86/163] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:34.048915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec9ad5-c4da-4f6a-9664-4328bcba9bbe None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:34.126648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd7cae-3d18-4c7d-9ee7-7a79d9eb0eb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:34.128315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd7cae-3d18-4c7d-9ee7-7a79d9eb0eb6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:34.140458 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:34.185557 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec9ad5-c4da-4f6a-9664-4328bcba9bbe None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:34.187523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:34.225588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943df719-910b-488d-b156-0ac1bd8112da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:34.226718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943df719-910b-488d-b156-0ac1bd8112da None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:34.227386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943df719-910b-488d-b156-0ac1bd8112da None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:34.227819 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943df719-910b-488d-b156-0ac1bd8112da None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:34.229195 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943df719-910b-488d-b156-0ac1bd8112da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:34.229663 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943df719-910b-488d-b156-0ac1bd8112da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:34.231352 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943df719-910b-488d-b156-0ac1bd8112da None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:34.241487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 87/164] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:34.242655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943df719-910b-488d-b156-0ac1bd8112da None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:34.312073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 78/165] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:34.312777 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd7cae-3d18-4c7d-9ee7-7a79d9eb0eb6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:34.411781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943df719-910b-488d-b156-0ac1bd8112da None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:34.476059 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecf778-79ae-4722-96c1-d427aeb5f5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:34.476579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecf778-79ae-4722-96c1-d427aeb5f5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:34.476896 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecf778-79ae-4722-96c1-d427aeb5f5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:34.477188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecf778-79ae-4722-96c1-d427aeb5f5a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:34.477848 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecf778-79ae-4722-96c1-d427aeb5f5a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:34.478730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecf778-79ae-4722-96c1-d427aeb5f5a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:34.480297 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecf778-79ae-4722-96c1-d427aeb5f5a1 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:34.488941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 88/166] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:34.490923 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecf778-79ae-4722-96c1-d427aeb5f5a1 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:34.506391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd7cae-3d18-4c7d-9ee7-7a79d9eb0eb6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:34.520683 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:34.532698 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:34.554726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4924b4-97ff-41f1-ab16-bbe3dc5e5152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:34.555398 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4924b4-97ff-41f1-ab16-bbe3dc5e5152 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:34.555680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4924b4-97ff-41f1-ab16-bbe3dc5e5152 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:34.555951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4924b4-97ff-41f1-ab16-bbe3dc5e5152 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:34.556725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4924b4-97ff-41f1-ab16-bbe3dc5e5152 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:34.557048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4924b4-97ff-41f1-ab16-bbe3dc5e5152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:34.558558 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4924b4-97ff-41f1-ab16-bbe3dc5e5152 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:34.568622 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 79/167] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:34.569651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4924b4-97ff-41f1-ab16-bbe3dc5e5152 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:34.680112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecf778-79ae-4722-96c1-d427aeb5f5a1 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:34.716481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156390b-7843-4e04-a1ac-e9fc7ab0001c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:34.717140 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156390b-7843-4e04-a1ac-e9fc7ab0001c None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:34.717415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156390b-7843-4e04-a1ac-e9fc7ab0001c None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:34.717680 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156390b-7843-4e04-a1ac-e9fc7ab0001c None admin] PATH_INFO: `/v3/users/f003550e956b429a97e0675a2bc86b98` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:34.718801 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156390b-7843-4e04-a1ac-e9fc7ab0001c None admin] RBAC: Authorizing `identity:get_user(user_id=f003550e956b429a97e0675a2bc86b98)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:34.720249 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156390b-7843-4e04-a1ac-e9fc7ab0001c None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:34.722007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 89/168] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:34 2022] GET /identity/v3/users/f003550e956b429a97e0675a2bc86b98 => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:34.722597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156390b-7843-4e04-a1ac-e9fc7ab0001c None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:34.733206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4924b4-97ff-41f1-ab16-bbe3dc5e5152 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:34.801811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb192ce-5585-428b-9b82-e0660b0288cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:34.802440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb192ce-5585-428b-9b82-e0660b0288cf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:34.802713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb192ce-5585-428b-9b82-e0660b0288cf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:34.802979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb192ce-5585-428b-9b82-e0660b0288cf None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:34.805201 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb192ce-5585-428b-9b82-e0660b0288cf None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:34.807024 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb192ce-5585-428b-9b82-e0660b0288cf None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:34.808858 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 80/169] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:34 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:34.809466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb192ce-5585-428b-9b82-e0660b0288cf None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:34.878289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:34.892094 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156390b-7843-4e04-a1ac-e9fc7ab0001c None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:34.893127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:34.950136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829cc49-bb7a-4dc5-b181-68cd35bc89e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:34.950772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829cc49-bb7a-4dc5-b181-68cd35bc89e0 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:34.951045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829cc49-bb7a-4dc5-b181-68cd35bc89e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:34.951310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829cc49-bb7a-4dc5-b181-68cd35bc89e0 None admin] PATH_INFO: `/v3/users/c10bdf610c574721a52a78348cf248de` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:34.952740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829cc49-bb7a-4dc5-b181-68cd35bc89e0 None admin] RBAC: Authorizing `identity:get_user(user_id=c10bdf610c574721a52a78348cf248de)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:34.954208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829cc49-bb7a-4dc5-b181-68cd35bc89e0 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:34.957229 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 90/170] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:34 2022] GET /identity/v3/users/c10bdf610c574721a52a78348cf248de => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:34.958486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829cc49-bb7a-4dc5-b181-68cd35bc89e0 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:35.027700 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb192ce-5585-428b-9b82-e0660b0288cf None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:35.073683 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829cc49-bb7a-4dc5-b181-68cd35bc89e0 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:35.097551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6161c-c212-406b-b73b-6c72eeb0021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:35.098554 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6161c-c212-406b-b73b-6c72eeb0021d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:35.099029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6161c-c212-406b-b73b-6c72eeb0021d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:35.099507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6161c-c212-406b-b73b-6c72eeb0021d None admin] PATH_INFO: `/v3/users/f803219b46c448619873abec62914fbf` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:35.100881 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6161c-c212-406b-b73b-6c72eeb0021d None admin] RBAC: Authorizing `identity:get_user(user_id=f803219b46c448619873abec62914fbf)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:35.102568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6161c-c212-406b-b73b-6c72eeb0021d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:35.104943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 81/171] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:34 2022] GET /identity/v3/users/f803219b46c448619873abec62914fbf => generated 289 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:35.105977 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6161c-c212-406b-b73b-6c72eeb0021d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:35.137445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110d171-e355-47ab-98f4-1b7df7194031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:35.138060 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110d171-e355-47ab-98f4-1b7df7194031 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:35.138337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110d171-e355-47ab-98f4-1b7df7194031 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:35.138614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110d171-e355-47ab-98f4-1b7df7194031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:35.214931 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:35.268355 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110d171-e355-47ab-98f4-1b7df7194031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:35.270162 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110d171-e355-47ab-98f4-1b7df7194031 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:35.323551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6161c-c212-406b-b73b-6c72eeb0021d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:35.345023 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:35.385898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 91/172] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:35.386999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110d171-e355-47ab-98f4-1b7df7194031 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:35.413064 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123be6a3-f1e2-47e3-a353-8099f30e807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:35.414025 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be6a3-f1e2-47e3-a353-8099f30e807b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:35.414511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be6a3-f1e2-47e3-a353-8099f30e807b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:35.414981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be6a3-f1e2-47e3-a353-8099f30e807b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:35.425017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123be6a3-f1e2-47e3-a353-8099f30e807b None admin] RBAC: Adding query filter params (role.id=22f7e3b007984ad79378413e11b1a86f, scope.project.id=157a31991261402d8b74b6c5316fcb03, user.id=c10bdf610c574721a52a78348cf248de) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:35.425569 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123be6a3-f1e2-47e3-a353-8099f30e807b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:35.427193 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123be6a3-f1e2-47e3-a353-8099f30e807b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:35.442897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 82/173] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:35 2022] GET /identity/v3/role_assignments?user.id=c10bdf610c574721a52a78348cf248de&scope.project.id=157a31991261402d8b74b6c5316fcb03&role.id=22f7e3b007984ad79378413e11b1a86f => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:35.443981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123be6a3-f1e2-47e3-a353-8099f30e807b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:35.471018 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:35.543680 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110d171-e355-47ab-98f4-1b7df7194031 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:35.596011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afac102-14d7-4baf-82ef-088869e4db82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:35.596867 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afac102-14d7-4baf-82ef-088869e4db82 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:35.597349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afac102-14d7-4baf-82ef-088869e4db82 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:35.597793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afac102-14d7-4baf-82ef-088869e4db82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:35.635470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123be6a3-f1e2-47e3-a353-8099f30e807b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:35.677125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34505baf-0c62-42f7-87c6-57e72955a033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:35.678195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34505baf-0c62-42f7-87c6-57e72955a033 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:35.678671 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34505baf-0c62-42f7-87c6-57e72955a033 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:35.679144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34505baf-0c62-42f7-87c6-57e72955a033 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:35.680625 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34505baf-0c62-42f7-87c6-57e72955a033 None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:35.682521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34505baf-0c62-42f7-87c6-57e72955a033 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:35.684649 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 83/174] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:35 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:35.685714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34505baf-0c62-42f7-87c6-57e72955a033 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:35.701142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afac102-14d7-4baf-82ef-088869e4db82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:35.702883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afac102-14d7-4baf-82ef-088869e4db82 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:35.775965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:35.781375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:35.819149 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 92/175] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:35.820444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e82514-b14d-4044-b0bc-71561f26446a None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:35.820827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e82514-b14d-4044-b0bc-71561f26446a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:35.821153 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e82514-b14d-4044-b0bc-71561f26446a None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:35.823271 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 93/176] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:35.826143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e82514-b14d-4044-b0bc-71561f26446a None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:35.854548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34505baf-0c62-42f7-87c6-57e72955a033 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:35.892145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a2c4b-7149-4e8a-a295-6bda73ddc055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:35.892773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a2c4b-7149-4e8a-a295-6bda73ddc055 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:35.893072 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a2c4b-7149-4e8a-a295-6bda73ddc055 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:35.893347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a2c4b-7149-4e8a-a295-6bda73ddc055 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:35.894444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a2c4b-7149-4e8a-a295-6bda73ddc055 None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:35.895882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a2c4b-7149-4e8a-a295-6bda73ddc055 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:35.897532 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 84/177] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:35 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:35.898627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794f241-bf7e-4db5-af4b-9b316fdfd3d7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:35.898909 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794f241-bf7e-4db5-af4b-9b316fdfd3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:35.899170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794f241-bf7e-4db5-af4b-9b316fdfd3d7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:35.901081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 85/178] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:35.905347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678cbab-e2f3-447c-a408-7bf4e3db3e55 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:35.905347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678cbab-e2f3-447c-a408-7bf4e3db3e55 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:35.905347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678cbab-e2f3-447c-a408-7bf4e3db3e55 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:35.905347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 86/179] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:35.905347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678cbab-e2f3-447c-a408-7bf4e3db3e55 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:35.940145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e82514-b14d-4044-b0bc-71561f26446a None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:35.973687 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080a20f-b18f-4615-aa8b-83d7d379db38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:35.974331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080a20f-b18f-4615-aa8b-83d7d379db38 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:35.974604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080a20f-b18f-4615-aa8b-83d7d379db38 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:35.974872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080a20f-b18f-4615-aa8b-83d7d379db38 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03/users/f803219b46c448619873abec62914fbf/roles/8072bf5817774f5786c71af7d54b87b5` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:35.976718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080a20f-b18f-4615-aa8b-83d7d379db38 None admin] RBAC: Authorizing `identity:create_grant(project_id=157a31991261402d8b74b6c5316fcb03, user_id=f803219b46c448619873abec62914fbf, role_id=8072bf5817774f5786c71af7d54b87b5)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:35.978397 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080a20f-b18f-4615-aa8b-83d7d379db38 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:36.002516 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678cbab-e2f3-447c-a408-7bf4e3db3e55 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:36.009695 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:36.035898 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b405b-930a-43f4-93c2-2a00b14861fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:36.036514 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b405b-930a-43f4-93c2-2a00b14861fb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:36.036809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b405b-930a-43f4-93c2-2a00b14861fb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:36.037121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b405b-930a-43f4-93c2-2a00b14861fb None admin] PATH_INFO: `/v3/projects/60f49905e8e34d66a8786ca2a47c6896` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:36.038236 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b405b-930a-43f4-93c2-2a00b14861fb None admin] RBAC: Authorizing `identity:get_project(project_id=60f49905e8e34d66a8786ca2a47c6896)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:36.039677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b405b-930a-43f4-93c2-2a00b14861fb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:36.041453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 87/180] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:35 2022] GET /identity/v3/projects/60f49905e8e34d66a8786ca2a47c6896 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:36.042556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0011b2-9dcb-41d0-9a2c-f85f45668a4a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:36.042839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0011b2-9dcb-41d0-9a2c-f85f45668a4a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:36.043109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0011b2-9dcb-41d0-9a2c-f85f45668a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:36.048625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 94/181] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:20:35 2022] PUT /identity/v3/projects/157a31991261402d8b74b6c5316fcb03/users/f803219b46c448619873abec62914fbf/roles/8072bf5817774f5786c71af7d54b87b5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:20:36.049320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080a20f-b18f-4615-aa8b-83d7d379db38 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:36.062096 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0d0011b2-9dcb-41d0-9a2c-f85f45668a4a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:36.063345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0d0011b2-9dcb-41d0-9a2c-f85f45668a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:36.083044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:36.139210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 88/182] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:36.140530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef4da-adc8-47af-88c5-eb8877487648 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:36.140820 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef4da-adc8-47af-88c5-eb8877487648 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:36.141130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef4da-adc8-47af-88c5-eb8877487648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:36.170476 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4ddef4da-adc8-47af-88c5-eb8877487648 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:36.172243 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4ddef4da-adc8-47af-88c5-eb8877487648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:36.207522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080a20f-b18f-4615-aa8b-83d7d379db38 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:36.247411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549fe4d-85be-4861-89fb-c309e3aad800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:36.248022 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549fe4d-85be-4861-89fb-c309e3aad800 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:36.248296 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549fe4d-85be-4861-89fb-c309e3aad800 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:36.248564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549fe4d-85be-4861-89fb-c309e3aad800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:36.250000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549fe4d-85be-4861-89fb-c309e3aad800 None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=157a31991261402d8b74b6c5316fcb03, user.id=f003550e956b429a97e0675a2bc86b98) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:36.250000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549fe4d-85be-4861-89fb-c309e3aad800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:36.251434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549fe4d-85be-4861-89fb-c309e3aad800 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:36.257766 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 95/183] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:36 2022] GET /identity/v3/role_assignments?user.id=f003550e956b429a97e0675a2bc86b98&scope.project.id=157a31991261402d8b74b6c5316fcb03&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:36.258813 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a6258-da3f-452c-b0c3-4b0c1a1b5615 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:36.259085 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a6258-da3f-452c-b0c3-4b0c1a1b5615 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:36.260067 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a6258-da3f-452c-b0c3-4b0c1a1b5615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:36.265515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 89/184] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:36.266681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddef4da-adc8-47af-88c5-eb8877487648 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:36.293071 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-6d3a6258-da3f-452c-b0c3-4b0c1a1b5615 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:36.295651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6d3a6258-da3f-452c-b0c3-4b0c1a1b5615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:36.337891 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:36.441351 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 96/185] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:36.453982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddef4da-adc8-47af-88c5-eb8877487648 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:36.498038 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a6258-da3f-452c-b0c3-4b0c1a1b5615 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:36.525378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:36.529695 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffce37-0dea-454c-94f5-f8c727228796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:36.530318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffce37-0dea-454c-94f5-f8c727228796 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:36.530592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffce37-0dea-454c-94f5-f8c727228796 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:36.530860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffce37-0dea-454c-94f5-f8c727228796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:36.531600 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffce37-0dea-454c-94f5-f8c727228796 None admin] RBAC: Adding query filter params (role.id=28ebd5e6ebbc404e87ed29420b2f4254, scope.project.id=60f49905e8e34d66a8786ca2a47c6896, user.id=c10bdf610c574721a52a78348cf248de) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:36.531910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffce37-0dea-454c-94f5-f8c727228796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:36.533538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffce37-0dea-454c-94f5-f8c727228796 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:36.543572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 90/186] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:36 2022] GET /identity/v3/role_assignments?user.id=c10bdf610c574721a52a78348cf248de&scope.project.id=60f49905e8e34d66a8786ca2a47c6896&role.id=28ebd5e6ebbc404e87ed29420b2f4254 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:36.612315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a6258-da3f-452c-b0c3-4b0c1a1b5615 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:36.646592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffce37-0dea-454c-94f5-f8c727228796 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:36.653266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f182d-3a57-4faa-ab1a-dcf9eae01503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:36.655369 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f182d-3a57-4faa-ab1a-dcf9eae01503 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:36.655864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f182d-3a57-4faa-ab1a-dcf9eae01503 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:36.656318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f182d-3a57-4faa-ab1a-dcf9eae01503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:36.674794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f182d-3a57-4faa-ab1a-dcf9eae01503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-643f182d-3a57-4faa-ab1a-dcf9eae01503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:36.679643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:36.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:36.681961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:36.681961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:36.681961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:36.681961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:36.681961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:36.681961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:36.681961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:36.681961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:36.681961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:36.681961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:36.681961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:36.681961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:20:36.681961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 97/187] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:20:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:20:36.690300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f182d-3a57-4faa-ab1a-dcf9eae01503 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:36.788497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:36.793769 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffce37-0dea-454c-94f5-f8c727228796 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:36.824483 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:36.831749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efffb9-d255-4dfd-8858-3d8f4571257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:36.832387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efffb9-d255-4dfd-8858-3d8f4571257a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:36.832660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efffb9-d255-4dfd-8858-3d8f4571257a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:36.832927 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efffb9-d255-4dfd-8858-3d8f4571257a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:36.844516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f182d-3a57-4faa-ab1a-dcf9eae01503 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:36.846426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efffb9-d255-4dfd-8858-3d8f4571257a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-f8efffb9-d255-4dfd-8858-3d8f4571257a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:36.851524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:36.852491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:36.853832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:36.853832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:36.853832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:36.853832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:36.853832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:36.853832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:36.853832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:36.853832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:36.853832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:36.853832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:36.853832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:20:36.853832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:36.853832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 91/188] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:20:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:20:36.858684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efffb9-d255-4dfd-8858-3d8f4571257a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:36.892473 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f2b95-309d-4997-9ae5-78a144a95d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:36.893299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2b95-309d-4997-9ae5-78a144a95d41 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:36.893579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2b95-309d-4997-9ae5-78a144a95d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:36.893852 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2b95-309d-4997-9ae5-78a144a95d41 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:36.894607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f2b95-309d-4997-9ae5-78a144a95d41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:36.894977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f2b95-309d-4997-9ae5-78a144a95d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:36.896428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f2b95-309d-4997-9ae5-78a144a95d41 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:36.905958 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 98/189] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:36.912332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f2b95-309d-4997-9ae5-78a144a95d41 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:36.979454 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efffb9-d255-4dfd-8858-3d8f4571257a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:37.012966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d20af-d60e-4bdf-a348-445979905c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:37.013611 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d20af-d60e-4bdf-a348-445979905c7f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:37.014132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d20af-d60e-4bdf-a348-445979905c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:37.014398 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d20af-d60e-4bdf-a348-445979905c7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:37.015491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d20af-d60e-4bdf-a348-445979905c7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:37.016930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d20af-d60e-4bdf-a348-445979905c7f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:37.021049 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 92/190] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:37.021049 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d20af-d60e-4bdf-a348-445979905c7f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:37.028504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f2b95-309d-4997-9ae5-78a144a95d41 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:37.050399 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:37.064665 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751715c-77c3-4178-9023-2070fbabf5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:37.065672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751715c-77c3-4178-9023-2070fbabf5bb None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:37.065672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751715c-77c3-4178-9023-2070fbabf5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:37.065953 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751715c-77c3-4178-9023-2070fbabf5bb None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:37.066612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751715c-77c3-4178-9023-2070fbabf5bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:37.066912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751715c-77c3-4178-9023-2070fbabf5bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:37.068280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751715c-77c3-4178-9023-2070fbabf5bb None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:37.073767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:37.077480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 99/191] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:20:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:37.082807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751715c-77c3-4178-9023-2070fbabf5bb None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:37.129358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d20af-d60e-4bdf-a348-445979905c7f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:37.168754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c9ac3-c783-494e-8630-370c90a5d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:37.169421 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9ac3-c783-494e-8630-370c90a5d83e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:37.169696 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9ac3-c783-494e-8630-370c90a5d83e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:37.169968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9ac3-c783-494e-8630-370c90a5d83e None admin] PATH_INFO: `/v3/users/c52bd7c02ec54180995078f8b7131fda` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:37.183801 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c9ac3-c783-494e-8630-370c90a5d83e None admin] RBAC: Authorizing `identity:get_user(user_id=c52bd7c02ec54180995078f8b7131fda)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:37.185395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c9ac3-c783-494e-8630-370c90a5d83e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:37.187354 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 93/192] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:37 2022] GET /identity/v3/users/c52bd7c02ec54180995078f8b7131fda => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:37.192557 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c9ac3-c783-494e-8630-370c90a5d83e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:37.195629 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751715c-77c3-4178-9023-2070fbabf5bb None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:37.232605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf45a22-1a09-4027-b742-0b8c821e2b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:37.233248 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf45a22-1a09-4027-b742-0b8c821e2b6d None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:37.233530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf45a22-1a09-4027-b742-0b8c821e2b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:37.233805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf45a22-1a09-4027-b742-0b8c821e2b6d None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:37.234459 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf45a22-1a09-4027-b742-0b8c821e2b6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:37.235932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf45a22-1a09-4027-b742-0b8c821e2b6d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:37.280100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:37.297477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c9ac3-c783-494e-8630-370c90a5d83e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:37.331371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a1374-31be-4672-9396-d97c44251797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:37.331970 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a1374-31be-4672-9396-d97c44251797 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:37.332245 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a1374-31be-4672-9396-d97c44251797 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:37.332507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a1374-31be-4672-9396-d97c44251797 None admin] PATH_INFO: `/v3/users/c52bd7c02ec54180995078f8b7131fda` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:37.333630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a1374-31be-4672-9396-d97c44251797 None admin] RBAC: Authorizing `identity:get_user(user_id=c52bd7c02ec54180995078f8b7131fda)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:37.335318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a1374-31be-4672-9396-d97c44251797 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:37.337324 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 94/193] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:37 2022] GET /identity/v3/users/c52bd7c02ec54180995078f8b7131fda => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:37.349237 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 100/194] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:20:37 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:20:37.349442 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a1374-31be-4672-9396-d97c44251797 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:37.349532 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf45a22-1a09-4027-b742-0b8c821e2b6d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:37.427699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:37.473108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a1374-31be-4672-9396-d97c44251797 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:37.478626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf45a22-1a09-4027-b742-0b8c821e2b6d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:37.513367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27919b7-1179-4071-8010-cadefc1669dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:37.514337 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27919b7-1179-4071-8010-cadefc1669dd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:37.514565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27919b7-1179-4071-8010-cadefc1669dd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:37.514861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27919b7-1179-4071-8010-cadefc1669dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:37.519065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010174f-53d7-4cb8-8224-7a34c0c251b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:37.519935 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010174f-53d7-4cb8-8224-7a34c0c251b4 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:37.520404 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010174f-53d7-4cb8-8224-7a34c0c251b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:37.520864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010174f-53d7-4cb8-8224-7a34c0c251b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:37.539602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:37.595355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27919b7-1179-4071-8010-cadefc1669dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:37.596762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27919b7-1179-4071-8010-cadefc1669dd None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:37.613614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010174f-53d7-4cb8-8224-7a34c0c251b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:37.616445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010174f-53d7-4cb8-8224-7a34c0c251b4 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:37.704945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:37.722961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 95/195] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:37.732708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27919b7-1179-4071-8010-cadefc1669dd None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:37.767712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 101/196] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:37.772949 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010174f-53d7-4cb8-8224-7a34c0c251b4 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:37.796805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:37.850124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27919b7-1179-4071-8010-cadefc1669dd None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:37.892218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d065cc6-ad89-43f5-829b-ee522f014860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:37.892860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d065cc6-ad89-43f5-829b-ee522f014860 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:37.893188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d065cc6-ad89-43f5-829b-ee522f014860 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:37.893457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d065cc6-ad89-43f5-829b-ee522f014860 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:37.894586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d065cc6-ad89-43f5-829b-ee522f014860 None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:37.896029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d065cc6-ad89-43f5-829b-ee522f014860 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:37.897677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 96/197] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:37 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:37.903614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d065cc6-ad89-43f5-829b-ee522f014860 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:37.904494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010174f-53d7-4cb8-8224-7a34c0c251b4 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:37.959194 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09d26b-cdc0-4584-a8d8-5a5845ad0af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:37.959817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d26b-cdc0-4584-a8d8-5a5845ad0af6 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:37.960090 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d26b-cdc0-4584-a8d8-5a5845ad0af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:37.960356 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d26b-cdc0-4584-a8d8-5a5845ad0af6 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:37.962207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09d26b-cdc0-4584-a8d8-5a5845ad0af6 None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:37.963679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09d26b-cdc0-4584-a8d8-5a5845ad0af6 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:37.965334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 102/198] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:37 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:37.971688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09d26b-cdc0-4584-a8d8-5a5845ad0af6 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:38.013495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:38.059423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d065cc6-ad89-43f5-829b-ee522f014860 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:38.082680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:38.106171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c2ba4-ed8a-465f-a12b-ee93b58b513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:38.106712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c2ba4-ed8a-465f-a12b-ee93b58b513c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:38.107050 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c2ba4-ed8a-465f-a12b-ee93b58b513c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:38.107322 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c2ba4-ed8a-465f-a12b-ee93b58b513c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:38.112281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c2ba4-ed8a-465f-a12b-ee93b58b513c None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=70ee53b2d7b14a80bd301008e64665c5, user.id=c52bd7c02ec54180995078f8b7131fda) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:38.112601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c2ba4-ed8a-465f-a12b-ee93b58b513c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:38.114110 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c2ba4-ed8a-465f-a12b-ee93b58b513c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:38.123724 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 97/199] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:37 2022] GET /identity/v3/role_assignments?user.id=c52bd7c02ec54180995078f8b7131fda&scope.project.id=70ee53b2d7b14a80bd301008e64665c5&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:38.176627 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09d26b-cdc0-4584-a8d8-5a5845ad0af6 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:38.227058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9711ad-2f5d-4e63-a5f6-70af7a47c6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:38.227671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9711ad-2f5d-4e63-a5f6-70af7a47c6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:38.228551 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9711ad-2f5d-4e63-a5f6-70af7a47c6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:38.229283 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9711ad-2f5d-4e63-a5f6-70af7a47c6c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:38.230048 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9711ad-2f5d-4e63-a5f6-70af7a47c6c4 None admin] RBAC: Adding query filter params (role.id=22f7e3b007984ad79378413e11b1a86f, scope.project.id=70ee53b2d7b14a80bd301008e64665c5, user.id=c52bd7c02ec54180995078f8b7131fda) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:38.230357 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9711ad-2f5d-4e63-a5f6-70af7a47c6c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:38.231814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9711ad-2f5d-4e63-a5f6-70af7a47c6c4 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:38.241618 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 103/200] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:37 2022] GET /identity/v3/role_assignments?user.id=c52bd7c02ec54180995078f8b7131fda&scope.project.id=70ee53b2d7b14a80bd301008e64665c5&role.id=22f7e3b007984ad79378413e11b1a86f => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:38.738752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e39b9-dedc-4265-9438-129a83b03d40 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:38.739303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e39b9-dedc-4265-9438-129a83b03d40 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:38.739303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e39b9-dedc-4265-9438-129a83b03d40 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:38.740869 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 98/201] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:38.746811 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506f969-252e-48d4-9b0d-873ac8c5d530 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:38.747093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506f969-252e-48d4-9b0d-873ac8c5d530 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:38.747361 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506f969-252e-48d4-9b0d-873ac8c5d530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:38.767706 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2506f969-252e-48d4-9b0d-873ac8c5d530 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:38.768928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2506f969-252e-48d4-9b0d-873ac8c5d530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:38.841276 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 104/202] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:20:39.111026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e39b9-dedc-4265-9438-129a83b03d40 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:39.254631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e39b9-dedc-4265-9438-129a83b03d40 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:39.304004 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95b6c9-5dff-4674-86a3-63cf9fc459a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:39.304648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95b6c9-5dff-4674-86a3-63cf9fc459a6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:39.304926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95b6c9-5dff-4674-86a3-63cf9fc459a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:39.305223 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95b6c9-5dff-4674-86a3-63cf9fc459a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:39.321712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95b6c9-5dff-4674-86a3-63cf9fc459a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-6e95b6c9-5dff-4674-86a3-63cf9fc459a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:39.328247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:39.329271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:39.330951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:39.330951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:39.330951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:39.330951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:39.330951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:39.330951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:39.330951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:39.330951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:39.330951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:39.330951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:39.330951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:39.330951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:39.330951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 99/203] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:39.335715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506f969-252e-48d4-9b0d-873ac8c5d530 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:39.367637 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:39.464551 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506f969-252e-48d4-9b0d-873ac8c5d530 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:39.498652 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82061d7-24e7-45de-8778-49d7d9d8ed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:39.499262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82061d7-24e7-45de-8778-49d7d9d8ed03 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:39.499537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82061d7-24e7-45de-8778-49d7d9d8ed03 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:39.499809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82061d7-24e7-45de-8778-49d7d9d8ed03 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:39.500467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82061d7-24e7-45de-8778-49d7d9d8ed03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:39.500769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82061d7-24e7-45de-8778-49d7d9d8ed03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:39.502189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82061d7-24e7-45de-8778-49d7d9d8ed03 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:39.510802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 105/204] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:39.516664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95b6c9-5dff-4674-86a3-63cf9fc459a6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:39.573187 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:39.643226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95b6c9-5dff-4674-86a3-63cf9fc459a6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:39.695059 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c70a48-df40-423e-a226-c38ec4aa9d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:39.695699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c70a48-df40-423e-a226-c38ec4aa9d8f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:39.695973 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c70a48-df40-423e-a226-c38ec4aa9d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:39.696240 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c70a48-df40-423e-a226-c38ec4aa9d8f None admin] PATH_INFO: `/v3/users/f803219b46c448619873abec62914fbf` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:39.698280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c70a48-df40-423e-a226-c38ec4aa9d8f None admin] RBAC: Authorizing `identity:get_user(user_id=f803219b46c448619873abec62914fbf)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:39.699742 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c70a48-df40-423e-a226-c38ec4aa9d8f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:39.701442 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 100/205] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:39 2022] GET /identity/v3/users/f803219b46c448619873abec62914fbf => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:39.707056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82061d7-24e7-45de-8778-49d7d9d8ed03 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:39.801396 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:39.813717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82061d7-24e7-45de-8778-49d7d9d8ed03 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:39.848918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100662d8-093f-4f99-94ef-9c85131d12c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:39.849571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100662d8-093f-4f99-94ef-9c85131d12c2 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:39.849850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100662d8-093f-4f99-94ef-9c85131d12c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:39.850120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100662d8-093f-4f99-94ef-9c85131d12c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:39.919825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100662d8-093f-4f99-94ef-9c85131d12c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:39.921234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100662d8-093f-4f99-94ef-9c85131d12c2 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:40.002868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:40.022632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 106/206] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:40.029031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c70a48-df40-423e-a226-c38ec4aa9d8f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:40.192739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c70a48-df40-423e-a226-c38ec4aa9d8f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:40.211779 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:40.244600 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7cba7-c7cc-4465-a90a-6afd406fd260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:40.245294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7cba7-c7cc-4465-a90a-6afd406fd260 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:40.245577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7cba7-c7cc-4465-a90a-6afd406fd260 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:40.245855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7cba7-c7cc-4465-a90a-6afd406fd260 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:40.247099 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7cba7-c7cc-4465-a90a-6afd406fd260 None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:40.248604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7cba7-c7cc-4465-a90a-6afd406fd260 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:40.250729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 101/207] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:40 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:40.256896 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100662d8-093f-4f99-94ef-9c85131d12c2 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:40.384683 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5fc55-9c06-486d-9c8b-424e0601a861 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:40.385071 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5fc55-9c06-486d-9c8b-424e0601a861 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:40.385253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5fc55-9c06-486d-9c8b-424e0601a861 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:40.386754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 102/208] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:20:40.392435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08987-d4a8-4fa9-8bc5-c31842db1124 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:40.392713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08987-d4a8-4fa9-8bc5-c31842db1124 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:40.393003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08987-d4a8-4fa9-8bc5-c31842db1124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:40.411849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-71c08987-d4a8-4fa9-8bc5-c31842db1124 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:40.413053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-71c08987-d4a8-4fa9-8bc5-c31842db1124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:40.417942 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100662d8-093f-4f99-94ef-9c85131d12c2 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:40.467699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51d1d7-0cfe-49c7-a51e-6837b3e938f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:40.468793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d1d7-0cfe-49c7-a51e-6837b3e938f9 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:40.469262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d1d7-0cfe-49c7-a51e-6837b3e938f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:40.469932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d1d7-0cfe-49c7-a51e-6837b3e938f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:40.471198 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51d1d7-0cfe-49c7-a51e-6837b3e938f9 None admin] RBAC: Adding query filter params (role.id=8072bf5817774f5786c71af7d54b87b5, scope.project.id=157a31991261402d8b74b6c5316fcb03, user.id=f803219b46c448619873abec62914fbf) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:40.471656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51d1d7-0cfe-49c7-a51e-6837b3e938f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:40.473308 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51d1d7-0cfe-49c7-a51e-6837b3e938f9 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:40.483229 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 107/209] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:40 2022] GET /identity/v3/role_assignments?user.id=f803219b46c448619873abec62914fbf&scope.project.id=157a31991261402d8b74b6c5316fcb03&role.id=8072bf5817774f5786c71af7d54b87b5 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:40.484877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4bc3f-6495-4687-a7d9-986c26ec76ef None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:40.485325 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4bc3f-6495-4687-a7d9-986c26ec76ef None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:40.485728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4bc3f-6495-4687-a7d9-986c26ec76ef None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:40.487109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 108/210] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:40.495742 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 103/211] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:40.501545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895eb98-c892-4805-8b5d-22b2b61e388d None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:40.502038 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895eb98-c892-4805-8b5d-22b2b61e388d None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:40.502455 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895eb98-c892-4805-8b5d-22b2b61e388d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:40.523879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-5895eb98-c892-4805-8b5d-22b2b61e388d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:40.526358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5895eb98-c892-4805-8b5d-22b2b61e388d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:40.575020 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:40.609167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 109/212] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:20:40.887482 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c08987-d4a8-4fa9-8bc5-c31842db1124 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:40.897169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895eb98-c892-4805-8b5d-22b2b61e388d None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:41.021014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c08987-d4a8-4fa9-8bc5-c31842db1124 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:41.033681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:41.056289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895eb98-c892-4805-8b5d-22b2b61e388d None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:41.061409 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9e8bb-3e8e-40f4-a13d-ec11a7d66a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:41.062057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9e8bb-3e8e-40f4-a13d-ec11a7d66a24 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:41.062550 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9e8bb-3e8e-40f4-a13d-ec11a7d66a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:41.062883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9e8bb-3e8e-40f4-a13d-ec11a7d66a24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:41.065427 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9e8bb-3e8e-40f4-a13d-ec11a7d66a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:41.066936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9e8bb-3e8e-40f4-a13d-ec11a7d66a24 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:41.068713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 104/213] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:41.073448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22885360-00cd-4cb0-a254-962cf60cff58 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:41.073448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22885360-00cd-4cb0-a254-962cf60cff58 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:41.073448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22885360-00cd-4cb0-a254-962cf60cff58 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:41.073448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 105/214] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:41.076481 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22885360-00cd-4cb0-a254-962cf60cff58 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:41.097726 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c1f50-228c-439e-97c9-8fdd63905a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:41.098136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c1f50-228c-439e-97c9-8fdd63905a8b None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:41.098412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c1f50-228c-439e-97c9-8fdd63905a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:41.098679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c1f50-228c-439e-97c9-8fdd63905a8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:41.111902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c1f50-228c-439e-97c9-8fdd63905a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-ca4c1f50-228c-439e-97c9-8fdd63905a8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:41.116858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:41.117828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:41.119905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:41.119905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:41.119905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:41.119905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:41.119905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:41.119905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:41.119905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:41.119905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:41.119905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:41.119905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:41.119905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:41.119905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:20:41.119905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 110/215] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:41.120623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c74f5-4409-4e4e-9927-9d4dbec4b7e7 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:41.120895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c74f5-4409-4e4e-9927-9d4dbec4b7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:41.121191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c74f5-4409-4e4e-9927-9d4dbec4b7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:41.139379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-e68c74f5-4409-4e4e-9927-9d4dbec4b7e7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:41.140475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-e68c74f5-4409-4e4e-9927-9d4dbec4b7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:41.179061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:41.197805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22885360-00cd-4cb0-a254-962cf60cff58 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:41.220184 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 111/216] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:41.221050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c74f5-4409-4e4e-9927-9d4dbec4b7e7 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:41.238572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e737f-7ccd-4418-a592-b14507026764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:41.239261 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e737f-7ccd-4418-a592-b14507026764 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:41.239542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e737f-7ccd-4418-a592-b14507026764 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:41.239818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e737f-7ccd-4418-a592-b14507026764 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:41.240472 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e737f-7ccd-4418-a592-b14507026764 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:41.241958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e737f-7ccd-4418-a592-b14507026764 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:41.320377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c74f5-4409-4e4e-9927-9d4dbec4b7e7 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:41.349537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 106/217] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:20:41 2022] POST /identity/v3/users => generated 297 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:20:41.352123 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560a382-d5b0-4842-a9cd-493028c7e2b2 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:41.352123 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560a382-d5b0-4842-a9cd-493028c7e2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:41.352123 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560a382-d5b0-4842-a9cd-493028c7e2b2 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:41.353280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 107/218] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:41.358781 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae329-70f0-400e-b690-065580030aa1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:41.359066 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae329-70f0-400e-b690-065580030aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:41.359321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae329-70f0-400e-b690-065580030aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:41.366238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b4243-12b4-4930-aabc-4a73e673bcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:41.366867 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b4243-12b4-4930-aabc-4a73e673bcce None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:41.367148 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b4243-12b4-4930-aabc-4a73e673bcce None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:41.367420 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b4243-12b4-4930-aabc-4a73e673bcce None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:41.368098 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b4243-12b4-4930-aabc-4a73e673bcce None admin] RBAC: Adding query filter params (name=member) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:41.368965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b4243-12b4-4930-aabc-4a73e673bcce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:41.370616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b4243-12b4-4930-aabc-4a73e673bcce None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:41.384620 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 112/219] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:41.388004 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d2bae329-70f0-400e-b690-065580030aa1 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:41.390146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d2bae329-70f0-400e-b690-065580030aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:41.391191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b4243-12b4-4930-aabc-4a73e673bcce None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:41.426271 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:41.434306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:41.492890 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 108/220] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:20:41.500144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae329-70f0-400e-b690-065580030aa1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:41.525922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b4243-12b4-4930-aabc-4a73e673bcce None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:41.569133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a56364-d88f-48ac-bb20-d29961a7d03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:41.570965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a56364-d88f-48ac-bb20-d29961a7d03d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:41.572653 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a56364-d88f-48ac-bb20-d29961a7d03d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:41.573165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a56364-d88f-48ac-bb20-d29961a7d03d None admin] PATH_INFO: `/v3/users/d84735d182ef440fb35c4f8969940178` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:41.589268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a56364-d88f-48ac-bb20-d29961a7d03d None admin] RBAC: Authorizing `identity:get_user(user_id=d84735d182ef440fb35c4f8969940178)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:41.590934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a56364-d88f-48ac-bb20-d29961a7d03d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:41.592714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 113/221] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:41 2022] GET /identity/v3/users/d84735d182ef440fb35c4f8969940178 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:41.598088 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a56364-d88f-48ac-bb20-d29961a7d03d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:41.630898 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae329-70f0-400e-b690-065580030aa1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:41.679499 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd177189-ad5b-4503-b04e-56d11e487670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:41.680346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd177189-ad5b-4503-b04e-56d11e487670 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:41.681288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd177189-ad5b-4503-b04e-56d11e487670 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:41.681859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd177189-ad5b-4503-b04e-56d11e487670 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:41.696135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd177189-ad5b-4503-b04e-56d11e487670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-fd177189-ad5b-4503-b04e-56d11e487670 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:41.700882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:41.701795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:41.702998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:41.702998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:41.702998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:41.702998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:41.702998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:41.702998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:41.702998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:41.702998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:41.702998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:41.702998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:41.702998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:41.702998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:41.702998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 109/222] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:20:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:20:41.710467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd177189-ad5b-4503-b04e-56d11e487670 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:41.722316 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:41.738730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a56364-d88f-48ac-bb20-d29961a7d03d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:41.747823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:41.788550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27209eab-c929-4ae1-bfad-a8c79adb7c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:41.789206 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27209eab-c929-4ae1-bfad-a8c79adb7c9e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:41.789618 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27209eab-c929-4ae1-bfad-a8c79adb7c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:41.789901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27209eab-c929-4ae1-bfad-a8c79adb7c9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:41.849618 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd177189-ad5b-4503-b04e-56d11e487670 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:41.872289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27209eab-c929-4ae1-bfad-a8c79adb7c9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:41.874110 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27209eab-c929-4ae1-bfad-a8c79adb7c9e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:41.890453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11de310-0250-41fd-a05a-d19d2da96354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:41.891470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11de310-0250-41fd-a05a-d19d2da96354 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:41.891896 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11de310-0250-41fd-a05a-d19d2da96354 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:41.892443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11de310-0250-41fd-a05a-d19d2da96354 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:41.893587 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11de310-0250-41fd-a05a-d19d2da96354 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:41.894037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11de310-0250-41fd-a05a-d19d2da96354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:41.895584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11de310-0250-41fd-a05a-d19d2da96354 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:41.908804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 110/223] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:41.910809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11de310-0250-41fd-a05a-d19d2da96354 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:41.969714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:41.990738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 114/224] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:41.991601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27209eab-c929-4ae1-bfad-a8c79adb7c9e None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:42.022385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:42.044479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11de310-0250-41fd-a05a-d19d2da96354 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:42.088383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adc15d-5af0-4189-9393-7ea9332008e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:42.089436 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adc15d-5af0-4189-9393-7ea9332008e5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:42.090136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adc15d-5af0-4189-9393-7ea9332008e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:42.090564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adc15d-5af0-4189-9393-7ea9332008e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:42.101960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adc15d-5af0-4189-9393-7ea9332008e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:42.107332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27209eab-c929-4ae1-bfad-a8c79adb7c9e None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-48adc15d-5af0-4189-9393-7ea9332008e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:42.108597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:42.109527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:42.110280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:42.110280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:42.110280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:42.110280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:42.110280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:42.110280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:42.110280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:42.110280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:42.110280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:42.110280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:42.110280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:20:42.110280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:42.112568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 111/225] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:20:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:42.113609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adc15d-5af0-4189-9393-7ea9332008e5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:42.146923 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64dd2d-46cf-4f57-b971-06f2142ef7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:42.147690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64dd2d-46cf-4f57-b971-06f2142ef7ad None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:42.148031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64dd2d-46cf-4f57-b971-06f2142ef7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:42.148377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64dd2d-46cf-4f57-b971-06f2142ef7ad None admin] PATH_INFO: `/v3/users/c52bd7c02ec54180995078f8b7131fda` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:42.152354 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64dd2d-46cf-4f57-b971-06f2142ef7ad None admin] RBAC: Authorizing `identity:get_user(user_id=c52bd7c02ec54180995078f8b7131fda)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:42.153884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64dd2d-46cf-4f57-b971-06f2142ef7ad None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:42.155741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 115/226] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:41 2022] GET /identity/v3/users/c52bd7c02ec54180995078f8b7131fda => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:42.156492 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64dd2d-46cf-4f57-b971-06f2142ef7ad None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:42.231445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:42.232686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adc15d-5af0-4189-9393-7ea9332008e5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:42.272785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca6c16-68c3-457c-9c7f-9203b8a4e875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:42.273602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca6c16-68c3-457c-9c7f-9203b8a4e875 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:42.273977 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca6c16-68c3-457c-9c7f-9203b8a4e875 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:42.274491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca6c16-68c3-457c-9c7f-9203b8a4e875 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:42.276402 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca6c16-68c3-457c-9c7f-9203b8a4e875 None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:42.278410 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca6c16-68c3-457c-9c7f-9203b8a4e875 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:42.281557 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 112/227] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:42 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:42.282728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca6c16-68c3-457c-9c7f-9203b8a4e875 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:42.289247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64dd2d-46cf-4f57-b971-06f2142ef7ad None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:42.304382 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:42.327938 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8271040-16e6-43c9-b73d-59ba591b8837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:42.328918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8271040-16e6-43c9-b73d-59ba591b8837 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:42.329439 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8271040-16e6-43c9-b73d-59ba591b8837 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:42.329900 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8271040-16e6-43c9-b73d-59ba591b8837 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:42.330751 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8271040-16e6-43c9-b73d-59ba591b8837 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:42.331306 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8271040-16e6-43c9-b73d-59ba591b8837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:42.332868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8271040-16e6-43c9-b73d-59ba591b8837 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:42.344757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 116/228] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:20:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:42.345992 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8271040-16e6-43c9-b73d-59ba591b8837 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:42.417135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca6c16-68c3-457c-9c7f-9203b8a4e875 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:42.454143 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef275129-7e79-475a-a548-bb62d0177931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:42.455180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef275129-7e79-475a-a548-bb62d0177931 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:42.455672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef275129-7e79-475a-a548-bb62d0177931 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:42.456166 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef275129-7e79-475a-a548-bb62d0177931 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:42.457562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef275129-7e79-475a-a548-bb62d0177931 None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:42.459317 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef275129-7e79-475a-a548-bb62d0177931 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:42.461256 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 113/229] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:42 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:42.462579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef275129-7e79-475a-a548-bb62d0177931 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:42.468942 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8271040-16e6-43c9-b73d-59ba591b8837 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:42.484128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:42.511467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36930f-413d-4a41-b2c4-a61ddfc5587b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:42.511997 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36930f-413d-4a41-b2c4-a61ddfc5587b None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:42.512270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36930f-413d-4a41-b2c4-a61ddfc5587b None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:42.512537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36930f-413d-4a41-b2c4-a61ddfc5587b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:42.513283 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36930f-413d-4a41-b2c4-a61ddfc5587b None admin] RBAC: Adding query filter params (role.id=28ebd5e6ebbc404e87ed29420b2f4254, scope.project.id=70ee53b2d7b14a80bd301008e64665c5, user.id=d84735d182ef440fb35c4f8969940178) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:42.513836 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36930f-413d-4a41-b2c4-a61ddfc5587b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:42.515287 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36930f-413d-4a41-b2c4-a61ddfc5587b None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:42.522031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 117/230] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:42 2022] GET /identity/v3/role_assignments?user.id=d84735d182ef440fb35c4f8969940178&scope.project.id=70ee53b2d7b14a80bd301008e64665c5&role.id=28ebd5e6ebbc404e87ed29420b2f4254 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:42.522893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36930f-413d-4a41-b2c4-a61ddfc5587b None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:42.586221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:42.614659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef275129-7e79-475a-a548-bb62d0177931 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:42.662179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36930f-413d-4a41-b2c4-a61ddfc5587b None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:42.695543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b332192-1526-4f45-b569-ca53cf40ac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:42.701705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332192-1526-4f45-b569-ca53cf40ac66 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:42.702328 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332192-1526-4f45-b569-ca53cf40ac66 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:42.702803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332192-1526-4f45-b569-ca53cf40ac66 None admin] PATH_INFO: `/v3/users/c52bd7c02ec54180995078f8b7131fda` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:42.704382 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332192-1526-4f45-b569-ca53cf40ac66 None admin] RBAC: Authorizing `identity:get_user(user_id=c52bd7c02ec54180995078f8b7131fda)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:42.706252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332192-1526-4f45-b569-ca53cf40ac66 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:42.708227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 114/231] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:42 2022] GET /identity/v3/users/c52bd7c02ec54180995078f8b7131fda => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:42.714279 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b332192-1526-4f45-b569-ca53cf40ac66 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:42.739600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d2dc4-dffb-491d-bc5d-0feb25dc43c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:42.740641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d2dc4-dffb-491d-bc5d-0feb25dc43c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:42.741139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d2dc4-dffb-491d-bc5d-0feb25dc43c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:42.741628 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d2dc4-dffb-491d-bc5d-0feb25dc43c7 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5/users/c52bd7c02ec54180995078f8b7131fda/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:42.745952 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d2dc4-dffb-491d-bc5d-0feb25dc43c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=70ee53b2d7b14a80bd301008e64665c5, user_id=c52bd7c02ec54180995078f8b7131fda, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:42.747984 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d2dc4-dffb-491d-bc5d-0feb25dc43c7 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:42.829631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 118/232] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:20:42 2022] PUT /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5/users/c52bd7c02ec54180995078f8b7131fda/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:20:42.860305 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b332192-1526-4f45-b569-ca53cf40ac66 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:42.911097 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caff0c-59a0-4910-afba-cce85155b39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:42.911741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caff0c-59a0-4910-afba-cce85155b39e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:42.912016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caff0c-59a0-4910-afba-cce85155b39e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:42.912282 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caff0c-59a0-4910-afba-cce85155b39e None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:42.913424 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54caff0c-59a0-4910-afba-cce85155b39e None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:42.915381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54caff0c-59a0-4910-afba-cce85155b39e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:42.917524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 115/233] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:42 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:42.923536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d2dc4-dffb-491d-bc5d-0feb25dc43c7 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:42.974562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:43.060935 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d2dc4-dffb-491d-bc5d-0feb25dc43c7 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:43.106367 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba94532-7624-48d0-ba1f-fb614726f4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:43.107095 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba94532-7624-48d0-ba1f-fb614726f4f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:43.107371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba94532-7624-48d0-ba1f-fb614726f4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:43.107639 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba94532-7624-48d0-ba1f-fb614726f4f5 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5/users/c52bd7c02ec54180995078f8b7131fda/roles/22f7e3b007984ad79378413e11b1a86f` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:43.109926 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba94532-7624-48d0-ba1f-fb614726f4f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=70ee53b2d7b14a80bd301008e64665c5, user_id=c52bd7c02ec54180995078f8b7131fda, role_id=22f7e3b007984ad79378413e11b1a86f)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:43.111433 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba94532-7624-48d0-ba1f-fb614726f4f5 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:43.196506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 119/234] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:20:42 2022] PUT /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5/users/c52bd7c02ec54180995078f8b7131fda/roles/22f7e3b007984ad79378413e11b1a86f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:20:43.914451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b97f-d544-4555-b6c1-2a2a92f1bcac None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:43.915016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b97f-d544-4555-b6c1-2a2a92f1bcac None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:43.915282 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b97f-d544-4555-b6c1-2a2a92f1bcac None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:43.916495 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 116/235] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:43.921788 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10cbf5-ee82-487b-8d84-fc089d4e616b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:43.922186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10cbf5-ee82-487b-8d84-fc089d4e616b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:43.922365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10cbf5-ee82-487b-8d84-fc089d4e616b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:43.945410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-7a10cbf5-ee82-487b-8d84-fc089d4e616b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:43.947463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7a10cbf5-ee82-487b-8d84-fc089d4e616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:44.033517 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 120/236] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:44.161025 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc64edc-4cfd-40d5-babe-7a5dd59520bc None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:44.161720 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc64edc-4cfd-40d5-babe-7a5dd59520bc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:44.161720 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc64edc-4cfd-40d5-babe-7a5dd59520bc None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:44.162896 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 117/237] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:44.169434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b35f4-807e-4976-a91f-f9d9e425322d None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:44.169657 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b35f4-807e-4976-a91f-f9d9e425322d None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:44.169931 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b35f4-807e-4976-a91f-f9d9e425322d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:44.189275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ab0b35f4-807e-4976-a91f-f9d9e425322d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:44.190444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ab0b35f4-807e-4976-a91f-f9d9e425322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:44.213989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:44.265063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 121/238] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:44.486577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc64edc-4cfd-40d5-babe-7a5dd59520bc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:44.509549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:44.615880 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc64edc-4cfd-40d5-babe-7a5dd59520bc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:44.659385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501852b-94eb-4372-87a6-5f36418f727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:44.660014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501852b-94eb-4372-87a6-5f36418f727f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:44.660285 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501852b-94eb-4372-87a6-5f36418f727f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:44.660550 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501852b-94eb-4372-87a6-5f36418f727f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:44.677879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501852b-94eb-4372-87a6-5f36418f727f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-b501852b-94eb-4372-87a6-5f36418f727f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:44.683902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:44.684790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:44.685598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:44.685598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:44.685598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:44.685598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:44.685598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:44.685598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:44.685598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:44.685598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:44.685598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:44.685598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:44.685598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:44.685598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:44.685598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 118/239] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:44.686232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b35f4-807e-4976-a91f-f9d9e425322d None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:44.694170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501852b-94eb-4372-87a6-5f36418f727f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:44.853950 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b35f4-807e-4976-a91f-f9d9e425322d None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:44.856043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:44.897003 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb50234-20f1-4893-8bc6-d92a1e599208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:44.897832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb50234-20f1-4893-8bc6-d92a1e599208 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:44.898114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb50234-20f1-4893-8bc6-d92a1e599208 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:44.898384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb50234-20f1-4893-8bc6-d92a1e599208 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:44.899804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb50234-20f1-4893-8bc6-d92a1e599208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:44.902951 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb50234-20f1-4893-8bc6-d92a1e599208 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:44.905261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 122/240] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:44.909713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501852b-94eb-4372-87a6-5f36418f727f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:44.914017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb50234-20f1-4893-8bc6-d92a1e599208 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:44.955432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51537a-9fe6-47ea-b2e8-8a5022a441f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:44.958093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51537a-9fe6-47ea-b2e8-8a5022a441f7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:44.959095 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51537a-9fe6-47ea-b2e8-8a5022a441f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:44.960239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51537a-9fe6-47ea-b2e8-8a5022a441f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:44.961132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51537a-9fe6-47ea-b2e8-8a5022a441f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:44.962292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51537a-9fe6-47ea-b2e8-8a5022a441f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:44.962748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:44.966986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51537a-9fe6-47ea-b2e8-8a5022a441f7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:44.987085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 119/241] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:45.002452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51537a-9fe6-47ea-b2e8-8a5022a441f7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:45.062976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb50234-20f1-4893-8bc6-d92a1e599208 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:45.105273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719399ea-52aa-4f25-ab8f-c5b1a7344433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:45.106220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719399ea-52aa-4f25-ab8f-c5b1a7344433 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:45.107743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719399ea-52aa-4f25-ab8f-c5b1a7344433 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:45.108211 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719399ea-52aa-4f25-ab8f-c5b1a7344433 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:45.109083 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719399ea-52aa-4f25-ab8f-c5b1a7344433 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:45.111959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719399ea-52aa-4f25-ab8f-c5b1a7344433 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:45.177223 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51537a-9fe6-47ea-b2e8-8a5022a441f7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:45.213158 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523b09a-6399-43ce-b51e-da11006ad9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:45.213785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523b09a-6399-43ce-b51e-da11006ad9cf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:45.214059 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523b09a-6399-43ce-b51e-da11006ad9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:45.214323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523b09a-6399-43ce-b51e-da11006ad9cf None admin] PATH_INFO: `/v3/users/887462ca6e994ea9b4f4e05ba20d638e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:45.225323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:45.229642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523b09a-6399-43ce-b51e-da11006ad9cf None admin] RBAC: Authorizing `identity:get_user(user_id=887462ca6e994ea9b4f4e05ba20d638e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:45.231184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523b09a-6399-43ce-b51e-da11006ad9cf None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:45.233082 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 120/242] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:45 2022] GET /identity/v3/users/887462ca6e994ea9b4f4e05ba20d638e => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:45.238465 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523b09a-6399-43ce-b51e-da11006ad9cf None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:45.266466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 123/243] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:20:44 2022] POST /identity/v3/users => generated 293 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:20:45.267790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739975f-f3c3-4340-a382-6e383e9b6c5a None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:45.268075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739975f-f3c3-4340-a382-6e383e9b6c5a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:45.268346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739975f-f3c3-4340-a382-6e383e9b6c5a None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:45.269813 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 124/244] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:45.284480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedceceb-7c26-4655-9332-13711bec345f None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:45.284866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedceceb-7c26-4655-9332-13711bec345f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:45.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedceceb-7c26-4655-9332-13711bec345f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:45.318173 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-bedceceb-7c26-4655-9332-13711bec345f None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:45.319382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-bedceceb-7c26-4655-9332-13711bec345f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:45.438689 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523b09a-6399-43ce-b51e-da11006ad9cf None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:45.470088 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 125/245] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:45.501533 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8154ca-b6d1-4d63-b8b8-b48f179772e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:45.502142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8154ca-b6d1-4d63-b8b8-b48f179772e7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:45.502414 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8154ca-b6d1-4d63-b8b8-b48f179772e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:45.502680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8154ca-b6d1-4d63-b8b8-b48f179772e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:45.546828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a25794-0c9d-4a90-bbb7-976fb6108094 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:45.547126 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a25794-0c9d-4a90-bbb7-976fb6108094 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:45.547368 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a25794-0c9d-4a90-bbb7-976fb6108094 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:45.548696 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 126/246] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:20:45.554033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe2c07-4304-4eda-bcbe-e090d0c183cd None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:45.554311 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe2c07-4304-4eda-bcbe-e090d0c183cd None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:45.554580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe2c07-4304-4eda-bcbe-e090d0c183cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:45.577097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-39fe2c07-4304-4eda-bcbe-e090d0c183cd None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:45.578710 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-39fe2c07-4304-4eda-bcbe-e090d0c183cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:45.586323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:45.588774 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:45.592329 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8154ca-b6d1-4d63-b8b8-b48f179772e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:45.594018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8154ca-b6d1-4d63-b8b8-b48f179772e7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:45.677028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 127/247] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:20:45.722765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 121/248] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 04:20:45.728221 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe2c07-4304-4eda-bcbe-e090d0c183cd None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:45.825105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8154ca-b6d1-4d63-b8b8-b48f179772e7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:45.852586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe2c07-4304-4eda-bcbe-e090d0c183cd None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:45.890202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53827f46-1883-463f-94c9-ff9492d188f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:45.890841 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827f46-1883-463f-94c9-ff9492d188f9 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:45.891120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827f46-1883-463f-94c9-ff9492d188f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:45.891400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827f46-1883-463f-94c9-ff9492d188f9 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:45.892523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53827f46-1883-463f-94c9-ff9492d188f9 None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:45.894069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53827f46-1883-463f-94c9-ff9492d188f9 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:45.900964 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 128/249] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:45 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:45.902811 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53827f46-1883-463f-94c9-ff9492d188f9 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:45.919070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:45.955604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:45.962976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8154ca-b6d1-4d63-b8b8-b48f179772e7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:46.008407 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948a9c5-16dd-43b4-866a-7264d1f73421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:46.009036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948a9c5-16dd-43b4-866a-7264d1f73421 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:46.009677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948a9c5-16dd-43b4-866a-7264d1f73421 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:46.009955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948a9c5-16dd-43b4-866a-7264d1f73421 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:46.022903 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948a9c5-16dd-43b4-866a-7264d1f73421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-4948a9c5-16dd-43b4-866a-7264d1f73421 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:46.030084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:46.030964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:46.031731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:46.031731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:46.031731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:46.031731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:46.031731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:46.031731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:46.031731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:46.031731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:46.031731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:46.031731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:46.031731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:46.031731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:46.033017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 122/250] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:20:46.033182 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e074f-3469-4b45-8a9a-71fee1ec9b44 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:46.034230 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e074f-3469-4b45-8a9a-71fee1ec9b44 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:46.034230 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e074f-3469-4b45-8a9a-71fee1ec9b44 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:46.035026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 123/251] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:46.035716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e074f-3469-4b45-8a9a-71fee1ec9b44 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:46.041288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53827f46-1883-463f-94c9-ff9492d188f9 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:46.088387 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8da8c-745a-4f79-bbd2-a62822860491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:46.089030 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8da8c-745a-4f79-bbd2-a62822860491 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:46.089302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8da8c-745a-4f79-bbd2-a62822860491 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:46.089574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8da8c-745a-4f79-bbd2-a62822860491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:46.090304 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8da8c-745a-4f79-bbd2-a62822860491 None admin] RBAC: Adding query filter params (role.id=8072bf5817774f5786c71af7d54b87b5, scope.project.id=70ee53b2d7b14a80bd301008e64665c5, user.id=887462ca6e994ea9b4f4e05ba20d638e) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:46.090629 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8da8c-745a-4f79-bbd2-a62822860491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:46.092825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8da8c-745a-4f79-bbd2-a62822860491 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:46.104123 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 129/252] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:45 2022] GET /identity/v3/role_assignments?user.id=887462ca6e994ea9b4f4e05ba20d638e&scope.project.id=70ee53b2d7b14a80bd301008e64665c5&role.id=8072bf5817774f5786c71af7d54b87b5 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:46.104123 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8da8c-745a-4f79-bbd2-a62822860491 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:46.213640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e074f-3469-4b45-8a9a-71fee1ec9b44 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:46.255758 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:46.287562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd5d36-4f4d-4c40-8f64-be67c7575a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:46.288174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd5d36-4f4d-4c40-8f64-be67c7575a77 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:46.288446 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd5d36-4f4d-4c40-8f64-be67c7575a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:46.288712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd5d36-4f4d-4c40-8f64-be67c7575a77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:46.308585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8da8c-745a-4f79-bbd2-a62822860491 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:46.309794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd5d36-4f4d-4c40-8f64-be67c7575a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-91bd5d36-4f4d-4c40-8f64-be67c7575a77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:46.315432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:46.319112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:46.319875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:46.319875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:46.319875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:46.319875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:46.319875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:46.319875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:46.319875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:46.319875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:46.319875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:46.319875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:46.319875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:20:46.319875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:46.319875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 124/253] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:20:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:46.319875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24009b-72be-4012-a2c1-b797637f2802 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:46.320556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24009b-72be-4012-a2c1-b797637f2802 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:46.320556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24009b-72be-4012-a2c1-b797637f2802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:46.340226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2f24009b-72be-4012-a2c1-b797637f2802 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:46.341580 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2f24009b-72be-4012-a2c1-b797637f2802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:46.353706 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9d4a9-30af-4ab9-a6ce-e3ef14b08dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:46.354438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9d4a9-30af-4ab9-a6ce-e3ef14b08dfe None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:46.354716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9d4a9-30af-4ab9-a6ce-e3ef14b08dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:46.356728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9d4a9-30af-4ab9-a6ce-e3ef14b08dfe None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:46.356728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9d4a9-30af-4ab9-a6ce-e3ef14b08dfe None admin] RBAC: Adding query filter params (name=member) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:46.356728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9d4a9-30af-4ab9-a6ce-e3ef14b08dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:46.357927 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9d4a9-30af-4ab9-a6ce-e3ef14b08dfe None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:46.359167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:46.368583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 130/254] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:46.369266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9d4a9-30af-4ab9-a6ce-e3ef14b08dfe None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:46.442584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 125/255] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:46.443655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24009b-72be-4012-a2c1-b797637f2802 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:46.511929 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9d4a9-30af-4ab9-a6ce-e3ef14b08dfe None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:46.597714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7cf24-d275-46d0-b525-10a096930d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:46.598344 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7cf24-d275-46d0-b525-10a096930d81 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:46.598627 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7cf24-d275-46d0-b525-10a096930d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:46.598897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7cf24-d275-46d0-b525-10a096930d81 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:46.599570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7cf24-d275-46d0-b525-10a096930d81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:46.599871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7cf24-d275-46d0-b525-10a096930d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:46.601274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7cf24-d275-46d0-b525-10a096930d81 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:46.609335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:46.617522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 131/256] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:46.623660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7cf24-d275-46d0-b525-10a096930d81 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:46.641827 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24009b-72be-4012-a2c1-b797637f2802 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:46.738874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821119d7-dd0a-4544-88e8-f30d5abb0f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:46.739905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821119d7-dd0a-4544-88e8-f30d5abb0f84 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:46.740385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821119d7-dd0a-4544-88e8-f30d5abb0f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:46.740852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821119d7-dd0a-4544-88e8-f30d5abb0f84 None admin] PATH_INFO: `/v3/users/d84735d182ef440fb35c4f8969940178` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:46.744973 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821119d7-dd0a-4544-88e8-f30d5abb0f84 None admin] RBAC: Authorizing `identity:get_user(user_id=d84735d182ef440fb35c4f8969940178)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:46.747681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821119d7-dd0a-4544-88e8-f30d5abb0f84 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:46.752127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 126/257] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:46 2022] GET /identity/v3/users/d84735d182ef440fb35c4f8969940178 => generated 297 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:46.763040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821119d7-dd0a-4544-88e8-f30d5abb0f84 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:46.810508 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:46.932303 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7cf24-d275-46d0-b525-10a096930d81 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:47.013932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49c6dc-4fc4-43b1-8336-b14bbdb1dbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:47.014589 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c6dc-4fc4-43b1-8336-b14bbdb1dbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:47.014864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c6dc-4fc4-43b1-8336-b14bbdb1dbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:47.015132 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c6dc-4fc4-43b1-8336-b14bbdb1dbf3 None admin] PATH_INFO: `/v3/users/c52bd7c02ec54180995078f8b7131fda` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:47.016310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49c6dc-4fc4-43b1-8336-b14bbdb1dbf3 None admin] RBAC: Authorizing `identity:get_user(user_id=c52bd7c02ec54180995078f8b7131fda)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:47.017816 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49c6dc-4fc4-43b1-8336-b14bbdb1dbf3 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:47.019648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 132/258] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:46 2022] GET /identity/v3/users/c52bd7c02ec54180995078f8b7131fda => generated 283 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:47.020478 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49c6dc-4fc4-43b1-8336-b14bbdb1dbf3 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:47.048608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821119d7-dd0a-4544-88e8-f30d5abb0f84 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:47.113996 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a171c6a-f0aa-486b-aee5-a7be84d5163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:47.115567 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a171c6a-f0aa-486b-aee5-a7be84d5163e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:47.116235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a171c6a-f0aa-486b-aee5-a7be84d5163e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:47.116929 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a171c6a-f0aa-486b-aee5-a7be84d5163e None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:47.119732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a171c6a-f0aa-486b-aee5-a7be84d5163e None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:47.123807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a171c6a-f0aa-486b-aee5-a7be84d5163e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:47.128031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 127/259] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:46 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:47.134695 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a171c6a-f0aa-486b-aee5-a7be84d5163e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:47.227686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:47.245601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:47.258874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a171c6a-f0aa-486b-aee5-a7be84d5163e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:47.298887 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ebfc7-ac38-4f40-a7f4-770c442d60a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:47.300499 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ebfc7-ac38-4f40-a7f4-770c442d60a9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:47.300973 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ebfc7-ac38-4f40-a7f4-770c442d60a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:47.301507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ebfc7-ac38-4f40-a7f4-770c442d60a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:47.346883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49c6dc-4fc4-43b1-8336-b14bbdb1dbf3 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:47.376333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ebfc7-ac38-4f40-a7f4-770c442d60a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:47.378139 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ebfc7-ac38-4f40-a7f4-770c442d60a9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:47.415116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f8122-570a-4584-a06b-22fb6a2101a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:47.415828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8122-570a-4584-a06b-22fb6a2101a2 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:47.416103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8122-570a-4584-a06b-22fb6a2101a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:47.416371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8122-570a-4584-a06b-22fb6a2101a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:47.426874 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f8122-570a-4584-a06b-22fb6a2101a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-8b3f8122-570a-4584-a06b-22fb6a2101a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:47.432331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:47.433488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:47.434279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:47.434279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:47.434279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:47.434279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:47.434279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:47.434279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:47.434279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:47.434279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:47.434279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:47.434279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:47.434279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:20:47.434279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:20:47.434279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 133/260] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:20:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:47.434279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f8122-570a-4584-a06b-22fb6a2101a2 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:47.482679 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:47.516444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 128/261] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:47.517592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ebfc7-ac38-4f40-a7f4-770c442d60a9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:47.598346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f8122-570a-4584-a06b-22fb6a2101a2 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:47.649558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:47.669159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514ca24-e797-4f6f-9fd1-5b452ab89b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:47.669832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514ca24-e797-4f6f-9fd1-5b452ab89b84 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:47.670107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514ca24-e797-4f6f-9fd1-5b452ab89b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:47.670379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514ca24-e797-4f6f-9fd1-5b452ab89b84 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5/users/d84735d182ef440fb35c4f8969940178/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:47.675144 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514ca24-e797-4f6f-9fd1-5b452ab89b84 None admin] RBAC: Authorizing `identity:create_grant(project_id=70ee53b2d7b14a80bd301008e64665c5, user_id=d84735d182ef440fb35c4f8969940178, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:47.676604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514ca24-e797-4f6f-9fd1-5b452ab89b84 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:47.702298 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ebfc7-ac38-4f40-a7f4-770c442d60a9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:47.738940 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077dbac-1459-4c30-864b-76e330d6bd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:47.739549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077dbac-1459-4c30-864b-76e330d6bd54 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:47.739829 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077dbac-1459-4c30-864b-76e330d6bd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:47.740101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077dbac-1459-4c30-864b-76e330d6bd54 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:47.740770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077dbac-1459-4c30-864b-76e330d6bd54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:47.741098 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077dbac-1459-4c30-864b-76e330d6bd54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:47.742489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077dbac-1459-4c30-864b-76e330d6bd54 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:47.755419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 129/262] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:20:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:47.759303 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 134/263] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:20:47 2022] PUT /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5/users/d84735d182ef440fb35c4f8969940178/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:20:47.759968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077dbac-1459-4c30-864b-76e330d6bd54 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:47.765018 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514ca24-e797-4f6f-9fd1-5b452ab89b84 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:47.859497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:47.967985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514ca24-e797-4f6f-9fd1-5b452ab89b84 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:47.971264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077dbac-1459-4c30-864b-76e330d6bd54 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:48.009899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce5adc-091a-457c-973d-3c9f760387c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:48.010455 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce5adc-091a-457c-973d-3c9f760387c6 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:48.010732 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce5adc-091a-457c-973d-3c9f760387c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:48.010997 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce5adc-091a-457c-973d-3c9f760387c6 None admin] PATH_INFO: `/v3/users/c52bd7c02ec54180995078f8b7131fda` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:48.012161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce5adc-091a-457c-973d-3c9f760387c6 None admin] RBAC: Authorizing `identity:get_user(user_id=c52bd7c02ec54180995078f8b7131fda)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:48.013960 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce5adc-091a-457c-973d-3c9f760387c6 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:48.015975 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 135/264] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:47 2022] GET /identity/v3/users/c52bd7c02ec54180995078f8b7131fda => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:48.021528 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce5adc-091a-457c-973d-3c9f760387c6 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:48.080535 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:48.099089 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130af94c-a9f8-49cd-8f1b-4ee3b0dfdb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:48.100172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130af94c-a9f8-49cd-8f1b-4ee3b0dfdb7b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:48.100659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130af94c-a9f8-49cd-8f1b-4ee3b0dfdb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:48.101198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130af94c-a9f8-49cd-8f1b-4ee3b0dfdb7b None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:48.105800 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130af94c-a9f8-49cd-8f1b-4ee3b0dfdb7b None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:48.107589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130af94c-a9f8-49cd-8f1b-4ee3b0dfdb7b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:48.110722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 130/265] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:47 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:48.118723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130af94c-a9f8-49cd-8f1b-4ee3b0dfdb7b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:48.129622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce5adc-091a-457c-973d-3c9f760387c6 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:48.197428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd7085-9d43-46a5-be39-74fdfd32855f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:48.198477 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd7085-9d43-46a5-be39-74fdfd32855f None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:48.201316 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd7085-9d43-46a5-be39-74fdfd32855f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:48.201837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd7085-9d43-46a5-be39-74fdfd32855f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:48.328618 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130af94c-a9f8-49cd-8f1b-4ee3b0dfdb7b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:48.346366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd7085-9d43-46a5-be39-74fdfd32855f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:48.347870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd7085-9d43-46a5-be39-74fdfd32855f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:48.370765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:48.433746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e7393-9fa0-4abc-bd3a-6a6af61eaa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:48.434380 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e7393-9fa0-4abc-bd3a-6a6af61eaa41 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:48.434668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e7393-9fa0-4abc-bd3a-6a6af61eaa41 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:48.434953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e7393-9fa0-4abc-bd3a-6a6af61eaa41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:48.435687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e7393-9fa0-4abc-bd3a-6a6af61eaa41 None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=70ee53b2d7b14a80bd301008e64665c5, user.id=c52bd7c02ec54180995078f8b7131fda) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:48.435996 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e7393-9fa0-4abc-bd3a-6a6af61eaa41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:48.437484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e7393-9fa0-4abc-bd3a-6a6af61eaa41 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:48.447565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 131/266] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:48 2022] GET /identity/v3/role_assignments?user.id=c52bd7c02ec54180995078f8b7131fda&scope.project.id=70ee53b2d7b14a80bd301008e64665c5&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 608 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:48.457934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:48.552424 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 136/267] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:48.558453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e7393-9fa0-4abc-bd3a-6a6af61eaa41 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:48.720687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e7393-9fa0-4abc-bd3a-6a6af61eaa41 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:48.765171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94fbb5-1244-4a00-9953-7bc916ba92d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:48.765902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94fbb5-1244-4a00-9953-7bc916ba92d4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:48.766181 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94fbb5-1244-4a00-9953-7bc916ba92d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:48.766448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94fbb5-1244-4a00-9953-7bc916ba92d4 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:48.767609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94fbb5-1244-4a00-9953-7bc916ba92d4 None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:48.769144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94fbb5-1244-4a00-9953-7bc916ba92d4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:48.770900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 132/268] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:48 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:48.778474 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd7085-9d43-46a5-be39-74fdfd32855f None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:48.900200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd7085-9d43-46a5-be39-74fdfd32855f None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:48.910684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f456-413e-4da0-9387-a7300259f644 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:48.910972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f456-413e-4da0-9387-a7300259f644 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:48.911252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f456-413e-4da0-9387-a7300259f644 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:48.912872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 133/269] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:48.918083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee7578-c09b-4672-93ef-742e6a0d2c9e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:48.918370 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee7578-c09b-4672-93ef-742e6a0d2c9e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:48.918644 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee7578-c09b-4672-93ef-742e6a0d2c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:48.945058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5915c1-e578-4012-9722-e0fc6d18ba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:48.945708 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5915c1-e578-4012-9722-e0fc6d18ba04 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:48.946798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5915c1-e578-4012-9722-e0fc6d18ba04 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:48.947108 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5915c1-e578-4012-9722-e0fc6d18ba04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:48.947818 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5915c1-e578-4012-9722-e0fc6d18ba04 None admin] RBAC: Adding query filter params (role.id=22f7e3b007984ad79378413e11b1a86f, scope.project.id=70ee53b2d7b14a80bd301008e64665c5, user.id=c52bd7c02ec54180995078f8b7131fda) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:48.948124 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5915c1-e578-4012-9722-e0fc6d18ba04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:48.949603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5915c1-e578-4012-9722-e0fc6d18ba04 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:48.956253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 137/270] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:48 2022] GET /identity/v3/role_assignments?user.id=c52bd7c02ec54180995078f8b7131fda&scope.project.id=70ee53b2d7b14a80bd301008e64665c5&role.id=22f7e3b007984ad79378413e11b1a86f => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:48.957817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8aee7578-c09b-4672-93ef-742e6a0d2c9e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:48.959049 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8aee7578-c09b-4672-93ef-742e6a0d2c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:49.040090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:49.073548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 134/271] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:49.201474 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296425c-c66b-4ab4-a0fe-6b6e48df538e None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:49.202087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296425c-c66b-4ab4-a0fe-6b6e48df538e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:49.202557 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296425c-c66b-4ab4-a0fe-6b6e48df538e None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:49.204363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 138/272] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:49.210026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d9ca4-7e75-43b8-855c-4ca364668ecc None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:49.210463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d9ca4-7e75-43b8-855c-4ca364668ecc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:49.210569 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d9ca4-7e75-43b8-855c-4ca364668ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:49.234418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3c1d9ca4-7e75-43b8-855c-4ca364668ecc None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:49.235586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3c1d9ca4-7e75-43b8-855c-4ca364668ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:49.300251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5130a49-6be9-4398-be6f-cb1971230a01 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:49.300530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5130a49-6be9-4398-be6f-cb1971230a01 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:49.301056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5130a49-6be9-4398-be6f-cb1971230a01 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:49.302624 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 139/273] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:49.311032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37bd90-feac-4f9b-9146-5acafb101b42 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:49.311583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37bd90-feac-4f9b-9146-5acafb101b42 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:49.312047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37bd90-feac-4f9b-9146-5acafb101b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:49.327771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 135/274] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:49.340285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ce37bd90-feac-4f9b-9146-5acafb101b42 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:49.341815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ce37bd90-feac-4f9b-9146-5acafb101b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:49.359793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:49.422491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d9ca4-7e75-43b8-855c-4ca364668ecc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:49.426777 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 140/275] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:49.539106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d9ca4-7e75-43b8-855c-4ca364668ecc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:49.548292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:49.577523 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b25a93-0cd4-4b6b-abf5-5cb865c716a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:49.578074 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b25a93-0cd4-4b6b-abf5-5cb865c716a2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:49.578349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b25a93-0cd4-4b6b-abf5-5cb865c716a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:49.578618 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b25a93-0cd4-4b6b-abf5-5cb865c716a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:49.588945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b25a93-0cd4-4b6b-abf5-5cb865c716a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-64b25a93-0cd4-4b6b-abf5-5cb865c716a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:49.593782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:49.594650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:49.595457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:49.595457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:49.595457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:49.595457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:49.595457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:49.595457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:49.595457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:49.595457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:49.595457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:49.595457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:49.595457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:49.595457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:49.595457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 136/276] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:20:49.603630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37bd90-feac-4f9b-9146-5acafb101b42 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:49.609762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b25a93-0cd4-4b6b-abf5-5cb865c716a2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:49.728065 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b25a93-0cd4-4b6b-abf5-5cb865c716a2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:49.731049 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37bd90-feac-4f9b-9146-5acafb101b42 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:49.763790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b0707-938c-4441-9d52-f44c836ba492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:49.764411 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b0707-938c-4441-9d52-f44c836ba492 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:49.764685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b0707-938c-4441-9d52-f44c836ba492 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:49.764956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b0707-938c-4441-9d52-f44c836ba492 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:49.765813 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981bc98-97cc-4b29-8cc7-514ed07fd4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:49.766415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981bc98-97cc-4b29-8cc7-514ed07fd4ec None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:49.766705 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981bc98-97cc-4b29-8cc7-514ed07fd4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:49.766963 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981bc98-97cc-4b29-8cc7-514ed07fd4ec None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:49.767634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981bc98-97cc-4b29-8cc7-514ed07fd4ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:49.767942 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981bc98-97cc-4b29-8cc7-514ed07fd4ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:49.769357 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981bc98-97cc-4b29-8cc7-514ed07fd4ec None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:49.776962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b0707-938c-4441-9d52-f44c836ba492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:49.778187 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 141/277] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:49.778987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981bc98-97cc-4b29-8cc7-514ed07fd4ec None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-229b0707-938c-4441-9d52-f44c836ba492 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:49.783390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:49.784406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:49.785383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:49.785383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:49.785383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:49.785383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:49.785383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:49.785383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:49.785383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:49.785383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:49.785383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:49.785383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:49.785383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:49.785383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:49.787290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 137/278] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:20:49.788314 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b0707-938c-4441-9d52-f44c836ba492 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:49.793528 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:49.820541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:49.885927 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981bc98-97cc-4b29-8cc7-514ed07fd4ec None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:49.897465 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b0707-938c-4441-9d52-f44c836ba492 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:49.922996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd07a4-5ae6-4eea-b14d-a850dba1b87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:49.923624 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd07a4-5ae6-4eea-b14d-a850dba1b87a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:49.923896 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd07a4-5ae6-4eea-b14d-a850dba1b87a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:49.924160 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd07a4-5ae6-4eea-b14d-a850dba1b87a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:49.925389 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd07a4-5ae6-4eea-b14d-a850dba1b87a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:49.926944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd07a4-5ae6-4eea-b14d-a850dba1b87a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:49.929128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 142/279] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:49.929986 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd07a4-5ae6-4eea-b14d-a850dba1b87a None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:49.939004 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a7bb6-5a06-4cd6-ab8c-2c1400796028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:49.939646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a7bb6-5a06-4cd6-ab8c-2c1400796028 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:49.939928 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a7bb6-5a06-4cd6-ab8c-2c1400796028 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:49.940202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a7bb6-5a06-4cd6-ab8c-2c1400796028 None admin] PATH_INFO: `/v3/users/887462ca6e994ea9b4f4e05ba20d638e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:49.941738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a7bb6-5a06-4cd6-ab8c-2c1400796028 None admin] RBAC: Authorizing `identity:get_user(user_id=887462ca6e994ea9b4f4e05ba20d638e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:49.943562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a7bb6-5a06-4cd6-ab8c-2c1400796028 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:49.945516 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 138/280] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:49 2022] GET /identity/v3/users/887462ca6e994ea9b4f4e05ba20d638e => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:49.946367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a7bb6-5a06-4cd6-ab8c-2c1400796028 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:50.022777 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:50.045115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd07a4-5ae6-4eea-b14d-a850dba1b87a None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:50.046062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:50.053426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a7bb6-5a06-4cd6-ab8c-2c1400796028 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:50.084418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7e619-6d64-4898-af61-0ed6ec1cf7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:50.085122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7e619-6d64-4898-af61-0ed6ec1cf7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:50.085404 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7e619-6d64-4898-af61-0ed6ec1cf7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:50.085674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7e619-6d64-4898-af61-0ed6ec1cf7f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:50.086441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7e619-6d64-4898-af61-0ed6ec1cf7f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:50.086754 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7e619-6d64-4898-af61-0ed6ec1cf7f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:50.088134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7e619-6d64-4898-af61-0ed6ec1cf7f0 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:50.088914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9087af-70c9-46fd-9457-205e31148860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:50.089563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9087af-70c9-46fd-9457-205e31148860 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:50.089844 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9087af-70c9-46fd-9457-205e31148860 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:50.090118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9087af-70c9-46fd-9457-205e31148860 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:50.090770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9087af-70c9-46fd-9457-205e31148860 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:50.092201 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9087af-70c9-46fd-9457-205e31148860 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:50.096434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 143/281] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:50.098079 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7e619-6d64-4898-af61-0ed6ec1cf7f0 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:50.195256 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 139/282] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:20:49 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:20:50.197121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9087af-70c9-46fd-9457-205e31148860 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:50.224136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7e619-6d64-4898-af61-0ed6ec1cf7f0 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:50.282049 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43d549-848d-4fe2-b9ff-0ad0e5dfda4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:50.283398 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43d549-848d-4fe2-b9ff-0ad0e5dfda4e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:50.283690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43d549-848d-4fe2-b9ff-0ad0e5dfda4e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:50.283968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43d549-848d-4fe2-b9ff-0ad0e5dfda4e None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:50.285589 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43d549-848d-4fe2-b9ff-0ad0e5dfda4e None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:50.287371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43d549-848d-4fe2-b9ff-0ad0e5dfda4e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:50.290772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 144/283] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:50 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:50.298764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43d549-848d-4fe2-b9ff-0ad0e5dfda4e None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:50.316418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:50.326919 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9087af-70c9-46fd-9457-205e31148860 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:50.368122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc03b1-a677-48ce-a087-3528dcbb5a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:50.369151 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc03b1-a677-48ce-a087-3528dcbb5a5d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:50.369498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc03b1-a677-48ce-a087-3528dcbb5a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:50.369836 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc03b1-a677-48ce-a087-3528dcbb5a5d None admin] PATH_INFO: `/v3/users/37504f463fab469b87870961e4f40001` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:50.388378 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc03b1-a677-48ce-a087-3528dcbb5a5d None admin] RBAC: Authorizing `identity:get_user(user_id=37504f463fab469b87870961e4f40001)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:50.390018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc03b1-a677-48ce-a087-3528dcbb5a5d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:50.395185 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 140/284] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:50 2022] GET /identity/v3/users/37504f463fab469b87870961e4f40001 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:50.398212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc03b1-a677-48ce-a087-3528dcbb5a5d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:50.410313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:50.440840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43d549-848d-4fe2-b9ff-0ad0e5dfda4e None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:50.488357 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd365ab-a4f0-4c3b-a7a2-1c7570fbd584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:50.489830 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd365ab-a4f0-4c3b-a7a2-1c7570fbd584 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:50.490308 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd365ab-a4f0-4c3b-a7a2-1c7570fbd584 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:50.491143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd365ab-a4f0-4c3b-a7a2-1c7570fbd584 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5/users/887462ca6e994ea9b4f4e05ba20d638e/roles/8072bf5817774f5786c71af7d54b87b5` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:50.494201 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd365ab-a4f0-4c3b-a7a2-1c7570fbd584 None admin] RBAC: Authorizing `identity:create_grant(project_id=70ee53b2d7b14a80bd301008e64665c5, user_id=887462ca6e994ea9b4f4e05ba20d638e, role_id=8072bf5817774f5786c71af7d54b87b5)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:50.496612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd365ab-a4f0-4c3b-a7a2-1c7570fbd584 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:50.518336 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc03b1-a677-48ce-a087-3528dcbb5a5d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:50.556288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b24807-f737-41d1-ae7a-af6bb8cd0b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:50.556908 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b24807-f737-41d1-ae7a-af6bb8cd0b5f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:50.557326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b24807-f737-41d1-ae7a-af6bb8cd0b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:50.557599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b24807-f737-41d1-ae7a-af6bb8cd0b5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:50.558363 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b24807-f737-41d1-ae7a-af6bb8cd0b5f None admin] RBAC: Adding query filter params (role.id=28ebd5e6ebbc404e87ed29420b2f4254, user.id=37504f463fab469b87870961e4f40001, scope.system=all) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:50.558675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b24807-f737-41d1-ae7a-af6bb8cd0b5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:50.560126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b24807-f737-41d1-ae7a-af6bb8cd0b5f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:50.565769 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 141/285] 10.222.0.50 () {56 vars in 1308 bytes} [Sat Sep 17 04:20:50 2022] GET /identity/v3/role_assignments?user.id=37504f463fab469b87870961e4f40001&scope.system=all&role.id=28ebd5e6ebbc404e87ed29420b2f4254 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:50.591201 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 145/286] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:20:50 2022] PUT /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5/users/887462ca6e994ea9b4f4e05ba20d638e/roles/8072bf5817774f5786c71af7d54b87b5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:20:50.905774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a98b2-fab6-4581-873a-2ee362602aaa None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:50.906535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a98b2-fab6-4581-873a-2ee362602aaa None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:50.907011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a98b2-fab6-4581-873a-2ee362602aaa None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:50.908826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 142/287] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:50.914065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7517e2-ed36-4aaf-8ce9-8d3c51653df1 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:50.915108 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7517e2-ed36-4aaf-8ce9-8d3c51653df1 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:50.915583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7517e2-ed36-4aaf-8ce9-8d3c51653df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:50.945266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-da7517e2-ed36-4aaf-8ce9-8d3c51653df1 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:50.947328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-da7517e2-ed36-4aaf-8ce9-8d3c51653df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:51.015307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:51.020957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 146/288] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:51.421811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a98b2-fab6-4581-873a-2ee362602aaa None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:51.515567 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:51.561784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a98b2-fab6-4581-873a-2ee362602aaa None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:51.607548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320c291-b1c3-422b-ac04-b42d6ad3f52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:51.608548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320c291-b1c3-422b-ac04-b42d6ad3f52d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:51.609054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320c291-b1c3-422b-ac04-b42d6ad3f52d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:51.609528 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320c291-b1c3-422b-ac04-b42d6ad3f52d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:51.629876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320c291-b1c3-422b-ac04-b42d6ad3f52d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1320c291-b1c3-422b-ac04-b42d6ad3f52d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:51.635325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:51.636174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:51.636946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:51.636946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:51.636946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:51.636946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:51.636946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:51.636946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:51.636946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:51.636946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:51.636946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:51.636946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:51.636946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:51.636946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:51.639576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 143/289] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:51.645589 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7517e2-ed36-4aaf-8ce9-8d3c51653df1 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:51.769827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7517e2-ed36-4aaf-8ce9-8d3c51653df1 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:51.807475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3d81b-9da0-4cfe-878b-8f2fb565028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:51.808080 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3d81b-9da0-4cfe-878b-8f2fb565028a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:51.808355 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3d81b-9da0-4cfe-878b-8f2fb565028a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:51.808622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3d81b-9da0-4cfe-878b-8f2fb565028a None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:51.809315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3d81b-9da0-4cfe-878b-8f2fb565028a None admin] RBAC: Adding query filter params (name=member) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:51.809617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3d81b-9da0-4cfe-878b-8f2fb565028a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:51.811009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3d81b-9da0-4cfe-878b-8f2fb565028a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:51.819627 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 147/290] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:51.826092 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320c291-b1c3-422b-ac04-b42d6ad3f52d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:51.972896 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320c291-b1c3-422b-ac04-b42d6ad3f52d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:52.016952 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:52.025703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cf031-453f-4fdf-aeaa-19f5576fd095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:52.026286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cf031-453f-4fdf-aeaa-19f5576fd095 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:52.026564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cf031-453f-4fdf-aeaa-19f5576fd095 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:52.026839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cf031-453f-4fdf-aeaa-19f5576fd095 None admin] PATH_INFO: `/v3/users/d84735d182ef440fb35c4f8969940178` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:52.028095 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cf031-453f-4fdf-aeaa-19f5576fd095 None admin] RBAC: Authorizing `identity:get_user(user_id=d84735d182ef440fb35c4f8969940178)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:52.029589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cf031-453f-4fdf-aeaa-19f5576fd095 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:52.031286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 144/291] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:51 2022] GET /identity/v3/users/d84735d182ef440fb35c4f8969940178 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:52.036779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3d81b-9da0-4cfe-878b-8f2fb565028a None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:52.133995 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:52.190423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3d81b-9da0-4cfe-878b-8f2fb565028a None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:52.239533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50100d5a-f898-4ea8-9489-f8da0b11c751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:52.240144 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50100d5a-f898-4ea8-9489-f8da0b11c751 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:52.240419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50100d5a-f898-4ea8-9489-f8da0b11c751 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:52.240690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50100d5a-f898-4ea8-9489-f8da0b11c751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:52.316881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50100d5a-f898-4ea8-9489-f8da0b11c751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:52.318423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50100d5a-f898-4ea8-9489-f8da0b11c751 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:52.460477 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:52.517805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 148/292] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:52.523620 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cf031-453f-4fdf-aeaa-19f5576fd095 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:52.670003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cf031-453f-4fdf-aeaa-19f5576fd095 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:52.720286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a49e06-7e35-4cd7-a95f-a47a236edf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:52.720926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a49e06-7e35-4cd7-a95f-a47a236edf8d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:52.721229 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a49e06-7e35-4cd7-a95f-a47a236edf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:52.721498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a49e06-7e35-4cd7-a95f-a47a236edf8d None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:52.722643 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a49e06-7e35-4cd7-a95f-a47a236edf8d None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:52.724080 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a49e06-7e35-4cd7-a95f-a47a236edf8d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:52.725745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 145/293] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:52 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:52.732635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50100d5a-f898-4ea8-9489-f8da0b11c751 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:52.849189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50100d5a-f898-4ea8-9489-f8da0b11c751 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:52.892426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c856d0-a48c-4a65-81ab-10a8a5a39014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:52.893050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c856d0-a48c-4a65-81ab-10a8a5a39014 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:52.893328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c856d0-a48c-4a65-81ab-10a8a5a39014 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:52.893591 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c856d0-a48c-4a65-81ab-10a8a5a39014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:52.894314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c856d0-a48c-4a65-81ab-10a8a5a39014 None admin] RBAC: Adding query filter params (role.id=28ebd5e6ebbc404e87ed29420b2f4254, scope.project.id=70ee53b2d7b14a80bd301008e64665c5, user.id=d84735d182ef440fb35c4f8969940178) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:52.894614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c856d0-a48c-4a65-81ab-10a8a5a39014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:52.896045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c856d0-a48c-4a65-81ab-10a8a5a39014 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:52.902889 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 149/294] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:52 2022] GET /identity/v3/role_assignments?user.id=d84735d182ef440fb35c4f8969940178&scope.project.id=70ee53b2d7b14a80bd301008e64665c5&role.id=28ebd5e6ebbc404e87ed29420b2f4254 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:53.188447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443717ab-e2ee-4d86-9489-e1fced509eb6 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:53.188723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443717ab-e2ee-4d86-9489-e1fced509eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:53.189012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443717ab-e2ee-4d86-9489-e1fced509eb6 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:53.190793 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 146/295] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:53.192335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7ef9f-f138-4cf6-913f-e82550f9ef62 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:53.192621 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7ef9f-f138-4cf6-913f-e82550f9ef62 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:53.192894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7ef9f-f138-4cf6-913f-e82550f9ef62 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:53.194651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 150/296] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:53.201374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4be49-dd96-478c-b24c-df0fc87bbe91 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:53.201684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4be49-dd96-478c-b24c-df0fc87bbe91 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:53.201919 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4be49-dd96-478c-b24c-df0fc87bbe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:53.207206 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1069d98-5367-4774-96c4-7d7572ee6783 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:53.207511 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1069d98-5367-4774-96c4-7d7572ee6783 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:53.207753 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1069d98-5367-4774-96c4-7d7572ee6783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:53.229246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c1069d98-5367-4774-96c4-7d7572ee6783 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:53.230464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c1069d98-5367-4774-96c4-7d7572ee6783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:53.231287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3ae4be49-dd96-478c-b24c-df0fc87bbe91 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:53.232668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3ae4be49-dd96-478c-b24c-df0fc87bbe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:53.251430 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:53.313864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 151/297] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:53.325680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:53.332600 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 147/298] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:53.335909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fe8c2-1771-4f29-b02b-5ca32bfbdc5a None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:53.336493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fe8c2-1771-4f29-b02b-5ca32bfbdc5a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:53.336939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fe8c2-1771-4f29-b02b-5ca32bfbdc5a None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:53.338540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 152/299] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:53.344258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87325b-ce53-4aaf-bca7-67e3e49d0a82 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:53.344536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87325b-ce53-4aaf-bca7-67e3e49d0a82 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:53.344840 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87325b-ce53-4aaf-bca7-67e3e49d0a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:53.354202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2936e-43ab-4664-bbc2-a38b8b269ec8 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:53.354741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2936e-43ab-4664-bbc2-a38b8b269ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:53.355213 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2936e-43ab-4664-bbc2-a38b8b269ec8 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:53.356760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 153/300] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:20:53.362604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c276e0-0913-4614-aa46-8eb2b72cd402 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:53.362908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c276e0-0913-4614-aa46-8eb2b72cd402 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:53.363183 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c276e0-0913-4614-aa46-8eb2b72cd402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:53.366172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-cd87325b-ce53-4aaf-bca7-67e3e49d0a82 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:53.368102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cd87325b-ce53-4aaf-bca7-67e3e49d0a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:53.386476 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-b9c276e0-0913-4614-aa46-8eb2b72cd402 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:53.388046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b9c276e0-0913-4614-aa46-8eb2b72cd402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:53.469747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 148/301] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:53.483397 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 154/302] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:20:53.609811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87325b-ce53-4aaf-bca7-67e3e49d0a82 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:53.640848 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c276e0-0913-4614-aa46-8eb2b72cd402 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:53.715480 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87325b-ce53-4aaf-bca7-67e3e49d0a82 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:53.749125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:53.752550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:53.756535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14356fc4-6e6f-4ad5-8dbe-25c90521e1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:53.757310 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356fc4-6e6f-4ad5-8dbe-25c90521e1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:53.757656 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356fc4-6e6f-4ad5-8dbe-25c90521e1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:53.758774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356fc4-6e6f-4ad5-8dbe-25c90521e1d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:53.769487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c276e0-0913-4614-aa46-8eb2b72cd402 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:53.779653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14356fc4-6e6f-4ad5-8dbe-25c90521e1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:53.779653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-14356fc4-6e6f-4ad5-8dbe-25c90521e1d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:53.779653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:53.779653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:53.779653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:53.779653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:53.779653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:53.779653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:53.779653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:53.779653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:53.779653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:53.779653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:53.779653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:53.779653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:53.780455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:53.781326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 149/303] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:53.782490 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14356fc4-6e6f-4ad5-8dbe-25c90521e1d9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:53.808369 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a0cfc-eb12-43a8-a4c0-0f0dd17a8d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:53.809022 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a0cfc-eb12-43a8-a4c0-0f0dd17a8d56 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:53.809295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a0cfc-eb12-43a8-a4c0-0f0dd17a8d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:53.809558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a0cfc-eb12-43a8-a4c0-0f0dd17a8d56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:53.810656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a0cfc-eb12-43a8-a4c0-0f0dd17a8d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:53.812076 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a0cfc-eb12-43a8-a4c0-0f0dd17a8d56 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:53.817035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 155/304] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:53.817035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a0cfc-eb12-43a8-a4c0-0f0dd17a8d56 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:53.885419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14356fc4-6e6f-4ad5-8dbe-25c90521e1d9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:53.918513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a0cfc-eb12-43a8-a4c0-0f0dd17a8d56 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:53.919700 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2510ce-0d18-421c-bc22-6766cda1dc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:53.920320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2510ce-0d18-421c-bc22-6766cda1dc39 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:53.920595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2510ce-0d18-421c-bc22-6766cda1dc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:53.920862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2510ce-0d18-421c-bc22-6766cda1dc39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:53.932162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2510ce-0d18-421c-bc22-6766cda1dc39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-fc2510ce-0d18-421c-bc22-6766cda1dc39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:53.937046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:53.938117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:53.938895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:53.938895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:53.938895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:53.938895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:53.938895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:53.938895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:53.938895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:53.938895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:53.938895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:53.938895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:53.938895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:53.938895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:53.938895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 150/305] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:53.939506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2510ce-0d18-421c-bc22-6766cda1dc39 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:53.953232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330de3b-604e-4b48-80dc-c0a55e8dc3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:53.953863 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330de3b-604e-4b48-80dc-c0a55e8dc3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:53.954142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330de3b-604e-4b48-80dc-c0a55e8dc3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:53.954414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330de3b-604e-4b48-80dc-c0a55e8dc3b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:53.964326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330de3b-604e-4b48-80dc-c0a55e8dc3b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-3330de3b-604e-4b48-80dc-c0a55e8dc3b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:53.969261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:53.970120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:53.970911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:53.970911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:53.970911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:53.970911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:53.970911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:53.970911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:53.970911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:53.970911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:53.970911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:53.970911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:53.970911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:53.970911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:20:53.970911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 156/306] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:53.972105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330de3b-604e-4b48-80dc-c0a55e8dc3b7 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:53.986953 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:53.989620 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:54.038744 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2510ce-0d18-421c-bc22-6766cda1dc39 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:54.071263 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330de3b-604e-4b48-80dc-c0a55e8dc3b7 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:54.074379 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88952a57-deaf-423a-a86a-52fbb9d30f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:54.074983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88952a57-deaf-423a-a86a-52fbb9d30f06 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:54.075262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88952a57-deaf-423a-a86a-52fbb9d30f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:54.075536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88952a57-deaf-423a-a86a-52fbb9d30f06 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:54.076203 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88952a57-deaf-423a-a86a-52fbb9d30f06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:54.076510 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88952a57-deaf-423a-a86a-52fbb9d30f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:54.077927 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88952a57-deaf-423a-a86a-52fbb9d30f06 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:54.090457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 151/307] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:54.090457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88952a57-deaf-423a-a86a-52fbb9d30f06 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:54.109880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72e9e8-8251-45e2-9827-0b486a4d12f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:54.110485 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72e9e8-8251-45e2-9827-0b486a4d12f6 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:54.110761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72e9e8-8251-45e2-9827-0b486a4d12f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:54.111034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72e9e8-8251-45e2-9827-0b486a4d12f6 None admin] PATH_INFO: `/v3/groups` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:54.111656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72e9e8-8251-45e2-9827-0b486a4d12f6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:54.113135 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72e9e8-8251-45e2-9827-0b486a4d12f6 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:54.196667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88952a57-deaf-423a-a86a-52fbb9d30f06 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:54.206815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:54.220289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 157/308] 10.222.0.50 () {60 vars in 1134 bytes} [Sat Sep 17 04:20:53 2022] POST /identity/v3/groups => generated 229 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:20:54.221147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72e9e8-8251-45e2-9827-0b486a4d12f6 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:54.231700 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a50fc5-7838-4c56-bd0b-4bde1f850324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:54.232342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a50fc5-7838-4c56-bd0b-4bde1f850324 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:54.232622 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a50fc5-7838-4c56-bd0b-4bde1f850324 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:54.232893 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a50fc5-7838-4c56-bd0b-4bde1f850324 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:54.233638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a50fc5-7838-4c56-bd0b-4bde1f850324 None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:54.233943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a50fc5-7838-4c56-bd0b-4bde1f850324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:54.235400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a50fc5-7838-4c56-bd0b-4bde1f850324 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:54.245854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 152/309] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:54.251617 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a50fc5-7838-4c56-bd0b-4bde1f850324 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:54.303963 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:54.337334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72e9e8-8251-45e2-9827-0b486a4d12f6 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:54.368727 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a50fc5-7838-4c56-bd0b-4bde1f850324 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:54.379208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30849734-e38d-4e8a-83f3-50b98a1b73d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:54.379841 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849734-e38d-4e8a-83f3-50b98a1b73d6 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:54.380114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849734-e38d-4e8a-83f3-50b98a1b73d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:54.380708 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849734-e38d-4e8a-83f3-50b98a1b73d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:54.381544 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30849734-e38d-4e8a-83f3-50b98a1b73d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:54.381850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30849734-e38d-4e8a-83f3-50b98a1b73d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:54.383379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30849734-e38d-4e8a-83f3-50b98a1b73d6 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:54.392685 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 158/310] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:54.393454 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30849734-e38d-4e8a-83f3-50b98a1b73d6 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:54.413709 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35a497-c739-4848-b383-eb45c251e20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:54.414924 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35a497-c739-4848-b383-eb45c251e20b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:54.415182 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35a497-c739-4848-b383-eb45c251e20b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:54.415514 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35a497-c739-4848-b383-eb45c251e20b None admin] PATH_INFO: `/v3/users/0d4aa59533624f53b58556c285fb3c23` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:54.431433 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35a497-c739-4848-b383-eb45c251e20b None admin] RBAC: Authorizing `identity:get_user(user_id=0d4aa59533624f53b58556c285fb3c23)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:54.433713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35a497-c739-4848-b383-eb45c251e20b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:54.435659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 153/311] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:54 2022] GET /identity/v3/users/0d4aa59533624f53b58556c285fb3c23 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:54.436451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35a497-c739-4848-b383-eb45c251e20b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:54.470784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:54.513812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30849734-e38d-4e8a-83f3-50b98a1b73d6 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:54.542978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35a497-c739-4848-b383-eb45c251e20b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:54.548106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34466f9f-2ac4-48c9-811e-43d97622bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:54.548735 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34466f9f-2ac4-48c9-811e-43d97622bea5 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:54.549045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34466f9f-2ac4-48c9-811e-43d97622bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:54.549293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34466f9f-2ac4-48c9-811e-43d97622bea5 None admin] PATH_INFO: `/v3/users/37504f463fab469b87870961e4f40001` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:54.550414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34466f9f-2ac4-48c9-811e-43d97622bea5 None admin] RBAC: Authorizing `identity:get_user(user_id=37504f463fab469b87870961e4f40001)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:54.551843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34466f9f-2ac4-48c9-811e-43d97622bea5 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:54.558034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 159/312] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:54 2022] GET /identity/v3/users/37504f463fab469b87870961e4f40001 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:54.558034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34466f9f-2ac4-48c9-811e-43d97622bea5 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:54.558034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:54.583599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5589b4-841a-49b9-be9a-8d105a0842f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:54.584225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5589b4-841a-49b9-be9a-8d105a0842f3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:54.584496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5589b4-841a-49b9-be9a-8d105a0842f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:54.584784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5589b4-841a-49b9-be9a-8d105a0842f3 None admin] PATH_INFO: `/v3/users/887462ca6e994ea9b4f4e05ba20d638e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:54.586126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5589b4-841a-49b9-be9a-8d105a0842f3 None admin] RBAC: Authorizing `identity:get_user(user_id=887462ca6e994ea9b4f4e05ba20d638e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:54.588172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5589b4-841a-49b9-be9a-8d105a0842f3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:54.589944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 154/313] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:54 2022] GET /identity/v3/users/887462ca6e994ea9b4f4e05ba20d638e => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:54.594169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5589b4-841a-49b9-be9a-8d105a0842f3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:54.660915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34466f9f-2ac4-48c9-811e-43d97622bea5 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:54.694150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:54.697200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b31a6-f1ed-4565-a626-f0c34ef3b036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:54.697802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b31a6-f1ed-4565-a626-f0c34ef3b036 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:54.698079 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b31a6-f1ed-4565-a626-f0c34ef3b036 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:54.698338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b31a6-f1ed-4565-a626-f0c34ef3b036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:54.698432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5589b4-841a-49b9-be9a-8d105a0842f3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:54.699054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b31a6-f1ed-4565-a626-f0c34ef3b036 None admin] RBAC: Adding query filter params (role.id=8072bf5817774f5786c71af7d54b87b5, user.id=0d4aa59533624f53b58556c285fb3c23, scope.system=all) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:54.699356 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b31a6-f1ed-4565-a626-f0c34ef3b036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:54.700790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b31a6-f1ed-4565-a626-f0c34ef3b036 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:54.709386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 160/314] 10.222.0.50 () {56 vars in 1308 bytes} [Sat Sep 17 04:20:54 2022] GET /identity/v3/role_assignments?user.id=0d4aa59533624f53b58556c285fb3c23&scope.system=all&role.id=8072bf5817774f5786c71af7d54b87b5 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:54.711002 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b31a6-f1ed-4565-a626-f0c34ef3b036 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:54.739657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2d187-b275-4c86-9713-764a18eb6649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:54.740707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d187-b275-4c86-9713-764a18eb6649 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:54.741227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d187-b275-4c86-9713-764a18eb6649 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:54.741707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d187-b275-4c86-9713-764a18eb6649 None admin] PATH_INFO: `/v3/system/users/37504f463fab469b87870961e4f40001/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:54.743863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2d187-b275-4c86-9713-764a18eb6649 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=37504f463fab469b87870961e4f40001, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:54.745687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2d187-b275-4c86-9713-764a18eb6649 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:54.799298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:54.824188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 155/315] 10.222.0.50 () {58 vars in 1334 bytes} [Sat Sep 17 04:20:54 2022] PUT /identity/v3/system/users/37504f463fab469b87870961e4f40001/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:20:54.856858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b31a6-f1ed-4565-a626-f0c34ef3b036 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:54.900010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5e550-c07e-416b-9ceb-7712b04b633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:54.900647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e550-c07e-416b-9ceb-7712b04b633d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:54.900929 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e550-c07e-416b-9ceb-7712b04b633d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:54.901238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e550-c07e-416b-9ceb-7712b04b633d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:54.980681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5e550-c07e-416b-9ceb-7712b04b633d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:54.982222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5e550-c07e-416b-9ceb-7712b04b633d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:55.057490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:55.095196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 161/316] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:20:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:20:55.100969 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2d187-b275-4c86-9713-764a18eb6649 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:55.217368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2d187-b275-4c86-9713-764a18eb6649 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:55.252341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ad1df-be73-4d8f-ae40-78295cea9970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:55.252976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ad1df-be73-4d8f-ae40-78295cea9970 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:55.253273 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ad1df-be73-4d8f-ae40-78295cea9970 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:55.253540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ad1df-be73-4d8f-ae40-78295cea9970 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:55.254665 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ad1df-be73-4d8f-ae40-78295cea9970 None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:55.256178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ad1df-be73-4d8f-ae40-78295cea9970 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:55.262998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 156/317] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:20:55 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:55.264729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5e550-c07e-416b-9ceb-7712b04b633d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:55.371252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5e550-c07e-416b-9ceb-7712b04b633d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:55.411880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac011731-43e0-4c3c-a116-f64d730b7db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:55.412490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac011731-43e0-4c3c-a116-f64d730b7db7 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:55.412771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac011731-43e0-4c3c-a116-f64d730b7db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:55.413067 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac011731-43e0-4c3c-a116-f64d730b7db7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:55.413867 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac011731-43e0-4c3c-a116-f64d730b7db7 None admin] RBAC: Adding query filter params (role.id=8072bf5817774f5786c71af7d54b87b5, scope.project.id=70ee53b2d7b14a80bd301008e64665c5, user.id=887462ca6e994ea9b4f4e05ba20d638e) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:55.414279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac011731-43e0-4c3c-a116-f64d730b7db7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:55.415703 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac011731-43e0-4c3c-a116-f64d730b7db7 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:55.422286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 162/318] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:20:55 2022] GET /identity/v3/role_assignments?user.id=887462ca6e994ea9b4f4e05ba20d638e&scope.project.id=70ee53b2d7b14a80bd301008e64665c5&role.id=8072bf5817774f5786c71af7d54b87b5 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:56.490459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249783a-6467-4d4c-bf21-339e6d667823 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:56.490944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249783a-6467-4d4c-bf21-339e6d667823 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:56.490944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249783a-6467-4d4c-bf21-339e6d667823 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:56.492332 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 157/319] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:56.497423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b14a-d033-4a5f-a9d3-d33a84813b8e None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:56.497818 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b14a-d033-4a5f-a9d3-d33a84813b8e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:56.497993 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b14a-d033-4a5f-a9d3-d33a84813b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:56.516048 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-acf9b14a-d033-4a5f-a9d3-d33a84813b8e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:56.517252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-acf9b14a-d033-4a5f-a9d3-d33a84813b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:56.542739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:56.585281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 163/320] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:20:56.852861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249783a-6467-4d4c-bf21-339e6d667823 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:56.887129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:56.948689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f4966-a24e-4c58-8172-955a404b0702 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:56.949054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f4966-a24e-4c58-8172-955a404b0702 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:56.949259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f4966-a24e-4c58-8172-955a404b0702 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:56.950718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 164/321] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:56.955698 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b06c-55c4-420e-a89e-18d9982abdef None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:56.955969 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b06c-55c4-420e-a89e-18d9982abdef None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:56.956236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b06c-55c4-420e-a89e-18d9982abdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:56.972913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249783a-6467-4d4c-bf21-339e6d667823 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:56.974216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-0b19b06c-55c4-420e-a89e-18d9982abdef None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:56.976283 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-0b19b06c-55c4-420e-a89e-18d9982abdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:57.008913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c4a54-b4bd-42f4-abfc-bcd80a659275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:57.009714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c4a54-b4bd-42f4-abfc-bcd80a659275 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:57.010295 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c4a54-b4bd-42f4-abfc-bcd80a659275 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:57.010567 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c4a54-b4bd-42f4-abfc-bcd80a659275 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:57.011939 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c4a54-b4bd-42f4-abfc-bcd80a659275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:57.013647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c4a54-b4bd-42f4-abfc-bcd80a659275 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:57.017036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 158/322] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:20:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:57.020843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c4a54-b4bd-42f4-abfc-bcd80a659275 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:57.048376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 165/323] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:20:57.049656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce992b-4a40-42fc-84d1-09cdf8ab3502 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:57.049943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce992b-4a40-42fc-84d1-09cdf8ab3502 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:57.050221 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce992b-4a40-42fc-84d1-09cdf8ab3502 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:57.051463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 166/324] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:20:57.056726 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b728a68-5c13-424e-beae-7b5cdbea9ec2 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:57.057044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b728a68-5c13-424e-beae-7b5cdbea9ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:57.057320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b728a68-5c13-424e-beae-7b5cdbea9ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:57.075443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-7b728a68-5c13-424e-beae-7b5cdbea9ec2 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:20:57.076627 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7b728a68-5c13-424e-beae-7b5cdbea9ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:20:57.124841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:57.128622 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c4a54-b4bd-42f4-abfc-bcd80a659275 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:57.158893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 167/325] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:20:57.168652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0052ce-5467-4969-85ca-759175d7815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:57.169295 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0052ce-5467-4969-85ca-759175d7815f None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:57.169568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0052ce-5467-4969-85ca-759175d7815f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:57.169831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0052ce-5467-4969-85ca-759175d7815f None admin] PATH_INFO: `/v3/groups` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:57.170455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0052ce-5467-4969-85ca-759175d7815f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:57.171867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0052ce-5467-4969-85ca-759175d7815f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:57.279915 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 159/326] 10.222.0.50 () {60 vars in 1134 bytes} [Sat Sep 17 04:20:57 2022] POST /identity/v3/groups => generated 226 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:20:57.333652 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b728a68-5c13-424e-beae-7b5cdbea9ec2 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:57.358460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:57.428427 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0052ce-5467-4969-85ca-759175d7815f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:57.446468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b728a68-5c13-424e-beae-7b5cdbea9ec2 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:57.486244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c60a7c-f841-4cf3-8ebe-0e7759ee3956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:57.486904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c60a7c-f841-4cf3-8ebe-0e7759ee3956 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:57.487179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c60a7c-f841-4cf3-8ebe-0e7759ee3956 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:57.487445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c60a7c-f841-4cf3-8ebe-0e7759ee3956 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:57.500866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c60a7c-f841-4cf3-8ebe-0e7759ee3956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-f3c60a7c-f841-4cf3-8ebe-0e7759ee3956 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:57.506178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:57.507021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:57.508647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:57.508647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:57.508647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:57.508647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:57.508647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:57.508647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:57.508647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:57.508647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:57.508647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:57.508647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:57.508647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:20:57.508647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:20:57.508647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 168/327] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:20:57.515292 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c60a7c-f841-4cf3-8ebe-0e7759ee3956 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:57.544950 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0052ce-5467-4969-85ca-759175d7815f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:57.585772 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8e3c5-ae7d-44ce-b975-fd795bd721b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:57.586419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8e3c5-ae7d-44ce-b975-fd795bd721b4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:57.586871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8e3c5-ae7d-44ce-b975-fd795bd721b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:57.587204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8e3c5-ae7d-44ce-b975-fd795bd721b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:57.600195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8e3c5-ae7d-44ce-b975-fd795bd721b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-eaa8e3c5-ae7d-44ce-b975-fd795bd721b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:20:57.606817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:20:57.607694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:20:57.608519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:20:57.608519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:20:57.608519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:20:57.608519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:20:57.608519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:20:57.608519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:20:57.608519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:20:57.608519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:20:57.608519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:20:57.608519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:20:57.608519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:20:57.608519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:20:57.608519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 160/328] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:20:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:20:57.609274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:57.614350 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8e3c5-ae7d-44ce-b975-fd795bd721b4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:57.635585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c60a7c-f841-4cf3-8ebe-0e7759ee3956 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:57.636630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:57.686852 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d874327-6501-4907-afd5-2e3396cd1373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:57.687394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d874327-6501-4907-afd5-2e3396cd1373 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:57.687665 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d874327-6501-4907-afd5-2e3396cd1373 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:57.687930 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d874327-6501-4907-afd5-2e3396cd1373 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:57.688590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d874327-6501-4907-afd5-2e3396cd1373 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:57.688888 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d874327-6501-4907-afd5-2e3396cd1373 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:57.690320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d874327-6501-4907-afd5-2e3396cd1373 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:57.700151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 169/329] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:57.705790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d874327-6501-4907-afd5-2e3396cd1373 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:57.744351 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8e3c5-ae7d-44ce-b975-fd795bd721b4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:57.788280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da269e22-9886-451c-9c5a-29394e062d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:57.789605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da269e22-9886-451c-9c5a-29394e062d51 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:57.789605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da269e22-9886-451c-9c5a-29394e062d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:57.789822 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da269e22-9886-451c-9c5a-29394e062d51 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:57.790636 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da269e22-9886-451c-9c5a-29394e062d51 None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:57.791090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da269e22-9886-451c-9c5a-29394e062d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:57.792764 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da269e22-9886-451c-9c5a-29394e062d51 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:57.802862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 161/330] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:20:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:57.809129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da269e22-9886-451c-9c5a-29394e062d51 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:57.843557 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d874327-6501-4907-afd5-2e3396cd1373 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:57.891866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae130bbb-d766-4baa-8a86-821caa37c7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:57.892845 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae130bbb-d766-4baa-8a86-821caa37c7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:57.893543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae130bbb-d766-4baa-8a86-821caa37c7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:57.893994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae130bbb-d766-4baa-8a86-821caa37c7e8 None admin] PATH_INFO: `/v3/users/0d4aa59533624f53b58556c285fb3c23` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:57.895728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae130bbb-d766-4baa-8a86-821caa37c7e8 None admin] RBAC: Authorizing `identity:get_user(user_id=0d4aa59533624f53b58556c285fb3c23)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:57.899207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae130bbb-d766-4baa-8a86-821caa37c7e8 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:57.902085 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 170/331] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:57 2022] GET /identity/v3/users/0d4aa59533624f53b58556c285fb3c23 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:20:57.908729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae130bbb-d766-4baa-8a86-821caa37c7e8 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:57.922439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:57.927116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:20:57.946052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da269e22-9886-451c-9c5a-29394e062d51 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:57.995690 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15665c68-bf27-4e2c-aa04-32ee3139b3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:57.996512 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15665c68-bf27-4e2c-aa04-32ee3139b3bc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:57.996889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15665c68-bf27-4e2c-aa04-32ee3139b3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:57.997304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15665c68-bf27-4e2c-aa04-32ee3139b3bc None admin] PATH_INFO: `/v3/users/37504f463fab469b87870961e4f40001` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:57.999114 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15665c68-bf27-4e2c-aa04-32ee3139b3bc None admin] RBAC: Authorizing `identity:get_user(user_id=37504f463fab469b87870961e4f40001)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:58.000787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15665c68-bf27-4e2c-aa04-32ee3139b3bc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:58.002843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 162/332] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:20:57 2022] GET /identity/v3/users/37504f463fab469b87870961e4f40001 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:20:58.009244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15665c68-bf27-4e2c-aa04-32ee3139b3bc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:20:58.039835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae130bbb-d766-4baa-8a86-821caa37c7e8 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:58.076773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2cf64-7550-4ce4-89dd-d72c92684c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:58.077496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2cf64-7550-4ce4-89dd-d72c92684c84 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:58.077773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2cf64-7550-4ce4-89dd-d72c92684c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:58.078037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2cf64-7550-4ce4-89dd-d72c92684c84 None admin] PATH_INFO: `/v3/system/users/0d4aa59533624f53b58556c285fb3c23/roles/8072bf5817774f5786c71af7d54b87b5` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:58.079457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2cf64-7550-4ce4-89dd-d72c92684c84 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0d4aa59533624f53b58556c285fb3c23, role_id=8072bf5817774f5786c71af7d54b87b5)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:58.080835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2cf64-7550-4ce4-89dd-d72c92684c84 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:58.123722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15665c68-bf27-4e2c-aa04-32ee3139b3bc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:20:58.161332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 171/333] 10.222.0.50 () {58 vars in 1334 bytes} [Sat Sep 17 04:20:57 2022] PUT /identity/v3/system/users/0d4aa59533624f53b58556c285fb3c23/roles/8072bf5817774f5786c71af7d54b87b5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:20:58.166143 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982573a-f5cc-4626-8618-10ef1d00b5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:20:58.166143 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982573a-f5cc-4626-8618-10ef1d00b5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:20:58.166143 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982573a-f5cc-4626-8618-10ef1d00b5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:20:58.166444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982573a-f5cc-4626-8618-10ef1d00b5c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:20:58.167167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982573a-f5cc-4626-8618-10ef1d00b5c7 None admin] RBAC: Adding query filter params (role.id=28ebd5e6ebbc404e87ed29420b2f4254, user.id=37504f463fab469b87870961e4f40001, scope.system=all) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:20:58.168372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982573a-f5cc-4626-8618-10ef1d00b5c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:20:58.168936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982573a-f5cc-4626-8618-10ef1d00b5c7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:20:58.184359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 163/334] 10.222.0.50 () {56 vars in 1308 bytes} [Sat Sep 17 04:20:58 2022] GET /identity/v3/role_assignments?user.id=37504f463fab469b87870961e4f40001&scope.system=all&role.id=28ebd5e6ebbc404e87ed29420b2f4254 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:00.256445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd6703-b03d-4773-b69c-81d1e515d55e None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:00.257470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd6703-b03d-4773-b69c-81d1e515d55e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:00.257966 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd6703-b03d-4773-b69c-81d1e515d55e None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:00.259795 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 172/335] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:00.265286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211f8fe-ca4e-4dff-a310-5bf9faf507e0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:00.266156 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211f8fe-ca4e-4dff-a310-5bf9faf507e0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:00.266620 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211f8fe-ca4e-4dff-a310-5bf9faf507e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:00.282430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:00.293819 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a211f8fe-ca4e-4dff-a310-5bf9faf507e0 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:00.295289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a211f8fe-ca4e-4dff-a310-5bf9faf507e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:00.375264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 164/336] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:00.708109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3aa68-41f4-481f-82a0-14c7ba8a2c9e None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:00.708481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3aa68-41f4-481f-82a0-14c7ba8a2c9e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:00.708687 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3aa68-41f4-481f-82a0-14c7ba8a2c9e None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:00.710320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 173/337] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:00.716632 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c25f46-1a4e-4d2e-a130-adf801d5f19e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:00.716917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c25f46-1a4e-4d2e-a130-adf801d5f19e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:00.717215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c25f46-1a4e-4d2e-a130-adf801d5f19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:00.742137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-26c25f46-1a4e-4d2e-a130-adf801d5f19e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:00.743332 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-26c25f46-1a4e-4d2e-a130-adf801d5f19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:00.815488 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 165/338] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:00.890683 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3aa68-41f4-481f-82a0-14c7ba8a2c9e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:00.989032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:01.024358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3aa68-41f4-481f-82a0-14c7ba8a2c9e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:01.068014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486efc9-5f2c-47aa-b1c7-d340facf8239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:01.069015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486efc9-5f2c-47aa-b1c7-d340facf8239 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:01.069512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486efc9-5f2c-47aa-b1c7-d340facf8239 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:01.070064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486efc9-5f2c-47aa-b1c7-d340facf8239 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:01.086464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486efc9-5f2c-47aa-b1c7-d340facf8239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-f486efc9-5f2c-47aa-b1c7-d340facf8239 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:01.092026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:01.092895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:01.098007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:01.098007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:01.098007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:01.098007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:01.098007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:01.098007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:01.098007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:01.098007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:01.098007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:01.098007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:01.098007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:21:01.098007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:01.100386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 174/339] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:01.106787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c25f46-1a4e-4d2e-a130-adf801d5f19e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:01.186776 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6410a9-5862-4ddc-bacc-20810ce2d58d None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:01.187430 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6410a9-5862-4ddc-bacc-20810ce2d58d None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:01.187894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6410a9-5862-4ddc-bacc-20810ce2d58d None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:01.189803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 175/340] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:01.202263 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:01.203690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc203365-6cc8-4014-8b17-4f8aa2fdd4c9 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:01.203921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc203365-6cc8-4014-8b17-4f8aa2fdd4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:01.204204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc203365-6cc8-4014-8b17-4f8aa2fdd4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:01.239423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c25f46-1a4e-4d2e-a130-adf801d5f19e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:01.241260 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-bc203365-6cc8-4014-8b17-4f8aa2fdd4c9 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:01.243154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-bc203365-6cc8-4014-8b17-4f8aa2fdd4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:01.279485 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceceec3-e160-4472-b743-1f8520bc42fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:01.280119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceceec3-e160-4472-b743-1f8520bc42fe None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:01.280369 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceceec3-e160-4472-b743-1f8520bc42fe None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:01.280630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceceec3-e160-4472-b743-1f8520bc42fe None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:01.281360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceceec3-e160-4472-b743-1f8520bc42fe None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:01.281659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceceec3-e160-4472-b743-1f8520bc42fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:01.283037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceceec3-e160-4472-b743-1f8520bc42fe None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:01.292422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 166/341] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:21:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:01.297901 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceceec3-e160-4472-b743-1f8520bc42fe None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:01.410675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceceec3-e160-4472-b743-1f8520bc42fe None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:01.416328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 176/342] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:21:01.417250 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc203365-6cc8-4014-8b17-4f8aa2fdd4c9 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:01.439226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:01.448076 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39ba3f-304a-4ac9-8c54-ca46051352b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:01.448689 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39ba3f-304a-4ac9-8c54-ca46051352b0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:01.448961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39ba3f-304a-4ac9-8c54-ca46051352b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:01.449258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39ba3f-304a-4ac9-8c54-ca46051352b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:01.554221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39ba3f-304a-4ac9-8c54-ca46051352b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:01.556555 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39ba3f-304a-4ac9-8c54-ca46051352b0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:01.603336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:01.676159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc203365-6cc8-4014-8b17-4f8aa2fdd4c9 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:01.693392 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 167/343] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:01.694673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dca50f-1832-4e36-b221-3fd936806759 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:01.694987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dca50f-1832-4e36-b221-3fd936806759 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:01.695255 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dca50f-1832-4e36-b221-3fd936806759 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:01.696796 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 168/344] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:01.697981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093cdeb-83d4-46bd-a18e-370a56ec52d4 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:01.698263 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093cdeb-83d4-46bd-a18e-370a56ec52d4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:01.698530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093cdeb-83d4-46bd-a18e-370a56ec52d4 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:01.699723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 169/345] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:01.703527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046769c-516d-4294-aad3-fe50367a2a86 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:01.703847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046769c-516d-4294-aad3-fe50367a2a86 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:01.704176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046769c-516d-4294-aad3-fe50367a2a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:01.724755 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1046769c-516d-4294-aad3-fe50367a2a86 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:01.726862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1046769c-516d-4294-aad3-fe50367a2a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:01.754144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:01.754335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8e7e3-4268-4971-af77-5c9c6d63582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:01.754897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8e7e3-4268-4971-af77-5c9c6d63582b None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:01.755179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8e7e3-4268-4971-af77-5c9c6d63582b None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:01.761014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8e7e3-4268-4971-af77-5c9c6d63582b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:01.782602 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8e7e3-4268-4971-af77-5c9c6d63582b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-a2f8e7e3-4268-4971-af77-5c9c6d63582b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:01.795373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:01.796268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:01.797047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:01.797047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:01.797047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:01.797047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:01.797047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:01.797047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:01.797047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:01.797047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:01.797047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:01.797047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:01.797047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:21:01.797047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:01.797047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 177/346] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:21:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:01.797687 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8e7e3-4268-4971-af77-5c9c6d63582b None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:01.810107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 170/347] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:01.812475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d1b6-0ea6-4402-b53e-2d98773709af None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:01.812782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d1b6-0ea6-4402-b53e-2d98773709af None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:01.817013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d1b6-0ea6-4402-b53e-2d98773709af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:01.838719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-75e5d1b6-0ea6-4402-b53e-2d98773709af None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:01.839897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-75e5d1b6-0ea6-4402-b53e-2d98773709af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:01.921115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 171/348] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:01.922063 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5d1b6-0ea6-4402-b53e-2d98773709af None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:01.935884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8e7e3-4268-4971-af77-5c9c6d63582b None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:01.961782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:01.973503 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3feeca-1c9a-4b86-86c7-a87e887252b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:01.974297 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3feeca-1c9a-4b86-86c7-a87e887252b7 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:01.982567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3feeca-1c9a-4b86-86c7-a87e887252b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:01.982567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3feeca-1c9a-4b86-86c7-a87e887252b7 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:01.982567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3feeca-1c9a-4b86-86c7-a87e887252b7 None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:01.982567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3feeca-1c9a-4b86-86c7-a87e887252b7 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:01.982567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 178/349] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:01 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:01.986471 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3feeca-1c9a-4b86-86c7-a87e887252b7 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:02.098809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:02.125096 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5d1b6-0ea6-4402-b53e-2d98773709af None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:02.138470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3feeca-1c9a-4b86-86c7-a87e887252b7 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:02.203575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954efd2b-6963-4c5f-9a6c-b550941ac259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:02.204195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954efd2b-6963-4c5f-9a6c-b550941ac259 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:02.204470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954efd2b-6963-4c5f-9a6c-b550941ac259 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:02.204732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954efd2b-6963-4c5f-9a6c-b550941ac259 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:02.205534 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954efd2b-6963-4c5f-9a6c-b550941ac259 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:02.205834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954efd2b-6963-4c5f-9a6c-b550941ac259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:02.206296 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14f512-b0f4-4ee0-8969-4b75b740da42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:02.207139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f512-b0f4-4ee0-8969-4b75b740da42 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:02.207383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954efd2b-6963-4c5f-9a6c-b550941ac259 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:02.208753 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f512-b0f4-4ee0-8969-4b75b740da42 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:02.209401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f512-b0f4-4ee0-8969-4b75b740da42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:02.227708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 172/350] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:02.229412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954efd2b-6963-4c5f-9a6c-b550941ac259 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:02.235120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14f512-b0f4-4ee0-8969-4b75b740da42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-ea14f512-b0f4-4ee0-8969-4b75b740da42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:02.247350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:02.248288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:02.249116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:02.249116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:02.249116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:02.249116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:02.249116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:02.249116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:02.249116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:02.249116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:02.249116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:02.249116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:02.249116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:21:02.249116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:02.253654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 179/351] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:02.254716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14f512-b0f4-4ee0-8969-4b75b740da42 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:02.329879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:02.389767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954efd2b-6963-4c5f-9a6c-b550941ac259 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:02.392000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14f512-b0f4-4ee0-8969-4b75b740da42 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:02.429163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce8f85-1509-4679-8c73-c5ebca7f9fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:02.430683 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8f85-1509-4679-8c73-c5ebca7f9fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:02.430964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8f85-1509-4679-8c73-c5ebca7f9fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:02.431237 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8f85-1509-4679-8c73-c5ebca7f9fc6 None admin] PATH_INFO: `/v3/groups/5447638e25154a70aa862e2854fb505c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:02.433655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b5470-1351-42f3-b89c-a4034e0c697b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:02.434466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b5470-1351-42f3-b89c-a4034e0c697b None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:02.434755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b5470-1351-42f3-b89c-a4034e0c697b None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:02.435029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b5470-1351-42f3-b89c-a4034e0c697b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:02.440794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce8f85-1509-4679-8c73-c5ebca7f9fc6 None admin] RBAC: Authorizing `identity:get_group(group_id=5447638e25154a70aa862e2854fb505c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:02.442654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce8f85-1509-4679-8c73-c5ebca7f9fc6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:02.444604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 173/352] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:02 2022] GET /identity/v3/groups/5447638e25154a70aa862e2854fb505c => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:02.446538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce8f85-1509-4679-8c73-c5ebca7f9fc6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:02.466091 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:02.542326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b5470-1351-42f3-b89c-a4034e0c697b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:02.543814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b5470-1351-42f3-b89c-a4034e0c697b None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:02.580584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce8f85-1509-4679-8c73-c5ebca7f9fc6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:02.605386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:02.625699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5da9b-e756-42b7-83e2-89341db710e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:02.626321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5da9b-e756-42b7-83e2-89341db710e8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:02.626655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5da9b-e756-42b7-83e2-89341db710e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:02.626868 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5da9b-e756-42b7-83e2-89341db710e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:02.627538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5da9b-e756-42b7-83e2-89341db710e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:02.627841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5da9b-e756-42b7-83e2-89341db710e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:02.629354 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5da9b-e756-42b7-83e2-89341db710e8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:02.640980 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 174/353] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:21:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:02.641639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5da9b-e756-42b7-83e2-89341db710e8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:02.662412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 180/354] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:02.663617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b5470-1351-42f3-b89c-a4034e0c697b None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:02.736367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:02.760889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5da9b-e756-42b7-83e2-89341db710e8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:02.781011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b5470-1351-42f3-b89c-a4034e0c697b None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:02.798931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b85ee-b211-41f9-9e68-0862c5840262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:02.799550 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b85ee-b211-41f9-9e68-0862c5840262 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:02.799824 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b85ee-b211-41f9-9e68-0862c5840262 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:02.800088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b85ee-b211-41f9-9e68-0862c5840262 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:02.815289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b85ee-b211-41f9-9e68-0862c5840262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-a79b85ee-b211-41f9-9e68-0862c5840262 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:02.822439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:02.823345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:02.824144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:02.824144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:02.824144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:02.824144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:02.824144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:02.824144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:02.824144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:02.824144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:02.824144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:02.824144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:02.824144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 04:21:02.824144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:02.824144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 175/355] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:02.824777 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b85ee-b211-41f9-9e68-0862c5840262 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:02.826054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1013cb-3920-40e8-a27e-3f555bd606f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:02.826349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1013cb-3920-40e8-a27e-3f555bd606f5 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:02.826697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1013cb-3920-40e8-a27e-3f555bd606f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:02.826899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1013cb-3920-40e8-a27e-3f555bd606f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:02.844767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1013cb-3920-40e8-a27e-3f555bd606f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-8c1013cb-3920-40e8-a27e-3f555bd606f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:02.849741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:02.850633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:02.852267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:02.852267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:02.852267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:02.852267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:02.852267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:02.852267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:02.852267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:02.852267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:02.852267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:02.852267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:02.852267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:21:02.852267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:02.852267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 181/356] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:21:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:02.857591 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ef20-7bd6-4a2e-8208-6312af62a564 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:02.857875 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ef20-7bd6-4a2e-8208-6312af62a564 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:02.858145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ef20-7bd6-4a2e-8208-6312af62a564 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:02.859428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 182/357] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:02.860475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52ef20-7bd6-4a2e-8208-6312af62a564 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:02.878030 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:02.948661 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b85ee-b211-41f9-9e68-0862c5840262 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:02.975689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52ef20-7bd6-4a2e-8208-6312af62a564 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:02.987782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da253774-bc66-4c42-8079-0c12683977d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:02.988392 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da253774-bc66-4c42-8079-0c12683977d4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:02.988665 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da253774-bc66-4c42-8079-0c12683977d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:02.988932 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da253774-bc66-4c42-8079-0c12683977d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:02.990546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da253774-bc66-4c42-8079-0c12683977d4 None admin] RBAC: Adding query filter params (group.id=5447638e25154a70aa862e2854fb505c, role.id=28ebd5e6ebbc404e87ed29420b2f4254, scope.project.id=157a31991261402d8b74b6c5316fcb03) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:02.990546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da253774-bc66-4c42-8079-0c12683977d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:02.991867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da253774-bc66-4c42-8079-0c12683977d4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:02.995027 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:03.005175 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 176/358] 10.222.0.50 () {56 vars in 1376 bytes} [Sat Sep 17 04:21:02 2022] GET /identity/v3/role_assignments?group.id=5447638e25154a70aa862e2854fb505c&scope.project.id=157a31991261402d8b74b6c5316fcb03&role.id=28ebd5e6ebbc404e87ed29420b2f4254 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:03.005175 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da253774-bc66-4c42-8079-0c12683977d4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:03.025793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0841f3-1721-4277-a839-1d61d204306f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:03.026534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0841f3-1721-4277-a839-1d61d204306f None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:03.026815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0841f3-1721-4277-a839-1d61d204306f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:03.027086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0841f3-1721-4277-a839-1d61d204306f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:03.135829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0841f3-1721-4277-a839-1d61d204306f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:03.139011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0841f3-1721-4277-a839-1d61d204306f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:03.159011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da253774-bc66-4c42-8079-0c12683977d4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:03.163277 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:03.209041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81379a-ec91-46eb-945f-cfb301c4eb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:03.209783 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81379a-ec91-46eb-945f-cfb301c4eb4e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:03.210167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81379a-ec91-46eb-945f-cfb301c4eb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:03.211269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81379a-ec91-46eb-945f-cfb301c4eb4e None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:03.212777 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81379a-ec91-46eb-945f-cfb301c4eb4e None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:03.214725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81379a-ec91-46eb-945f-cfb301c4eb4e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:03.216101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 177/359] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:02 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:03.216873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81379a-ec91-46eb-945f-cfb301c4eb4e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:03.276066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 183/360] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:03.276920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0841f3-1721-4277-a839-1d61d204306f None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:03.303792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:03.349950 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81379a-ec91-46eb-945f-cfb301c4eb4e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:03.387547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e10e2a-c213-44bf-a937-916a5f754a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:03.388153 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10e2a-c213-44bf-a937-916a5f754a92 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:03.388425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10e2a-c213-44bf-a937-916a5f754a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:03.388693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10e2a-c213-44bf-a937-916a5f754a92 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:03.389392 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e10e2a-c213-44bf-a937-916a5f754a92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:03.389693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e10e2a-c213-44bf-a937-916a5f754a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:03.391083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e10e2a-c213-44bf-a937-916a5f754a92 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:03.402366 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 178/361] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:21:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:03.403872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb132e9f-9456-48fe-a1cf-49ad8aef0053 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:03.404153 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb132e9f-9456-48fe-a1cf-49ad8aef0053 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:03.404418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb132e9f-9456-48fe-a1cf-49ad8aef0053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:03.408709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0841f3-1721-4277-a839-1d61d204306f None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:03.423523 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-cb132e9f-9456-48fe-a1cf-49ad8aef0053 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:03.424791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cb132e9f-9456-48fe-a1cf-49ad8aef0053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:03.425087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:03.452177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d7d57-c63c-48c4-ab2c-6f969e3dd84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:03.453239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d7d57-c63c-48c4-ab2c-6f969e3dd84d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:03.453522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d7d57-c63c-48c4-ab2c-6f969e3dd84d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:03.453937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d7d57-c63c-48c4-ab2c-6f969e3dd84d None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:03.454732 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d7d57-c63c-48c4-ab2c-6f969e3dd84d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:03.455038 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d7d57-c63c-48c4-ab2c-6f969e3dd84d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:03.456899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d7d57-c63c-48c4-ab2c-6f969e3dd84d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:03.467971 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 184/362] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:03.469318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d7d57-c63c-48c4-ab2c-6f969e3dd84d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:03.509041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 179/363] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:03.509041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb132e9f-9456-48fe-a1cf-49ad8aef0053 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:03.589268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:03.609528 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d7d57-c63c-48c4-ab2c-6f969e3dd84d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:03.635995 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb132e9f-9456-48fe-a1cf-49ad8aef0053 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:03.655656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab533f5-9ca9-4438-9c0c-90ebb570b06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:03.656290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab533f5-9ca9-4438-9c0c-90ebb570b06f None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:03.656571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab533f5-9ca9-4438-9c0c-90ebb570b06f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:03.656840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab533f5-9ca9-4438-9c0c-90ebb570b06f None admin] PATH_INFO: `/v3/groups/5447638e25154a70aa862e2854fb505c` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:03.658026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab533f5-9ca9-4438-9c0c-90ebb570b06f None admin] RBAC: Authorizing `identity:get_group(group_id=5447638e25154a70aa862e2854fb505c)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:03.659478 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab533f5-9ca9-4438-9c0c-90ebb570b06f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:03.661275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 185/364] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:03 2022] GET /identity/v3/groups/5447638e25154a70aa862e2854fb505c => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:03.661845 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab533f5-9ca9-4438-9c0c-90ebb570b06f None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:03.673297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28937f7-1ff9-42e1-aa15-2364dd23990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:03.673988 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28937f7-1ff9-42e1-aa15-2364dd23990f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:03.674268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28937f7-1ff9-42e1-aa15-2364dd23990f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:03.674536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28937f7-1ff9-42e1-aa15-2364dd23990f None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:03.675738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28937f7-1ff9-42e1-aa15-2364dd23990f None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:03.677294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28937f7-1ff9-42e1-aa15-2364dd23990f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:03.679796 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 180/365] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:03 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:03.680816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28937f7-1ff9-42e1-aa15-2364dd23990f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:03.720831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:03.797088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28937f7-1ff9-42e1-aa15-2364dd23990f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:03.801421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab533f5-9ca9-4438-9c0c-90ebb570b06f None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:03.838857 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:03.852055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4b336-a41e-4a09-be40-c97c05d266f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:03.852785 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b336-a41e-4a09-be40-c97c05d266f9 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:03.853062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b336-a41e-4a09-be40-c97c05d266f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:03.853317 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b336-a41e-4a09-be40-c97c05d266f9 None admin] PATH_INFO: `/v3/users/0d4aa59533624f53b58556c285fb3c23` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:03.853715 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b4a4f-9952-4c7a-9b46-873ee6c62f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:03.854540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b4a4f-9952-4c7a-9b46-873ee6c62f6f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:03.854644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4b336-a41e-4a09-be40-c97c05d266f9 None admin] RBAC: Authorizing `identity:get_user(user_id=0d4aa59533624f53b58556c285fb3c23)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:03.854946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b4a4f-9952-4c7a-9b46-873ee6c62f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:03.855339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b4a4f-9952-4c7a-9b46-873ee6c62f6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:03.856196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4b336-a41e-4a09-be40-c97c05d266f9 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:03.858124 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 186/366] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:21:03 2022] GET /identity/v3/users/0d4aa59533624f53b58556c285fb3c23 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:03.858736 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4b336-a41e-4a09-be40-c97c05d266f9 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:03.951412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b4a4f-9952-4c7a-9b46-873ee6c62f6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:03.952869 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b4a4f-9952-4c7a-9b46-873ee6c62f6f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:03.993648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4b336-a41e-4a09-be40-c97c05d266f9 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:04.006882 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:04.037991 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc9ef9-93a8-4f54-8d0a-4968a96b416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:04.039215 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc9ef9-93a8-4f54-8d0a-4968a96b416e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:04.039496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc9ef9-93a8-4f54-8d0a-4968a96b416e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:04.039761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc9ef9-93a8-4f54-8d0a-4968a96b416e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:04.040490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc9ef9-93a8-4f54-8d0a-4968a96b416e None admin] RBAC: Adding query filter params (group.id=5447638e25154a70aa862e2854fb505c, role.id=22f7e3b007984ad79378413e11b1a86f, scope.project.id=157a31991261402d8b74b6c5316fcb03) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:04.040822 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc9ef9-93a8-4f54-8d0a-4968a96b416e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:04.043015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc9ef9-93a8-4f54-8d0a-4968a96b416e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:04.057035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 187/367] 10.222.0.50 () {56 vars in 1376 bytes} [Sat Sep 17 04:21:03 2022] GET /identity/v3/role_assignments?group.id=5447638e25154a70aa862e2854fb505c&scope.project.id=157a31991261402d8b74b6c5316fcb03&role.id=22f7e3b007984ad79378413e11b1a86f => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:04.057035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc9ef9-93a8-4f54-8d0a-4968a96b416e None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:04.108865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 181/368] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:04.110003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b4a4f-9952-4c7a-9b46-873ee6c62f6f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:04.162278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:04.206239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc9ef9-93a8-4f54-8d0a-4968a96b416e None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:04.253783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5708c-b81d-46d7-84df-1d0a4fe5acb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:04.254794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5708c-b81d-46d7-84df-1d0a4fe5acb1 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:04.255282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5708c-b81d-46d7-84df-1d0a4fe5acb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:04.255772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5708c-b81d-46d7-84df-1d0a4fe5acb1 None admin] PATH_INFO: `/v3/groups/5447638e25154a70aa862e2854fb505c` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:04.257239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5708c-b81d-46d7-84df-1d0a4fe5acb1 None admin] RBAC: Authorizing `identity:get_group(group_id=5447638e25154a70aa862e2854fb505c)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:04.258954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5708c-b81d-46d7-84df-1d0a4fe5acb1 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:04.261702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 188/369] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:04 2022] GET /identity/v3/groups/5447638e25154a70aa862e2854fb505c => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:04.263061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5708c-b81d-46d7-84df-1d0a4fe5acb1 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:04.278061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b4a4f-9952-4c7a-9b46-873ee6c62f6f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:04.317352 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:04.326093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cafccf-6173-4d81-9953-15933048158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:04.327641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cafccf-6173-4d81-9953-15933048158e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:04.327641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cafccf-6173-4d81-9953-15933048158e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:04.327641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cafccf-6173-4d81-9953-15933048158e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:04.342417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cafccf-6173-4d81-9953-15933048158e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e4cafccf-6173-4d81-9953-15933048158e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:04.349192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:04.350136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:04.351462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:04.351462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:04.351462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:04.351462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:04.351462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:04.351462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:04.351462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:04.351462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:04.351462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:04.351462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:04.351462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:04.351462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:04.351462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 182/370] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:21:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:04.351462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cafccf-6173-4d81-9953-15933048158e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:04.381248 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5708c-b81d-46d7-84df-1d0a4fe5acb1 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:04.421893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eda006-f005-4f48-a1f0-3ba30209bf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:04.422579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eda006-f005-4f48-a1f0-3ba30209bf04 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:04.422862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eda006-f005-4f48-a1f0-3ba30209bf04 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:04.423126 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eda006-f005-4f48-a1f0-3ba30209bf04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:04.423847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eda006-f005-4f48-a1f0-3ba30209bf04 None admin] RBAC: Adding query filter params (role.id=8072bf5817774f5786c71af7d54b87b5, user.id=0d4aa59533624f53b58556c285fb3c23, scope.system=all) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:04.424150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eda006-f005-4f48-a1f0-3ba30209bf04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:04.425613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eda006-f005-4f48-a1f0-3ba30209bf04 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:04.438501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 189/371] 10.222.0.50 () {56 vars in 1308 bytes} [Sat Sep 17 04:21:04 2022] GET /identity/v3/role_assignments?user.id=0d4aa59533624f53b58556c285fb3c23&scope.system=all&role.id=8072bf5817774f5786c71af7d54b87b5 => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:04.439398 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eda006-f005-4f48-a1f0-3ba30209bf04 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:04.472756 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:04.486782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cafccf-6173-4d81-9953-15933048158e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:04.526324 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e81e6-2fc5-4aac-97c0-1afc1bb14a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:04.527017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e81e6-2fc5-4aac-97c0-1afc1bb14a00 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:04.527294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e81e6-2fc5-4aac-97c0-1afc1bb14a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:04.527558 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e81e6-2fc5-4aac-97c0-1afc1bb14a00 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:04.528703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e81e6-2fc5-4aac-97c0-1afc1bb14a00 None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:04.530186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e81e6-2fc5-4aac-97c0-1afc1bb14a00 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:04.532124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 183/372] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:04 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:04.537497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e81e6-2fc5-4aac-97c0-1afc1bb14a00 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:04.575496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:04.579737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eda006-f005-4f48-a1f0-3ba30209bf04 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:04.626095 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc71ab-0f2c-4ca2-b4c9-71b177305548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:04.627662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc71ab-0f2c-4ca2-b4c9-71b177305548 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:04.628237 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc71ab-0f2c-4ca2-b4c9-71b177305548 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:04.628708 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc71ab-0f2c-4ca2-b4c9-71b177305548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:04.629669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc71ab-0f2c-4ca2-b4c9-71b177305548 None admin] RBAC: Adding query filter params (group.id=5447638e25154a70aa862e2854fb505c, role.id=28ebd5e6ebbc404e87ed29420b2f4254, scope.project.id=70ee53b2d7b14a80bd301008e64665c5) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:04.630163 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc71ab-0f2c-4ca2-b4c9-71b177305548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:04.633686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc71ab-0f2c-4ca2-b4c9-71b177305548 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:04.642343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 190/373] 10.222.0.50 () {56 vars in 1376 bytes} [Sat Sep 17 04:21:04 2022] GET /identity/v3/role_assignments?group.id=5447638e25154a70aa862e2854fb505c&scope.project.id=70ee53b2d7b14a80bd301008e64665c5&role.id=28ebd5e6ebbc404e87ed29420b2f4254 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:04.643499 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc71ab-0f2c-4ca2-b4c9-71b177305548 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:04.701227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e81e6-2fc5-4aac-97c0-1afc1bb14a00 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:04.767180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59af05-696e-41dd-9e0c-40cdbdf7d416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:04.768101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59af05-696e-41dd-9e0c-40cdbdf7d416 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:04.768486 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59af05-696e-41dd-9e0c-40cdbdf7d416 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:04.768818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59af05-696e-41dd-9e0c-40cdbdf7d416 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:04.769662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59af05-696e-41dd-9e0c-40cdbdf7d416 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:04.770031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59af05-696e-41dd-9e0c-40cdbdf7d416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:04.771505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59af05-696e-41dd-9e0c-40cdbdf7d416 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:04.776684 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc71ab-0f2c-4ca2-b4c9-71b177305548 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:04.794590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 184/374] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:04.799979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59af05-696e-41dd-9e0c-40cdbdf7d416 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:04.831341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705c200-5aa6-4c8f-9cca-9da298797d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:04.831996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705c200-5aa6-4c8f-9cca-9da298797d61 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:04.832273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705c200-5aa6-4c8f-9cca-9da298797d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:04.832544 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705c200-5aa6-4c8f-9cca-9da298797d61 None admin] PATH_INFO: `/v3/groups/5447638e25154a70aa862e2854fb505c` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:04.834912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705c200-5aa6-4c8f-9cca-9da298797d61 None admin] RBAC: Authorizing `identity:get_group(group_id=5447638e25154a70aa862e2854fb505c)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:04.837474 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705c200-5aa6-4c8f-9cca-9da298797d61 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:04.843171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:04.847981 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 191/375] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:04 2022] GET /identity/v3/groups/5447638e25154a70aa862e2854fb505c => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:04.854814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705c200-5aa6-4c8f-9cca-9da298797d61 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:04.914570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:04.999266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705c200-5aa6-4c8f-9cca-9da298797d61 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:05.002705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59af05-696e-41dd-9e0c-40cdbdf7d416 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:05.037939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761caa93-4e9b-46f0-9dc9-3c73da52520c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:05.038972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761caa93-4e9b-46f0-9dc9-3c73da52520c None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:05.039258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761caa93-4e9b-46f0-9dc9-3c73da52520c None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:05.039534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761caa93-4e9b-46f0-9dc9-3c73da52520c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:05.040272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761caa93-4e9b-46f0-9dc9-3c73da52520c None admin] RBAC: Adding query filter params (group.id=5447638e25154a70aa862e2854fb505c, role.id=22f7e3b007984ad79378413e11b1a86f, scope.project.id=70ee53b2d7b14a80bd301008e64665c5) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:05.040583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761caa93-4e9b-46f0-9dc9-3c73da52520c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:05.042666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761caa93-4e9b-46f0-9dc9-3c73da52520c None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:05.053402 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 192/376] 10.222.0.50 () {56 vars in 1376 bytes} [Sat Sep 17 04:21:04 2022] GET /identity/v3/role_assignments?group.id=5447638e25154a70aa862e2854fb505c&scope.project.id=70ee53b2d7b14a80bd301008e64665c5&role.id=22f7e3b007984ad79378413e11b1a86f => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:05.095022 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e99fe4-80c9-4b22-b805-901d9bf57921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:05.095721 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e99fe4-80c9-4b22-b805-901d9bf57921 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:05.096008 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e99fe4-80c9-4b22-b805-901d9bf57921 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:05.096275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e99fe4-80c9-4b22-b805-901d9bf57921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:05.181359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e99fe4-80c9-4b22-b805-901d9bf57921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:05.182928 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e99fe4-80c9-4b22-b805-901d9bf57921 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:05.209406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:05.295085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 185/377] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 04:21:05.300392 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761caa93-4e9b-46f0-9dc9-3c73da52520c None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:05.440737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:05.446893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761caa93-4e9b-46f0-9dc9-3c73da52520c None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:05.484070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880da9e-178f-4d62-b472-9ae0be322935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:05.484710 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880da9e-178f-4d62-b472-9ae0be322935 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:05.484985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880da9e-178f-4d62-b472-9ae0be322935 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:05.485280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880da9e-178f-4d62-b472-9ae0be322935 None admin] PATH_INFO: `/v3/projects/18915dddeacb48718863511fb593fb67` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:05.486405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880da9e-178f-4d62-b472-9ae0be322935 None admin] RBAC: Authorizing `identity:get_project(project_id=18915dddeacb48718863511fb593fb67)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:05.487843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880da9e-178f-4d62-b472-9ae0be322935 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:05.490374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 193/378] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:05 2022] GET /identity/v3/projects/18915dddeacb48718863511fb593fb67 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:05.495783 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e99fe4-80c9-4b22-b805-901d9bf57921 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:05.603930 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7376e10-183c-4280-8a5d-586fbce873b6 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:05.604468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7376e10-183c-4280-8a5d-586fbce873b6 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:05.604691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7376e10-183c-4280-8a5d-586fbce873b6 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:05.607395 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 194/379] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:05.611719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ccbed-8d0f-4791-a6d6-0b65c6074b7a None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:05.612003 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ccbed-8d0f-4791-a6d6-0b65c6074b7a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:05.612277 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ccbed-8d0f-4791-a6d6-0b65c6074b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:05.621264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e99fe4-80c9-4b22-b805-901d9bf57921 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:05.640704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:05.649805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2e0ccbed-8d0f-4791-a6d6-0b65c6074b7a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:05.651061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2e0ccbed-8d0f-4791-a6d6-0b65c6074b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:05.658004 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc6c92-9175-4e62-9650-f369bd0398a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:05.658648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc6c92-9175-4e62-9650-f369bd0398a4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:05.658975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc6c92-9175-4e62-9650-f369bd0398a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:05.659247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc6c92-9175-4e62-9650-f369bd0398a4 None admin] PATH_INFO: `/v3/groups/51403e70fbc94ce6b5815ef7a97e14ab` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:05.664540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc6c92-9175-4e62-9650-f369bd0398a4 None admin] RBAC: Authorizing `identity:get_group(group_id=51403e70fbc94ce6b5815ef7a97e14ab)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:05.666057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc6c92-9175-4e62-9650-f369bd0398a4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:05.668024 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 186/380] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:05 2022] GET /identity/v3/groups/51403e70fbc94ce6b5815ef7a97e14ab => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:05.673828 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc6c92-9175-4e62-9650-f369bd0398a4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:05.774711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 195/381] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:21:05.779795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc6c92-9175-4e62-9650-f369bd0398a4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:05.817962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabcead-b5d5-49f0-80e7-3995a2ab0bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:05.818578 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabcead-b5d5-49f0-80e7-3995a2ab0bea None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:05.818853 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabcead-b5d5-49f0-80e7-3995a2ab0bea None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:05.819125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabcead-b5d5-49f0-80e7-3995a2ab0bea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:05.820501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabcead-b5d5-49f0-80e7-3995a2ab0bea None admin] RBAC: Adding query filter params (group.id=51403e70fbc94ce6b5815ef7a97e14ab, role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=18915dddeacb48718863511fb593fb67) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:05.820892 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabcead-b5d5-49f0-80e7-3995a2ab0bea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:05.822418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabcead-b5d5-49f0-80e7-3995a2ab0bea None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:05.828432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 187/382] 10.222.0.50 () {56 vars in 1376 bytes} [Sat Sep 17 04:21:05 2022] GET /identity/v3/role_assignments?group.id=51403e70fbc94ce6b5815ef7a97e14ab&scope.project.id=18915dddeacb48718863511fb593fb67&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:06.085566 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ccbed-8d0f-4791-a6d6-0b65c6074b7a None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:06.184069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:06.191414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ccbed-8d0f-4791-a6d6-0b65c6074b7a None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:06.227858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b86fe-696e-4c0d-83b1-5969fa13f16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:06.227858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b86fe-696e-4c0d-83b1-5969fa13f16d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:06.227858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b86fe-696e-4c0d-83b1-5969fa13f16d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:06.227858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b86fe-696e-4c0d-83b1-5969fa13f16d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:06.238899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b86fe-696e-4c0d-83b1-5969fa13f16d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-1c8b86fe-696e-4c0d-83b1-5969fa13f16d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:06.244084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:06.244979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:06.245809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:06.245809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:06.245809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:06.245809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:06.245809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:06.245809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:06.245809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:06.245809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:06.245809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:06.245809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:06.245809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:21:06.245809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:06.249096 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 196/383] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:06.252154 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabcead-b5d5-49f0-80e7-3995a2ab0bea None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:06.357462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:06.447856 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabcead-b5d5-49f0-80e7-3995a2ab0bea None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:06.498606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e9e64-1389-4444-812a-aed64920d72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:06.499250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e9e64-1389-4444-812a-aed64920d72a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:06.499496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e9e64-1389-4444-812a-aed64920d72a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:06.499773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e9e64-1389-4444-812a-aed64920d72a None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:06.500446 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e9e64-1389-4444-812a-aed64920d72a None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:06.500749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e9e64-1389-4444-812a-aed64920d72a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:06.502172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e9e64-1389-4444-812a-aed64920d72a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:06.514341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 188/384] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:21:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:06.519789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b86fe-696e-4c0d-83b1-5969fa13f16d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:06.645021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b86fe-696e-4c0d-83b1-5969fa13f16d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:06.678544 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f8f14-95ec-42db-b990-c24c3af3137a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:06.679326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8f14-95ec-42db-b990-c24c3af3137a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:06.679601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8f14-95ec-42db-b990-c24c3af3137a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:06.679869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8f14-95ec-42db-b990-c24c3af3137a None admin] PATH_INFO: `/v3/groups/5447638e25154a70aa862e2854fb505c` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:06.680973 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f8f14-95ec-42db-b990-c24c3af3137a None admin] RBAC: Authorizing `identity:get_group(group_id=5447638e25154a70aa862e2854fb505c)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:06.682432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f8f14-95ec-42db-b990-c24c3af3137a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:06.688573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 197/385] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:06 2022] GET /identity/v3/groups/5447638e25154a70aa862e2854fb505c => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:06.689907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e9e64-1389-4444-812a-aed64920d72a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:06.844766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e9e64-1389-4444-812a-aed64920d72a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:06.855109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:06.886703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9d7bf-64c3-4fb9-a54c-625f6822d5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:06.887615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9d7bf-64c3-4fb9-a54c-625f6822d5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:06.887896 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9d7bf-64c3-4fb9-a54c-625f6822d5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:06.888163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9d7bf-64c3-4fb9-a54c-625f6822d5f3 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:06.889367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9d7bf-64c3-4fb9-a54c-625f6822d5f3 None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:06.890825 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9d7bf-64c3-4fb9-a54c-625f6822d5f3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:06.892793 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 189/386] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:06 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:06.898829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f8f14-95ec-42db-b990-c24c3af3137a None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:06.902986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23ecf8-606a-4222-af91-2a4cb9508d76 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:06.903266 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23ecf8-606a-4222-af91-2a4cb9508d76 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:06.903538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23ecf8-606a-4222-af91-2a4cb9508d76 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:06.905267 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 190/387] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:21:06.910279 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291dbe-99a2-48c3-998c-cd91ff2e9429 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:06.910558 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291dbe-99a2-48c3-998c-cd91ff2e9429 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:06.910826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291dbe-99a2-48c3-998c-cd91ff2e9429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:06.930709 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-13291dbe-99a2-48c3-998c-cd91ff2e9429 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:06.931898 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-13291dbe-99a2-48c3-998c-cd91ff2e9429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:06.958691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:07.005515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 191/388] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:21:07.088754 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f8f14-95ec-42db-b990-c24c3af3137a None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:07.137699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a9ff6-f5ec-4f0a-8b23-bd21be543ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:07.138365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9ff6-f5ec-4f0a-8b23-bd21be543ad9 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:07.138639 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9ff6-f5ec-4f0a-8b23-bd21be543ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:07.138907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9ff6-f5ec-4f0a-8b23-bd21be543ad9 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03/groups/5447638e25154a70aa862e2854fb505c/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:07.146220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a9ff6-f5ec-4f0a-8b23-bd21be543ad9 None admin] RBAC: Authorizing `identity:create_grant(project_id=157a31991261402d8b74b6c5316fcb03, group_id=5447638e25154a70aa862e2854fb505c, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:07.153457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a9ff6-f5ec-4f0a-8b23-bd21be543ad9 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:07.257270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 198/389] 10.222.0.50 () {58 vars in 1442 bytes} [Sat Sep 17 04:21:06 2022] PUT /identity/v3/projects/157a31991261402d8b74b6c5316fcb03/groups/5447638e25154a70aa862e2854fb505c/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:21:07.377669 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13291dbe-99a2-48c3-998c-cd91ff2e9429 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:07.495619 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13291dbe-99a2-48c3-998c-cd91ff2e9429 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:07.503917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:07.528013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b843f90-89a6-4bf3-9e6c-000eb48b2be7 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:07.528316 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b843f90-89a6-4bf3-9e6c-000eb48b2be7 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:07.528572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b843f90-89a6-4bf3-9e6c-000eb48b2be7 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:07.530299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 199/390] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:07.534491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a8893-00cd-45b6-85f5-7954a1baaac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:07.535087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a8893-00cd-45b6-85f5-7954a1baaac4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:07.535423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a8893-00cd-45b6-85f5-7954a1baaac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:07.535696 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a8893-00cd-45b6-85f5-7954a1baaac4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:07.535875 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296123cf-0c50-4e12-bb3f-d4a6c0058866 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:07.536129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296123cf-0c50-4e12-bb3f-d4a6c0058866 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:07.536400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296123cf-0c50-4e12-bb3f-d4a6c0058866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:07.548861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a8893-00cd-45b6-85f5-7954a1baaac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7a2a8893-00cd-45b6-85f5-7954a1baaac4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:07.553942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:07.555925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:07.557738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:07.557738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:07.557738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:07.557738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:07.557738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:07.557738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:07.557738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:07.557738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:07.557738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:07.557738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:07.557738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:21:07.557738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:07.557738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 192/391] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:21:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:07.559109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-296123cf-0c50-4e12-bb3f-d4a6c0058866 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:07.559109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-296123cf-0c50-4e12-bb3f-d4a6c0058866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:07.565035 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a8893-00cd-45b6-85f5-7954a1baaac4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:07.661414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 200/392] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:21:07.708041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a8893-00cd-45b6-85f5-7954a1baaac4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:07.744713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81551da3-bb0a-4d19-9535-9a80aa8692fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:07.745347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551da3-bb0a-4d19-9535-9a80aa8692fa None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:07.745726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551da3-bb0a-4d19-9535-9a80aa8692fa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:07.745984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551da3-bb0a-4d19-9535-9a80aa8692fa None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:07.746585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81551da3-bb0a-4d19-9535-9a80aa8692fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:07.746885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81551da3-bb0a-4d19-9535-9a80aa8692fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:07.748251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81551da3-bb0a-4d19-9535-9a80aa8692fa None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:07.757627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 193/393] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:07.763426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296123cf-0c50-4e12-bb3f-d4a6c0058866 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:07.782942 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:07.902996 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d3eeb-a95f-42bd-9fba-b7b6b745fc12 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:07.903361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d3eeb-a95f-42bd-9fba-b7b6b745fc12 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:07.903542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d3eeb-a95f-42bd-9fba-b7b6b745fc12 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:07.905108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 194/394] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:21:07.917029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296123cf-0c50-4e12-bb3f-d4a6c0058866 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:07.917197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32efaa-7adc-4a71-9674-746b0051c0eb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:07.917197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32efaa-7adc-4a71-9674-746b0051c0eb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:07.917197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32efaa-7adc-4a71-9674-746b0051c0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:07.949870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4df1d6-0351-4641-b9d8-7b5ee84defc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:07.950507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4df1d6-0351-4641-b9d8-7b5ee84defc3 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:07.950779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4df1d6-0351-4641-b9d8-7b5ee84defc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:07.951046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4df1d6-0351-4641-b9d8-7b5ee84defc3 None admin] PATH_INFO: `/v3/groups/5447638e25154a70aa862e2854fb505c` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:07.951833 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-fc32efaa-7adc-4a71-9674-746b0051c0eb None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:07.952199 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4df1d6-0351-4641-b9d8-7b5ee84defc3 None admin] RBAC: Authorizing `identity:get_group(group_id=5447638e25154a70aa862e2854fb505c)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:07.953513 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fc32efaa-7adc-4a71-9674-746b0051c0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:07.953640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4df1d6-0351-4641-b9d8-7b5ee84defc3 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:07.955361 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 201/395] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:07 2022] GET /identity/v3/groups/5447638e25154a70aa862e2854fb505c => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:07.961833 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4df1d6-0351-4641-b9d8-7b5ee84defc3 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:08.006400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:08.084908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:08.101636 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 195/396] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:08.115581 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32efaa-7adc-4a71-9674-746b0051c0eb None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:08.133203 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4df1d6-0351-4641-b9d8-7b5ee84defc3 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:08.206581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea32a3a-210b-41d0-a2e8-5ed9af5a441a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:08.207673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea32a3a-210b-41d0-a2e8-5ed9af5a441a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:08.208290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea32a3a-210b-41d0-a2e8-5ed9af5a441a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:08.208764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea32a3a-210b-41d0-a2e8-5ed9af5a441a None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:08.210760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea32a3a-210b-41d0-a2e8-5ed9af5a441a None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:08.212460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea32a3a-210b-41d0-a2e8-5ed9af5a441a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:08.214371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 202/397] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:07 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:08.220094 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea32a3a-210b-41d0-a2e8-5ed9af5a441a None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:08.238498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32efaa-7adc-4a71-9674-746b0051c0eb None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:08.288957 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a192d-8a30-4856-bc6f-b1136e3100b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:08.288957 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a192d-8a30-4856-bc6f-b1136e3100b9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:08.288957 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a192d-8a30-4856-bc6f-b1136e3100b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:08.288957 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a192d-8a30-4856-bc6f-b1136e3100b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:08.308771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a192d-8a30-4856-bc6f-b1136e3100b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-649a192d-8a30-4856-bc6f-b1136e3100b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:08.323227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:08.324170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:08.324936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:08.324936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:08.324936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:08.324936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:08.324936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:08.324936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:08.324936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:08.324936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:08.324936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:08.324936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:08.324936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:21:08.324936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:08.324936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 196/398] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:08.346881 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a192d-8a30-4856-bc6f-b1136e3100b9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:08.369908 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:08.370128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea32a3a-210b-41d0-a2e8-5ed9af5a441a None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:08.423638 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be850b-6696-42d5-b1b3-323f601cbcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:08.424310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be850b-6696-42d5-b1b3-323f601cbcad None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:08.424584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be850b-6696-42d5-b1b3-323f601cbcad None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:08.424850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be850b-6696-42d5-b1b3-323f601cbcad None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03/groups/5447638e25154a70aa862e2854fb505c/roles/22f7e3b007984ad79378413e11b1a86f` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:08.428424 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be850b-6696-42d5-b1b3-323f601cbcad None admin] RBAC: Authorizing `identity:create_grant(project_id=157a31991261402d8b74b6c5316fcb03, group_id=5447638e25154a70aa862e2854fb505c, role_id=22f7e3b007984ad79378413e11b1a86f)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:08.431831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be850b-6696-42d5-b1b3-323f601cbcad None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:08.479432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a192d-8a30-4856-bc6f-b1136e3100b9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:08.504326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 203/399] 10.222.0.50 () {58 vars in 1442 bytes} [Sat Sep 17 04:21:08 2022] PUT /identity/v3/projects/157a31991261402d8b74b6c5316fcb03/groups/5447638e25154a70aa862e2854fb505c/roles/22f7e3b007984ad79378413e11b1a86f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:21:08.506619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be850b-6696-42d5-b1b3-323f601cbcad None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:08.519693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07c15d-eb1c-4aa6-8b2a-6ba5affea06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:08.520508 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07c15d-eb1c-4aa6-8b2a-6ba5affea06a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:08.521437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07c15d-eb1c-4aa6-8b2a-6ba5affea06a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:08.521437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07c15d-eb1c-4aa6-8b2a-6ba5affea06a None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:08.522039 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07c15d-eb1c-4aa6-8b2a-6ba5affea06a None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:08.523087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07c15d-eb1c-4aa6-8b2a-6ba5affea06a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:08.524839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07c15d-eb1c-4aa6-8b2a-6ba5affea06a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:08.525671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:08.537471 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 197/400] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:21:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:08.555319 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07c15d-eb1c-4aa6-8b2a-6ba5affea06a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:08.650470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be850b-6696-42d5-b1b3-323f601cbcad None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:08.701903 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:08.708395 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83213fa-4da4-4d5b-8bbb-c531049ac475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:08.709806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83213fa-4da4-4d5b-8bbb-c531049ac475 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:08.710930 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83213fa-4da4-4d5b-8bbb-c531049ac475 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:08.711366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83213fa-4da4-4d5b-8bbb-c531049ac475 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:08.723431 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07c15d-eb1c-4aa6-8b2a-6ba5affea06a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:08.727234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83213fa-4da4-4d5b-8bbb-c531049ac475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-e83213fa-4da4-4d5b-8bbb-c531049ac475 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:08.735501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:08.736364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:08.737188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:08.737188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:08.737188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:08.737188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:08.737188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:08.737188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:08.737188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:08.737188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:08.737188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:08.737188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:08.737188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:21:08.737188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:08.737188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 204/401] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:21:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:08.737188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89400689-5d83-4ce4-8cba-9d3a5c3b68f3 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:08.737885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89400689-5d83-4ce4-8cba-9d3a5c3b68f3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:08.741761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89400689-5d83-4ce4-8cba-9d3a5c3b68f3 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:08.743604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 205/402] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:08.744545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89400689-5d83-4ce4-8cba-9d3a5c3b68f3 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:08.771084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d815b-0e49-48a7-bfc5-389bc9a2b680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:08.772634 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d815b-0e49-48a7-bfc5-389bc9a2b680 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:08.772984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d815b-0e49-48a7-bfc5-389bc9a2b680 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:08.773426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d815b-0e49-48a7-bfc5-389bc9a2b680 None admin] PATH_INFO: `/v3/groups/5447638e25154a70aa862e2854fb505c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:08.774773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d815b-0e49-48a7-bfc5-389bc9a2b680 None admin] RBAC: Authorizing `identity:get_group(group_id=5447638e25154a70aa862e2854fb505c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:08.776298 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d815b-0e49-48a7-bfc5-389bc9a2b680 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:08.778498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 198/403] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:08 2022] GET /identity/v3/groups/5447638e25154a70aa862e2854fb505c => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:08.779531 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025aa0fe-eea6-4f46-aec7-30d035d0a0f7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:08.784209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025aa0fe-eea6-4f46-aec7-30d035d0a0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:08.784608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025aa0fe-eea6-4f46-aec7-30d035d0a0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:08.803112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-025aa0fe-eea6-4f46-aec7-30d035d0a0f7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:08.804928 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-025aa0fe-eea6-4f46-aec7-30d035d0a0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:08.852193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:08.891728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 199/404] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:08.893060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025aa0fe-eea6-4f46-aec7-30d035d0a0f7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:08.894977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89400689-5d83-4ce4-8cba-9d3a5c3b68f3 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:08.933173 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5eb5c-e22f-4c6a-a7aa-af945f8f697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:08.933956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5eb5c-e22f-4c6a-a7aa-af945f8f697a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:08.934362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5eb5c-e22f-4c6a-a7aa-af945f8f697a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:08.934639 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5eb5c-e22f-4c6a-a7aa-af945f8f697a None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:08.935377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5eb5c-e22f-4c6a-a7aa-af945f8f697a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:08.935753 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5eb5c-e22f-4c6a-a7aa-af945f8f697a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:08.937244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5eb5c-e22f-4c6a-a7aa-af945f8f697a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:08.946382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 206/405] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:08.951862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5eb5c-e22f-4c6a-a7aa-af945f8f697a None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:08.989811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:09.013581 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025aa0fe-eea6-4f46-aec7-30d035d0a0f7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:09.049342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d463e-0c87-45e4-92c4-8962bf479e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:09.050365 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d463e-0c87-45e4-92c4-8962bf479e47 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:09.050887 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d463e-0c87-45e4-92c4-8962bf479e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:09.051347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d463e-0c87-45e4-92c4-8962bf479e47 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:09.052647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d463e-0c87-45e4-92c4-8962bf479e47 None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:09.055603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d463e-0c87-45e4-92c4-8962bf479e47 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:09.058514 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 200/406] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:08 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:09.059519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5eb5c-e22f-4c6a-a7aa-af945f8f697a None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:09.067599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d463e-0c87-45e4-92c4-8962bf479e47 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:09.110887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:09.121798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2db75-734d-424b-920f-c23129243d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:09.122433 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2db75-734d-424b-920f-c23129243d96 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:09.122709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2db75-734d-424b-920f-c23129243d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:09.122973 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2db75-734d-424b-920f-c23129243d96 None admin] PATH_INFO: `/v3/groups/5447638e25154a70aa862e2854fb505c` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:09.124080 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2db75-734d-424b-920f-c23129243d96 None admin] RBAC: Authorizing `identity:get_group(group_id=5447638e25154a70aa862e2854fb505c)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:09.125550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2db75-734d-424b-920f-c23129243d96 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:09.127506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 207/407] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:08 2022] GET /identity/v3/groups/5447638e25154a70aa862e2854fb505c => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:09.132956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2db75-734d-424b-920f-c23129243d96 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:09.266378 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d463e-0c87-45e4-92c4-8962bf479e47 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:09.319695 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2db75-734d-424b-920f-c23129243d96 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:09.335520 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc43c5a-7e1f-4541-a712-b0b082480c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:09.336896 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc43c5a-7e1f-4541-a712-b0b082480c64 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:09.337672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc43c5a-7e1f-4541-a712-b0b082480c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:09.338208 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc43c5a-7e1f-4541-a712-b0b082480c64 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5/groups/5447638e25154a70aa862e2854fb505c/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:09.341302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc43c5a-7e1f-4541-a712-b0b082480c64 None admin] RBAC: Authorizing `identity:create_grant(project_id=70ee53b2d7b14a80bd301008e64665c5, group_id=5447638e25154a70aa862e2854fb505c, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:09.343455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc43c5a-7e1f-4541-a712-b0b082480c64 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:09.361583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad5903-3d5a-4df1-abed-b7a6a9c6b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:09.362127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad5903-3d5a-4df1-abed-b7a6a9c6b299 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:09.362400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad5903-3d5a-4df1-abed-b7a6a9c6b299 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:09.362667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad5903-3d5a-4df1-abed-b7a6a9c6b299 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:09.363774 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad5903-3d5a-4df1-abed-b7a6a9c6b299 None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:09.365274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad5903-3d5a-4df1-abed-b7a6a9c6b299 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:09.367422 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 208/408] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:09 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:09.368010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad5903-3d5a-4df1-abed-b7a6a9c6b299 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:09.433623 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 201/409] 10.222.0.50 () {58 vars in 1442 bytes} [Sat Sep 17 04:21:09 2022] PUT /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5/groups/5447638e25154a70aa862e2854fb505c/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:21:09.434672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc43c5a-7e1f-4541-a712-b0b082480c64 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:09.453912 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:09.464007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:09.533598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad5903-3d5a-4df1-abed-b7a6a9c6b299 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:09.603451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9f3d9-0634-42fa-8c76-f9aa53c794f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:09.604107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9f3d9-0634-42fa-8c76-f9aa53c794f1 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:09.604386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9f3d9-0634-42fa-8c76-f9aa53c794f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:09.604660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9f3d9-0634-42fa-8c76-f9aa53c794f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:09.627317 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9f3d9-0634-42fa-8c76-f9aa53c794f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-3ab9f3d9-0634-42fa-8c76-f9aa53c794f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:09.634783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:09.635838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:09.636632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:09.636632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:09.636632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:09.636632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:09.636632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:09.636632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:09.636632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:09.636632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:09.636632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:09.636632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:09.636632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:09.636632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:09.640357 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 209/410] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:21:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:09.647358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9f3d9-0634-42fa-8c76-f9aa53c794f1 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:09.661317 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc43c5a-7e1f-4541-a712-b0b082480c64 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:09.713832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84472fb0-fdef-43c8-a45e-c2b604b5c483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:09.714502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84472fb0-fdef-43c8-a45e-c2b604b5c483 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:09.714784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84472fb0-fdef-43c8-a45e-c2b604b5c483 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:09.715059 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84472fb0-fdef-43c8-a45e-c2b604b5c483 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5/groups/5447638e25154a70aa862e2854fb505c/roles/22f7e3b007984ad79378413e11b1a86f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:09.717337 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84472fb0-fdef-43c8-a45e-c2b604b5c483 None admin] RBAC: Authorizing `identity:create_grant(project_id=70ee53b2d7b14a80bd301008e64665c5, group_id=5447638e25154a70aa862e2854fb505c, role_id=22f7e3b007984ad79378413e11b1a86f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:09.718944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84472fb0-fdef-43c8-a45e-c2b604b5c483 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:09.784172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9f3d9-0634-42fa-8c76-f9aa53c794f1 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:09.813329 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:09.817956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 202/411] 10.222.0.50 () {58 vars in 1442 bytes} [Sat Sep 17 04:21:09 2022] PUT /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5/groups/5447638e25154a70aa862e2854fb505c/roles/22f7e3b007984ad79378413e11b1a86f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:21:09.824819 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65389a2-3b90-498c-be49-1713bd413e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:09.825866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65389a2-3b90-498c-be49-1713bd413e19 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:09.826307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65389a2-3b90-498c-be49-1713bd413e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:09.826739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65389a2-3b90-498c-be49-1713bd413e19 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:09.827764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65389a2-3b90-498c-be49-1713bd413e19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:09.828292 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65389a2-3b90-498c-be49-1713bd413e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:09.830117 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65389a2-3b90-498c-be49-1713bd413e19 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:09.845302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 210/412] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:09.847556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84472fb0-fdef-43c8-a45e-c2b604b5c483 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:09.953887 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:09.999565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84472fb0-fdef-43c8-a45e-c2b604b5c483 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:10.042302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f4c4-573e-4d3d-835d-cf7074f0a0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:10.042948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f4c4-573e-4d3d-835d-cf7074f0a0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:10.043227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f4c4-573e-4d3d-835d-cf7074f0a0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:10.043498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f4c4-573e-4d3d-835d-cf7074f0a0b5 None admin] PATH_INFO: `/v3/groups/51403e70fbc94ce6b5815ef7a97e14ab` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:10.044653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91f4c4-573e-4d3d-835d-cf7074f0a0b5 None admin] RBAC: Authorizing `identity:get_group(group_id=51403e70fbc94ce6b5815ef7a97e14ab)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:10.046249 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91f4c4-573e-4d3d-835d-cf7074f0a0b5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:10.047261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a20ee-2588-405d-aa3c-beb742ea23e0 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:10.047544 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a20ee-2588-405d-aa3c-beb742ea23e0 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:10.047942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 203/413] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:09 2022] GET /identity/v3/groups/51403e70fbc94ce6b5815ef7a97e14ab => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:10.048043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a20ee-2588-405d-aa3c-beb742ea23e0 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:10.052140 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 211/414] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:10.053333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f4c4-573e-4d3d-835d-cf7074f0a0b5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:10.058672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e198778-3eb2-442f-8ba5-f2af4bc4080e None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:10.058962 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e198778-3eb2-442f-8ba5-f2af4bc4080e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:10.059242 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e198778-3eb2-442f-8ba5-f2af4bc4080e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:10.098126 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-0e198778-3eb2-442f-8ba5-f2af4bc4080e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:10.099361 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-0e198778-3eb2-442f-8ba5-f2af4bc4080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:10.199886 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f4c4-573e-4d3d-835d-cf7074f0a0b5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:10.206267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 212/415] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:10.236491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90570c-285e-426e-96e4-8e1d589e9de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:10.237515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90570c-285e-426e-96e4-8e1d589e9de3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:10.237987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90570c-285e-426e-96e4-8e1d589e9de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:10.238467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90570c-285e-426e-96e4-8e1d589e9de3 None admin] PATH_INFO: `/v3/projects/18915dddeacb48718863511fb593fb67` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:10.239843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90570c-285e-426e-96e4-8e1d589e9de3 None admin] RBAC: Authorizing `identity:get_project(project_id=18915dddeacb48718863511fb593fb67)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:10.241579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90570c-285e-426e-96e4-8e1d589e9de3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:10.243703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 204/416] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:10 2022] GET /identity/v3/projects/18915dddeacb48718863511fb593fb67 => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:10.249072 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e198778-3eb2-442f-8ba5-f2af4bc4080e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:10.384333 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e198778-3eb2-442f-8ba5-f2af4bc4080e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:10.410110 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:10.429541 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe48760-ae00-4db5-ac72-c96e41d3dbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:10.430212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe48760-ae00-4db5-ac72-c96e41d3dbaa None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:10.430487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe48760-ae00-4db5-ac72-c96e41d3dbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:10.430757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe48760-ae00-4db5-ac72-c96e41d3dbaa None admin] PATH_INFO: `/v3/projects/18915dddeacb48718863511fb593fb67/groups/51403e70fbc94ce6b5815ef7a97e14ab/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:10.438337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe48760-ae00-4db5-ac72-c96e41d3dbaa None admin] RBAC: Authorizing `identity:create_grant(project_id=18915dddeacb48718863511fb593fb67, group_id=51403e70fbc94ce6b5815ef7a97e14ab, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:10.439781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe48760-ae00-4db5-ac72-c96e41d3dbaa None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:10.496591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90570c-285e-426e-96e4-8e1d589e9de3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:10.499984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:10.519422 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 213/417] 10.222.0.50 () {58 vars in 1442 bytes} [Sat Sep 17 04:21:10 2022] PUT /identity/v3/projects/18915dddeacb48718863511fb593fb67/groups/51403e70fbc94ce6b5815ef7a97e14ab/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:21:10.612297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90570c-285e-426e-96e4-8e1d589e9de3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:10.649942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40577caa-903a-4125-9bcc-4ca8c5e8eea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:10.650924 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40577caa-903a-4125-9bcc-4ca8c5e8eea4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:10.651394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40577caa-903a-4125-9bcc-4ca8c5e8eea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:10.651877 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40577caa-903a-4125-9bcc-4ca8c5e8eea4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:10.664180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40577caa-903a-4125-9bcc-4ca8c5e8eea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-40577caa-903a-4125-9bcc-4ca8c5e8eea4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:10.670323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:10.671211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:10.672000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:10.672000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:10.672000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:10.672000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:10.672000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:10.672000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:10.672000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:10.672000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:10.672000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:10.672000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:10.672000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:21:10.672000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:10.674772 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 205/418] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:10.681363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe48760-ae00-4db5-ac72-c96e41d3dbaa None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:10.793063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe48760-ae00-4db5-ac72-c96e41d3dbaa None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:10.831647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a22df9-39a7-405c-9743-74d6f55a295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:10.832630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a22df9-39a7-405c-9743-74d6f55a295e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:10.833132 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a22df9-39a7-405c-9743-74d6f55a295e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:10.833596 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a22df9-39a7-405c-9743-74d6f55a295e None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:10.834468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a22df9-39a7-405c-9743-74d6f55a295e None admin] RBAC: Adding query filter params (name=member) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:10.835013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a22df9-39a7-405c-9743-74d6f55a295e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:10.836920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a22df9-39a7-405c-9743-74d6f55a295e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:10.846374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 214/419] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:21:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:10.852662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40577caa-903a-4125-9bcc-4ca8c5e8eea4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:10.918455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:10.964018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40577caa-903a-4125-9bcc-4ca8c5e8eea4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:11.000646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182753d0-db68-4916-acfd-b0982c7e8512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:11.001610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182753d0-db68-4916-acfd-b0982c7e8512 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:11.002084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182753d0-db68-4916-acfd-b0982c7e8512 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:11.002568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182753d0-db68-4916-acfd-b0982c7e8512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:11.055010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9643104-6805-4af6-ba0d-3a12e313178e None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:11.055643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9643104-6805-4af6-ba0d-3a12e313178e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:11.056108 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9643104-6805-4af6-ba0d-3a12e313178e None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:11.058305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 215/420] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:21:11.066494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672aa5f-a39b-4051-a408-e871371a9b95 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:11.067045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672aa5f-a39b-4051-a408-e871371a9b95 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:11.067510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672aa5f-a39b-4051-a408-e871371a9b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:11.089316 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-5672aa5f-a39b-4051-a408-e871371a9b95 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:11.091129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5672aa5f-a39b-4051-a408-e871371a9b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:11.099066 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182753d0-db68-4916-acfd-b0982c7e8512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:11.101209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182753d0-db68-4916-acfd-b0982c7e8512 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:11.132973 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:11.187925 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 216/421] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:11.230183 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:11.291501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 206/422] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:11.297299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672aa5f-a39b-4051-a408-e871371a9b95 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:11.400638 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672aa5f-a39b-4051-a408-e871371a9b95 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:11.436361 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5152cd-1f69-485d-b00d-2fece9d257f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:11.437406 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5152cd-1f69-485d-b00d-2fece9d257f0 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:11.437926 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5152cd-1f69-485d-b00d-2fece9d257f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:11.438425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5152cd-1f69-485d-b00d-2fece9d257f0 None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:11.439723 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5152cd-1f69-485d-b00d-2fece9d257f0 None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:11.441374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5152cd-1f69-485d-b00d-2fece9d257f0 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:11.443626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 217/423] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:11 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:11.450279 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182753d0-db68-4916-acfd-b0982c7e8512 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:11.553921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5152cd-1f69-485d-b00d-2fece9d257f0 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:11.562733 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182753d0-db68-4916-acfd-b0982c7e8512 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:11.601596 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effceba5-dcc0-485a-b733-4a8032e8b6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:11.602652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effceba5-dcc0-485a-b733-4a8032e8b6af None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:11.603154 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effceba5-dcc0-485a-b733-4a8032e8b6af None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:11.603614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effceba5-dcc0-485a-b733-4a8032e8b6af None admin] PATH_INFO: `/v3/groups/5447638e25154a70aa862e2854fb505c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:11.605598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effceba5-dcc0-485a-b733-4a8032e8b6af None admin] RBAC: Authorizing `identity:get_group(group_id=5447638e25154a70aa862e2854fb505c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:11.607238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effceba5-dcc0-485a-b733-4a8032e8b6af None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:11.609409 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 207/424] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:11 2022] GET /identity/v3/groups/5447638e25154a70aa862e2854fb505c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:11.617983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effceba5-dcc0-485a-b733-4a8032e8b6af None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:11.648546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:11.664283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:11.743541 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5152cd-1f69-485d-b00d-2fece9d257f0 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:11.781214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ec7fa-4f65-4bf6-913b-c67f6d188aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:11.781847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ec7fa-4f65-4bf6-913b-c67f6d188aaf None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:11.782123 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ec7fa-4f65-4bf6-913b-c67f6d188aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:11.782390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ec7fa-4f65-4bf6-913b-c67f6d188aaf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:11.793625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ec7fa-4f65-4bf6-913b-c67f6d188aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-3b8ec7fa-4f65-4bf6-913b-c67f6d188aaf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:11.798689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:11.799714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:11.800506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:11.800506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:11.800506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:11.800506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:11.800506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:11.800506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:11.800506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:11.800506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:11.800506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:11.800506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:11.800506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:21:11.800506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:11.800506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 218/425] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:21:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:11.809923 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ec7fa-4f65-4bf6-913b-c67f6d188aaf None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:11.811138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effceba5-dcc0-485a-b733-4a8032e8b6af None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:11.856132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949220fe-8179-42f2-8753-3cf78c0faefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:11.857142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949220fe-8179-42f2-8753-3cf78c0faefa None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:11.857636 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949220fe-8179-42f2-8753-3cf78c0faefa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:11.858144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949220fe-8179-42f2-8753-3cf78c0faefa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:11.859068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949220fe-8179-42f2-8753-3cf78c0faefa None admin] RBAC: Adding query filter params (group.id=5447638e25154a70aa862e2854fb505c, role.id=28ebd5e6ebbc404e87ed29420b2f4254, scope.project.id=157a31991261402d8b74b6c5316fcb03) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:11.859564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949220fe-8179-42f2-8753-3cf78c0faefa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:11.861222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949220fe-8179-42f2-8753-3cf78c0faefa None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:11.874216 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 208/426] 10.222.0.50 () {56 vars in 1376 bytes} [Sat Sep 17 04:21:11 2022] GET /identity/v3/role_assignments?group.id=5447638e25154a70aa862e2854fb505c&scope.project.id=157a31991261402d8b74b6c5316fcb03&role.id=28ebd5e6ebbc404e87ed29420b2f4254 => generated 611 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:11.925379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ec7fa-4f65-4bf6-913b-c67f6d188aaf None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:11.933358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:11.963817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d09ac5-089c-4b36-80a5-846127f346b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:11.964525 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d09ac5-089c-4b36-80a5-846127f346b9 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:11.964858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d09ac5-089c-4b36-80a5-846127f346b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:11.965176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d09ac5-089c-4b36-80a5-846127f346b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:11.965862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d09ac5-089c-4b36-80a5-846127f346b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:11.966164 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d09ac5-089c-4b36-80a5-846127f346b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:11.967611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d09ac5-089c-4b36-80a5-846127f346b9 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:11.977919 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 219/427] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:11.983198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949220fe-8179-42f2-8753-3cf78c0faefa None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:12.130169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:12.138948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949220fe-8179-42f2-8753-3cf78c0faefa None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:12.188265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78d233-ba8e-48f2-be08-8297a2750744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:12.188790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78d233-ba8e-48f2-be08-8297a2750744 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:12.189092 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78d233-ba8e-48f2-be08-8297a2750744 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:12.189362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78d233-ba8e-48f2-be08-8297a2750744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:12.274180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78d233-ba8e-48f2-be08-8297a2750744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:12.275645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78d233-ba8e-48f2-be08-8297a2750744 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:12.285939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d77a3-5187-4438-a065-0c78342cfc9d None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:12.286226 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d77a3-5187-4438-a065-0c78342cfc9d None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:12.286501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d77a3-5187-4438-a065-0c78342cfc9d None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:12.288040 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 220/428] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:12.293527 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335870-1fa5-4c64-960c-144f0d0743cf None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:12.293807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335870-1fa5-4c64-960c-144f0d0743cf None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:12.294084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335870-1fa5-4c64-960c-144f0d0743cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:12.316154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-f7335870-1fa5-4c64-960c-144f0d0743cf None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:12.317380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f7335870-1fa5-4c64-960c-144f0d0743cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:12.408479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:12.409451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 221/429] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:12.420748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 209/430] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:12.426675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7335870-1fa5-4c64-960c-144f0d0743cf None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:12.524022 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:12.534369 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7335870-1fa5-4c64-960c-144f0d0743cf None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:12.578397 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c94a0-3faf-4323-a06b-4dec1e0e604d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:12.579045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c94a0-3faf-4323-a06b-4dec1e0e604d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:12.579331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c94a0-3faf-4323-a06b-4dec1e0e604d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:12.579604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c94a0-3faf-4323-a06b-4dec1e0e604d None admin] PATH_INFO: `/v3/projects/157a31991261402d8b74b6c5316fcb03` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:12.580746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c94a0-3faf-4323-a06b-4dec1e0e604d None admin] RBAC: Authorizing `identity:get_project(project_id=157a31991261402d8b74b6c5316fcb03)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:12.582261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c94a0-3faf-4323-a06b-4dec1e0e604d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:12.584869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 222/431] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:12 2022] GET /identity/v3/projects/157a31991261402d8b74b6c5316fcb03 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:12.590049 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78d233-ba8e-48f2-be08-8297a2750744 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:12.674230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22798f-9355-466f-bb35-f76e7e6ec145 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:12.674546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22798f-9355-466f-bb35-f76e7e6ec145 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:12.674777 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22798f-9355-466f-bb35-f76e7e6ec145 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:12.676102 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 223/432] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:12.682567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a25ee9-4ef2-4f1f-8b16-7f676caf587b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:12.682844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a25ee9-4ef2-4f1f-8b16-7f676caf587b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:12.683115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a25ee9-4ef2-4f1f-8b16-7f676caf587b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:12.706690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-d1a25ee9-4ef2-4f1f-8b16-7f676caf587b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:12.708039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d1a25ee9-4ef2-4f1f-8b16-7f676caf587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:12.708643 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78d233-ba8e-48f2-be08-8297a2750744 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:12.744956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabf71a-fe6e-4643-b1d6-21992fdef44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:12.745612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabf71a-fe6e-4643-b1d6-21992fdef44c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:12.745885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabf71a-fe6e-4643-b1d6-21992fdef44c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:12.746154 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabf71a-fe6e-4643-b1d6-21992fdef44c None admin] PATH_INFO: `/v3/groups/5447638e25154a70aa862e2854fb505c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:12.747265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabf71a-fe6e-4643-b1d6-21992fdef44c None admin] RBAC: Authorizing `identity:get_group(group_id=5447638e25154a70aa862e2854fb505c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:12.748713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabf71a-fe6e-4643-b1d6-21992fdef44c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:12.750603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 210/433] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:12 2022] GET /identity/v3/groups/5447638e25154a70aa862e2854fb505c => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:12.751253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabf71a-fe6e-4643-b1d6-21992fdef44c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:12.805144 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 224/434] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:21:12.806563 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a25ee9-4ef2-4f1f-8b16-7f676caf587b None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:12.836481 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:12.879704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabf71a-fe6e-4643-b1d6-21992fdef44c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:12.925640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31fa58-5600-4c18-9f54-ea7bcfca8b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:12.926277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31fa58-5600-4c18-9f54-ea7bcfca8b6c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:12.926551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31fa58-5600-4c18-9f54-ea7bcfca8b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:12.926817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31fa58-5600-4c18-9f54-ea7bcfca8b6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:12.933889 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:12.944548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31fa58-5600-4c18-9f54-ea7bcfca8b6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:12.945885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a25ee9-4ef2-4f1f-8b16-7f676caf587b None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0f31fa58-5600-4c18-9f54-ea7bcfca8b6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:12.951003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:12.951855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:12.952654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:12.952654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:12.952654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:12.952654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:12.952654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:12.952654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:12.952654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:12.952654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:12.952654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:12.952654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:12.952654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 04:21:12.952654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:12.954985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 211/435] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:12.961809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31fa58-5600-4c18-9f54-ea7bcfca8b6c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:12.993498 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c3d35-3578-4301-bd2c-b0d8097eba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:12.994383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3d35-3578-4301-bd2c-b0d8097eba37 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:12.995000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3d35-3578-4301-bd2c-b0d8097eba37 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:12.995823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3d35-3578-4301-bd2c-b0d8097eba37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:12.996970 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c3d35-3578-4301-bd2c-b0d8097eba37 None admin] RBAC: Adding query filter params (group.id=5447638e25154a70aa862e2854fb505c, role.id=22f7e3b007984ad79378413e11b1a86f, scope.project.id=157a31991261402d8b74b6c5316fcb03) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:12.997449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c3d35-3578-4301-bd2c-b0d8097eba37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:12.999302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c3d35-3578-4301-bd2c-b0d8097eba37 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:13.007817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 225/436] 10.222.0.50 () {56 vars in 1376 bytes} [Sat Sep 17 04:21:12 2022] GET /identity/v3/role_assignments?group.id=5447638e25154a70aa862e2854fb505c&scope.project.id=157a31991261402d8b74b6c5316fcb03&role.id=22f7e3b007984ad79378413e11b1a86f => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:13.079556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31fa58-5600-4c18-9f54-ea7bcfca8b6c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:13.105304 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c3d35-3578-4301-bd2c-b0d8097eba37 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:13.107047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:13.124367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01628cb-015b-4f3b-8665-b2b60c7c043c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:13.125650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01628cb-015b-4f3b-8665-b2b60c7c043c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:13.126080 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01628cb-015b-4f3b-8665-b2b60c7c043c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:13.126771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01628cb-015b-4f3b-8665-b2b60c7c043c None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:13.128057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01628cb-015b-4f3b-8665-b2b60c7c043c None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:13.128547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01628cb-015b-4f3b-8665-b2b60c7c043c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:13.130149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01628cb-015b-4f3b-8665-b2b60c7c043c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:13.144564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 212/437] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:21:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:13.154365 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01628cb-015b-4f3b-8665-b2b60c7c043c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:13.252551 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c3d35-3578-4301-bd2c-b0d8097eba37 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:13.297177 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01628cb-015b-4f3b-8665-b2b60c7c043c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:13.311264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c4d93-4b27-4e9b-9d58-9c264444a7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:13.311940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4d93-4b27-4e9b-9d58-9c264444a7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:13.312234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4d93-4b27-4e9b-9d58-9c264444a7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:13.312487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4d93-4b27-4e9b-9d58-9c264444a7a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:13.325907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c4d93-4b27-4e9b-9d58-9c264444a7a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-1f7c4d93-4b27-4e9b-9d58-9c264444a7a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:13.332081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:13.333084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:13.333856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:13.333856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:13.333856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:13.333856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:13.333856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:13.333856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:13.333856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:13.333856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:13.333856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:13.333856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:13.333856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:21:13.333856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:13.334466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 226/438] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:21:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:13.342617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c4d93-4b27-4e9b-9d58-9c264444a7a9 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:13.351758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb716003-7286-4e01-b1de-94f3eae334b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:13.352806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb716003-7286-4e01-b1de-94f3eae334b1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:13.353119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb716003-7286-4e01-b1de-94f3eae334b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:13.353395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb716003-7286-4e01-b1de-94f3eae334b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:13.361067 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:13.427078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:13.445406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb716003-7286-4e01-b1de-94f3eae334b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:13.446904 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb716003-7286-4e01-b1de-94f3eae334b1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:13.472503 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c4d93-4b27-4e9b-9d58-9c264444a7a9 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:13.506948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da78797-20bf-4b99-adde-540948c5daf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:13.507558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da78797-20bf-4b99-adde-540948c5daf9 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:13.507840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da78797-20bf-4b99-adde-540948c5daf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:13.508113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da78797-20bf-4b99-adde-540948c5daf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:13.508767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da78797-20bf-4b99-adde-540948c5daf9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:13.509095 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da78797-20bf-4b99-adde-540948c5daf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:13.510467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da78797-20bf-4b99-adde-540948c5daf9 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:13.518847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 227/439] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:13.520081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f50b-5e5f-499f-9537-fdd131aac286 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:13.520363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f50b-5e5f-499f-9537-fdd131aac286 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:13.520632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f50b-5e5f-499f-9537-fdd131aac286 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:13.522622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 228/440] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:13.527515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057f50b-5e5f-499f-9537-fdd131aac286 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:13.551186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 213/441] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:13.552414 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c7cba-e20b-428f-a86c-f8fccac99b40 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:13.552692 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c7cba-e20b-428f-a86c-f8fccac99b40 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:13.552959 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c7cba-e20b-428f-a86c-f8fccac99b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:13.571202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-674c7cba-e20b-428f-a86c-f8fccac99b40 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:13.572389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-674c7cba-e20b-428f-a86c-f8fccac99b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:13.602546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:13.627508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057f50b-5e5f-499f-9537-fdd131aac286 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:13.636791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 214/442] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:13.637657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c7cba-e20b-428f-a86c-f8fccac99b40 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:13.652244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:13.667368 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9762f2-3099-428e-a691-ea79a975c25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:13.667974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9762f2-3099-428e-a691-ea79a975c25d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:13.668247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9762f2-3099-428e-a691-ea79a975c25d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:13.668512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9762f2-3099-428e-a691-ea79a975c25d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:13.735579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9762f2-3099-428e-a691-ea79a975c25d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:13.737036 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9762f2-3099-428e-a691-ea79a975c25d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:13.743211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c7cba-e20b-428f-a86c-f8fccac99b40 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:13.778737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813eb990-a54b-4f3f-af51-fab424b83544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:13.779353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eb990-a54b-4f3f-af51-fab424b83544 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:13.779630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eb990-a54b-4f3f-af51-fab424b83544 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:13.779901 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eb990-a54b-4f3f-af51-fab424b83544 None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:13.781039 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813eb990-a54b-4f3f-af51-fab424b83544 None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:13.782478 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813eb990-a54b-4f3f-af51-fab424b83544 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:13.784278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 215/443] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:13 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:13.790047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813eb990-a54b-4f3f-af51-fab424b83544 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:13.813258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:13.844399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 229/444] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:13.845447 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9762f2-3099-428e-a691-ea79a975c25d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:13.878165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:13.897639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813eb990-a54b-4f3f-af51-fab424b83544 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:13.933397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621246bf-74c6-47dd-908a-62be5062ffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:13.934018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621246bf-74c6-47dd-908a-62be5062ffd6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:13.934288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621246bf-74c6-47dd-908a-62be5062ffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:13.934559 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621246bf-74c6-47dd-908a-62be5062ffd6 None admin] PATH_INFO: `/v3/groups/5447638e25154a70aa862e2854fb505c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:13.935668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621246bf-74c6-47dd-908a-62be5062ffd6 None admin] RBAC: Authorizing `identity:get_group(group_id=5447638e25154a70aa862e2854fb505c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:13.937123 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621246bf-74c6-47dd-908a-62be5062ffd6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:13.938681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 216/445] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:13 2022] GET /identity/v3/groups/5447638e25154a70aa862e2854fb505c => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:13.939418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621246bf-74c6-47dd-908a-62be5062ffd6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:13.950439 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9762f2-3099-428e-a691-ea79a975c25d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:13.983443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e080a66-7673-4b64-9295-1bf885bafb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:13.984058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e080a66-7673-4b64-9295-1bf885bafb4d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:13.984331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e080a66-7673-4b64-9295-1bf885bafb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:13.984602 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e080a66-7673-4b64-9295-1bf885bafb4d None admin] PATH_INFO: `/v3/projects/70ee53b2d7b14a80bd301008e64665c5` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:13.985736 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e080a66-7673-4b64-9295-1bf885bafb4d None admin] RBAC: Authorizing `identity:get_project(project_id=70ee53b2d7b14a80bd301008e64665c5)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:13.987155 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e080a66-7673-4b64-9295-1bf885bafb4d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:13.988728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 230/446] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:13 2022] GET /identity/v3/projects/70ee53b2d7b14a80bd301008e64665c5 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:13.989550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e080a66-7673-4b64-9295-1bf885bafb4d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:14.032890 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:14.038748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621246bf-74c6-47dd-908a-62be5062ffd6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:14.073031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3084e3b-ae75-4c45-94c4-53bebf812bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:14.073649 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3084e3b-ae75-4c45-94c4-53bebf812bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:14.073923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3084e3b-ae75-4c45-94c4-53bebf812bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:14.074190 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3084e3b-ae75-4c45-94c4-53bebf812bc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:14.083999 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3084e3b-ae75-4c45-94c4-53bebf812bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-f3084e3b-ae75-4c45-94c4-53bebf812bc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:14.088805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:14.089866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:14.090866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:14.090866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:14.090866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:14.090866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:14.090866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:14.090866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:14.090866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:14.090866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:14.090866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:14.090866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:14.090866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:14.090866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:14.091595 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e080a66-7673-4b64-9295-1bf885bafb4d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:14.091681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 217/447] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:21:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:14.091681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3084e3b-ae75-4c45-94c4-53bebf812bc4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:14.105865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:14.124878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a17a0-1af3-4b0e-b8ab-ed07a95e58a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:14.125502 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a17a0-1af3-4b0e-b8ab-ed07a95e58a5 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:14.126629 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a17a0-1af3-4b0e-b8ab-ed07a95e58a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:14.126629 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a17a0-1af3-4b0e-b8ab-ed07a95e58a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:14.126873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a17a0-1af3-4b0e-b8ab-ed07a95e58a5 None admin] RBAC: Adding query filter params (group.id=5447638e25154a70aa862e2854fb505c, role.id=28ebd5e6ebbc404e87ed29420b2f4254, scope.project.id=70ee53b2d7b14a80bd301008e64665c5) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:14.127175 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a17a0-1af3-4b0e-b8ab-ed07a95e58a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:14.128645 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a17a0-1af3-4b0e-b8ab-ed07a95e58a5 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:14.134890 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 231/448] 10.222.0.50 () {56 vars in 1376 bytes} [Sat Sep 17 04:21:13 2022] GET /identity/v3/role_assignments?group.id=5447638e25154a70aa862e2854fb505c&scope.project.id=70ee53b2d7b14a80bd301008e64665c5&role.id=28ebd5e6ebbc404e87ed29420b2f4254 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:14.135675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a17a0-1af3-4b0e-b8ab-ed07a95e58a5 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:14.207594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3084e3b-ae75-4c45-94c4-53bebf812bc4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:14.253497 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a17a0-1af3-4b0e-b8ab-ed07a95e58a5 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:14.260650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc189530-64d1-43ff-bd5a-696248edccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:14.261747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189530-64d1-43ff-bd5a-696248edccdc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:14.261855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189530-64d1-43ff-bd5a-696248edccdc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:14.262105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189530-64d1-43ff-bd5a-696248edccdc None admin] PATH_INFO: `/v3/groups/5447638e25154a70aa862e2854fb505c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:14.263321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc189530-64d1-43ff-bd5a-696248edccdc None admin] RBAC: Authorizing `identity:get_group(group_id=5447638e25154a70aa862e2854fb505c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:14.264218 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:14.264791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc189530-64d1-43ff-bd5a-696248edccdc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:14.266635 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 218/449] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:14 2022] GET /identity/v3/groups/5447638e25154a70aa862e2854fb505c => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:14.272932 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc189530-64d1-43ff-bd5a-696248edccdc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:14.291958 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7366b-9ebf-42ff-a055-b50186ce3aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:14.292634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7366b-9ebf-42ff-a055-b50186ce3aad None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:14.292921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7366b-9ebf-42ff-a055-b50186ce3aad None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:14.293632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7366b-9ebf-42ff-a055-b50186ce3aad None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:14.294382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7366b-9ebf-42ff-a055-b50186ce3aad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:14.294916 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7366b-9ebf-42ff-a055-b50186ce3aad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:14.296458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7366b-9ebf-42ff-a055-b50186ce3aad None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:14.311506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 232/450] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:14.312652 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7366b-9ebf-42ff-a055-b50186ce3aad None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:14.367824 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:14.395467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc189530-64d1-43ff-bd5a-696248edccdc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:14.435560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06896a40-13c4-43fb-aa5d-5b81ce0915de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:14.436169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06896a40-13c4-43fb-aa5d-5b81ce0915de None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:14.436444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06896a40-13c4-43fb-aa5d-5b81ce0915de None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:14.436708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06896a40-13c4-43fb-aa5d-5b81ce0915de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:14.438081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06896a40-13c4-43fb-aa5d-5b81ce0915de None admin] RBAC: Adding query filter params (group.id=5447638e25154a70aa862e2854fb505c, role.id=22f7e3b007984ad79378413e11b1a86f, scope.project.id=70ee53b2d7b14a80bd301008e64665c5) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:14.438081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06896a40-13c4-43fb-aa5d-5b81ce0915de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:14.441213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06896a40-13c4-43fb-aa5d-5b81ce0915de None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:14.442779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7366b-9ebf-42ff-a055-b50186ce3aad None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:14.445889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 219/451] 10.222.0.50 () {56 vars in 1376 bytes} [Sat Sep 17 04:21:14 2022] GET /identity/v3/role_assignments?group.id=5447638e25154a70aa862e2854fb505c&scope.project.id=70ee53b2d7b14a80bd301008e64665c5&role.id=22f7e3b007984ad79378413e11b1a86f => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:14.481294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bfcf1-280a-4311-8f5d-50f3a30ce1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:14.481926 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bfcf1-280a-4311-8f5d-50f3a30ce1da None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:14.482199 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bfcf1-280a-4311-8f5d-50f3a30ce1da None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:14.482467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bfcf1-280a-4311-8f5d-50f3a30ce1da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:14.524028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:14.564150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bfcf1-280a-4311-8f5d-50f3a30ce1da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:14.565767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bfcf1-280a-4311-8f5d-50f3a30ce1da None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:14.670752 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 233/452] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:14.676300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06896a40-13c4-43fb-aa5d-5b81ce0915de None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:14.775856 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06896a40-13c4-43fb-aa5d-5b81ce0915de None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:14.809655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10095827-2f1d-43c4-8a50-3e86e474d145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:14.810286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10095827-2f1d-43c4-8a50-3e86e474d145 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:14.810579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10095827-2f1d-43c4-8a50-3e86e474d145 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:14.810834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10095827-2f1d-43c4-8a50-3e86e474d145 None admin] PATH_INFO: `/v3/projects/18915dddeacb48718863511fb593fb67` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:14.811958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10095827-2f1d-43c4-8a50-3e86e474d145 None admin] RBAC: Authorizing `identity:get_project(project_id=18915dddeacb48718863511fb593fb67)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:14.813424 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10095827-2f1d-43c4-8a50-3e86e474d145 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:14.815373 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 220/453] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:21:14 2022] GET /identity/v3/projects/18915dddeacb48718863511fb593fb67 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:14.821311 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bfcf1-280a-4311-8f5d-50f3a30ce1da None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:14.888756 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:14.921977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bfcf1-280a-4311-8f5d-50f3a30ce1da None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:14.953751 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67730c0e-a044-43f1-afc0-618cf7675fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:14.954366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67730c0e-a044-43f1-afc0-618cf7675fac None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:14.954638 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67730c0e-a044-43f1-afc0-618cf7675fac None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:14.954903 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67730c0e-a044-43f1-afc0-618cf7675fac None admin] PATH_INFO: `/v3/groups/51403e70fbc94ce6b5815ef7a97e14ab` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:14.955972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67730c0e-a044-43f1-afc0-618cf7675fac None admin] RBAC: Authorizing `identity:get_group(group_id=51403e70fbc94ce6b5815ef7a97e14ab)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:14.957418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67730c0e-a044-43f1-afc0-618cf7675fac None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:14.958948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 234/454] 10.222.0.50 () {56 vars in 1180 bytes} [Sat Sep 17 04:21:14 2022] GET /identity/v3/groups/51403e70fbc94ce6b5815ef7a97e14ab => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:14.964900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10095827-2f1d-43c4-8a50-3e86e474d145 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:14.977465 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:15.061739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10095827-2f1d-43c4-8a50-3e86e474d145 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:15.092839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5340faa-501e-42af-acf7-2f5c7754c6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:15.093481 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340faa-501e-42af-acf7-2f5c7754c6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:15.093754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340faa-501e-42af-acf7-2f5c7754c6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:15.094018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340faa-501e-42af-acf7-2f5c7754c6f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:15.094724 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5340faa-501e-42af-acf7-2f5c7754c6f3 None admin] RBAC: Adding query filter params (group.id=51403e70fbc94ce6b5815ef7a97e14ab, role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=18915dddeacb48718863511fb593fb67) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:15.095024 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5340faa-501e-42af-acf7-2f5c7754c6f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:15.096428 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5340faa-501e-42af-acf7-2f5c7754c6f3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:15.102590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 221/455] 10.222.0.50 () {56 vars in 1376 bytes} [Sat Sep 17 04:21:14 2022] GET /identity/v3/role_assignments?group.id=51403e70fbc94ce6b5815ef7a97e14ab&scope.project.id=18915dddeacb48718863511fb593fb67&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:17.608453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa00c67-cf36-4e55-a36e-daea9ee24aa8 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:17.608963 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa00c67-cf36-4e55-a36e-daea9ee24aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:17.608963 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa00c67-cf36-4e55-a36e-daea9ee24aa8 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:17.610727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 235/456] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:17.615949 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7ae11-9169-4196-a426-06268eafa6c7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:17.616388 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7ae11-9169-4196-a426-06268eafa6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:17.616554 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7ae11-9169-4196-a426-06268eafa6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:17.638575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c9f7ae11-9169-4196-a426-06268eafa6c7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:17.639765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c9f7ae11-9169-4196-a426-06268eafa6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:17.735461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 222/457] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:17.864141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a1d7-b0f1-40b9-ad4d-6f1b27aaa2ae None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:17.864432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a1d7-b0f1-40b9-ad4d-6f1b27aaa2ae None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:17.864614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a1d7-b0f1-40b9-ad4d-6f1b27aaa2ae None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:17.866583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 236/458] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:17.871949 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e7607-99e6-4609-8375-3b87e1eec23b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:17.872234 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e7607-99e6-4609-8375-3b87e1eec23b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:17.872503 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e7607-99e6-4609-8375-3b87e1eec23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:17.882796 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:17.896152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3b9e7607-99e6-4609-8375-3b87e1eec23b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:17.897996 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3b9e7607-99e6-4609-8375-3b87e1eec23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:17.999136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 223/459] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:18.055196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52a1d7-b0f1-40b9-ad4d-6f1b27aaa2ae None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:18.071753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5142cd9-a18c-42ff-8d28-95825314744e None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:18.072041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5142cd9-a18c-42ff-8d28-95825314744e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:18.072318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5142cd9-a18c-42ff-8d28-95825314744e None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:18.073686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 224/460] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:21:18.078553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd883ac9-fccc-43a3-a514-b62c4d9527aa None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:18.078831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd883ac9-fccc-43a3-a514-b62c4d9527aa None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:18.079099 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd883ac9-fccc-43a3-a514-b62c4d9527aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:18.111521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-fd883ac9-fccc-43a3-a514-b62c4d9527aa None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:18.112706 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fd883ac9-fccc-43a3-a514-b62c4d9527aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:18.217551 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52a1d7-b0f1-40b9-ad4d-6f1b27aaa2ae None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:18.254600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751be1a3-1700-40c8-8ee7-3806d9e5c7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:18.255230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751be1a3-1700-40c8-8ee7-3806d9e5c7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:18.255508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751be1a3-1700-40c8-8ee7-3806d9e5c7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:18.255783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751be1a3-1700-40c8-8ee7-3806d9e5c7f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:18.265677 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:18.269110 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751be1a3-1700-40c8-8ee7-3806d9e5c7f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:18.270571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751be1a3-1700-40c8-8ee7-3806d9e5c7f3 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:18.284567 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 225/461] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-751be1a3-1700-40c8-8ee7-3806d9e5c7f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:18.292501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:18.293441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:18.294265 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:18.294265 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:18.294265 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:18.294265 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 237/462] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:18.299478 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd883ac9-fccc-43a3-a514-b62c4d9527aa None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:18.370803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:18.373863 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751be1a3-1700-40c8-8ee7-3806d9e5c7f3 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:18.472886 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd883ac9-fccc-43a3-a514-b62c4d9527aa None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:18.511669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751be1a3-1700-40c8-8ee7-3806d9e5c7f3 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:18.548514 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43528a4b-5f0d-42cc-aeda-ed97aaba71c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:18.549151 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43528a4b-5f0d-42cc-aeda-ed97aaba71c5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:18.549432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43528a4b-5f0d-42cc-aeda-ed97aaba71c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:18.549700 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43528a4b-5f0d-42cc-aeda-ed97aaba71c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:18.550349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43528a4b-5f0d-42cc-aeda-ed97aaba71c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:18.550650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43528a4b-5f0d-42cc-aeda-ed97aaba71c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:18.552031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43528a4b-5f0d-42cc-aeda-ed97aaba71c5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:18.575913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 226/463] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:18.576784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43528a4b-5f0d-42cc-aeda-ed97aaba71c5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:18.580578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667b5b3-e47c-414f-b6ce-6182a44eca0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:18.583925 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667b5b3-e47c-414f-b6ce-6182a44eca0c None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:18.583925 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667b5b3-e47c-414f-b6ce-6182a44eca0c None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:18.583925 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667b5b3-e47c-414f-b6ce-6182a44eca0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:18.593463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667b5b3-e47c-414f-b6ce-6182a44eca0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:18.594937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667b5b3-e47c-414f-b6ce-6182a44eca0c None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-8667b5b3-e47c-414f-b6ce-6182a44eca0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:18.609770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:18.611034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:18.611878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:18.611878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:18.611878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:18.611878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 238/464] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:18.612082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667b5b3-e47c-414f-b6ce-6182a44eca0c None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:18.654504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:18.691629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43528a4b-5f0d-42cc-aeda-ed97aaba71c5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:18.713816 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667b5b3-e47c-414f-b6ce-6182a44eca0c None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:18.717106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:18.731269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babafae-92f9-4f47-865b-34c83dd55d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:18.731841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babafae-92f9-4f47-865b-34c83dd55d08 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:18.732181 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babafae-92f9-4f47-865b-34c83dd55d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:18.732457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babafae-92f9-4f47-865b-34c83dd55d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:18.745820 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babafae-92f9-4f47-865b-34c83dd55d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:18.747322 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babafae-92f9-4f47-865b-34c83dd55d08 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:18.753644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188c50b-cf66-455b-905a-9682eea025c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:18.754259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188c50b-cf66-455b-905a-9682eea025c5 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:18.754534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188c50b-cf66-455b-905a-9682eea025c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:18.754805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188c50b-cf66-455b-905a-9682eea025c5 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:18.755464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188c50b-cf66-455b-905a-9682eea025c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:18.757536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188c50b-cf66-455b-905a-9682eea025c5 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-6babafae-92f9-4f47-865b-34c83dd55d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:18.763990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:18.766062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:18.768146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:18.768146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:18.768146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:18.768146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 227/465] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:18.768146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babafae-92f9-4f47-865b-34c83dd55d08 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:18.862124 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 239/466] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:21:18 2022] POST /identity/v3/users => generated 246 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:21:18.870064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188c50b-cf66-455b-905a-9682eea025c5 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:18.883777 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babafae-92f9-4f47-865b-34c83dd55d08 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:18.936475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b926dd-abf0-4f0d-b2a1-9942f4a247df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:18.938613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b926dd-abf0-4f0d-b2a1-9942f4a247df None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:18.938888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b926dd-abf0-4f0d-b2a1-9942f4a247df None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:18.939381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b926dd-abf0-4f0d-b2a1-9942f4a247df None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:18.940053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b926dd-abf0-4f0d-b2a1-9942f4a247df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:18.940354 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b926dd-abf0-4f0d-b2a1-9942f4a247df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:18.941874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b926dd-abf0-4f0d-b2a1-9942f4a247df None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:18.956233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 228/467] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:18.957762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5933a77-a1df-41dd-aba5-0bf3bec7a95c None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:18.958040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5933a77-a1df-41dd-aba5-0bf3bec7a95c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:18.958308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5933a77-a1df-41dd-aba5-0bf3bec7a95c None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:18.960397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 229/468] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:18.965631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5933a77-a1df-41dd-aba5-0bf3bec7a95c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:19.008138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:19.018655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:19.025718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188c50b-cf66-455b-905a-9682eea025c5 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:19.077161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a77c1-8645-45bd-855a-51ecb877d15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:19.078200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a77c1-8645-45bd-855a-51ecb877d15a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:19.078200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a77c1-8645-45bd-855a-51ecb877d15a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:19.078842 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a77c1-8645-45bd-855a-51ecb877d15a None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:19.080666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a77c1-8645-45bd-855a-51ecb877d15a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:19.080666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a77c1-8645-45bd-855a-51ecb877d15a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:19.081667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a77c1-8645-45bd-855a-51ecb877d15a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:19.096841 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 240/469] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:19.098273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef7d3c-f357-4362-b6fa-8c231826ad2b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:19.098557 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef7d3c-f357-4362-b6fa-8c231826ad2b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:19.098831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef7d3c-f357-4362-b6fa-8c231826ad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:19.106964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5933a77-a1df-41dd-aba5-0bf3bec7a95c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:19.123007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-62ef7d3c-f357-4362-b6fa-8c231826ad2b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:19.124640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-62ef7d3c-f357-4362-b6fa-8c231826ad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:19.148014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3a388-0a1b-4492-9e80-4fcef358d6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:19.148876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3a388-0a1b-4492-9e80-4fcef358d6a1 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:19.149410 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3a388-0a1b-4492-9e80-4fcef358d6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:19.149827 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3a388-0a1b-4492-9e80-4fcef358d6a1 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:19.150805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3a388-0a1b-4492-9e80-4fcef358d6a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:19.152449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3a388-0a1b-4492-9e80-4fcef358d6a1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:19.201045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 241/470] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:19.201879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef7d3c-f357-4362-b6fa-8c231826ad2b None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:19.244338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 230/471] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:21:18 2022] POST /identity/v3/users => generated 248 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:21:19.309267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:19.326270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef7d3c-f357-4362-b6fa-8c231826ad2b None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:19.363206 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c861ffb-87c9-43dc-b900-d2989032b5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:19.363842 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861ffb-87c9-43dc-b900-d2989032b5d0 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:19.364187 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861ffb-87c9-43dc-b900-d2989032b5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:19.364461 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861ffb-87c9-43dc-b900-d2989032b5d0 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:19.365156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c861ffb-87c9-43dc-b900-d2989032b5d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:19.367632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c861ffb-87c9-43dc-b900-d2989032b5d0 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:19.482996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 242/472] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:21:19 2022] POST /identity/v3/users => generated 248 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:21:19.496718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3a388-0a1b-4492-9e80-4fcef358d6a1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:19.551512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288c6a7-d786-4096-9ba7-467c5c81b073 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:19.551824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288c6a7-d786-4096-9ba7-467c5c81b073 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:19.552072 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288c6a7-d786-4096-9ba7-467c5c81b073 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:19.554963 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 243/473] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:19.561340 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb2d47-bada-40e9-ba71-0caa54b06f3e None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:19.561619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb2d47-bada-40e9-ba71-0caa54b06f3e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:19.561819 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb2d47-bada-40e9-ba71-0caa54b06f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:19.596026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2cfb2d47-bada-40e9-ba71-0caa54b06f3e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:19.597691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2cfb2d47-bada-40e9-ba71-0caa54b06f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:19.614662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:19.625698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3a388-0a1b-4492-9e80-4fcef358d6a1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:19.670537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a05f10-d847-4410-8450-bbbbfbe69ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:19.671329 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a05f10-d847-4410-8450-bbbbfbe69ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:19.671730 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a05f10-d847-4410-8450-bbbbfbe69ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:19.672100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a05f10-d847-4410-8450-bbbbfbe69ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:19.687325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a05f10-d847-4410-8450-bbbbfbe69ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:19.689215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a05f10-d847-4410-8450-bbbbfbe69ed0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:19.702266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 244/474] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-d7a05f10-d847-4410-8450-bbbbfbe69ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:19.706770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:19.708081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:19.709714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:19.709714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:19.709714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:19.711440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 231/475] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:19.716521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb2d47-bada-40e9-ba71-0caa54b06f3e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:19.799662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:19.831153 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb2d47-bada-40e9-ba71-0caa54b06f3e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:19.872026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9daa0-f657-47a4-b050-32d66b472c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:19.873022 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9daa0-f657-47a4-b050-32d66b472c79 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:19.873516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9daa0-f657-47a4-b050-32d66b472c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:19.874002 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9daa0-f657-47a4-b050-32d66b472c79 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:19.874849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9daa0-f657-47a4-b050-32d66b472c79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:19.875347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9daa0-f657-47a4-b050-32d66b472c79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:19.876918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9daa0-f657-47a4-b050-32d66b472c79 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:19.889508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 245/476] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:19.894688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a05f10-d847-4410-8450-bbbbfbe69ed0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:20.018669 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a05f10-d847-4410-8450-bbbbfbe69ed0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:20.054663 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12161e-f8e6-4a53-b8a2-ef1f111321e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:20.055267 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12161e-f8e6-4a53-b8a2-ef1f111321e3 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:20.055538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12161e-f8e6-4a53-b8a2-ef1f111321e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:20.055803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12161e-f8e6-4a53-b8a2-ef1f111321e3 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:20.056444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12161e-f8e6-4a53-b8a2-ef1f111321e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:20.058042 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12161e-f8e6-4a53-b8a2-ef1f111321e3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:20.058353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9daa0-f657-47a4-b050-32d66b472c79 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:20.169971 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:20.175457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 232/477] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:21:19 2022] POST /identity/v3/users => generated 249 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:21:20.181697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9daa0-f657-47a4-b050-32d66b472c79 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:20.222410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cdb39-5e60-4d85-a684-5f3e281868ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:20.223094 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cdb39-5e60-4d85-a684-5f3e281868ed None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:20.223377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cdb39-5e60-4d85-a684-5f3e281868ed None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:20.223704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cdb39-5e60-4d85-a684-5f3e281868ed None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:20.224439 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cdb39-5e60-4d85-a684-5f3e281868ed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:20.225904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cdb39-5e60-4d85-a684-5f3e281868ed None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:20.230982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:20.261825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.sql.core [None req-a05cdb39-5e60-4d85-a684-5f3e281868ed None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 17 04:21:20.261825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 17 04:21:20.261825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [parameters: {'id': '3a656155ce9d41b091709001626d349a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 17 04:21:20.261825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81614) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-a05cdb39-5e60-4d85-a684-5f3e281868ed None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application conn.query(q) Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application result.read() Sep 17 04:21:20.282291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return ref.to_dict() Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 04:21:20.283286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application next(self.gen) Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application yield resource Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application next(self.gen) Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self.session.rollback() Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self.force_reraise() Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise self.value Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application session.commit() Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 17 04:21:20.284171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._prepare_impl() Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self.session.flush() Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._flush(objects) Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application compat.raise_( Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application flush_context.execute() Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rec.execute(self) Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 04:21:20.285050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 04:21:20.285914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application conn.query(q) Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application result.read() Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 04:21:20.286784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [parameters: {'id': '3a656155ce9d41b091709001626d349a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:20.288147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 17 04:21:20.288918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:20.291837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 246/478] 10.222.0.50 () {60 vars in 1131 bytes} [Sat Sep 17 04:21:20 2022] POST /identity/v3/roles => generated 144 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:20.291957 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12161e-f8e6-4a53-b8a2-ef1f111321e3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:20.432467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12161e-f8e6-4a53-b8a2-ef1f111321e3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:20.481358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0e953-bde8-4669-92ca-34f1fe1db44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:20.482033 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e953-bde8-4669-92ca-34f1fe1db44b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:20.482311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e953-bde8-4669-92ca-34f1fe1db44b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:20.482579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e953-bde8-4669-92ca-34f1fe1db44b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:20.493425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0e953-bde8-4669-92ca-34f1fe1db44b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-5fe0e953-bde8-4669-92ca-34f1fe1db44b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:20.498741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:20.500753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:20.502719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:20.502719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:20.502719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:20.502719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:20.502719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:20.502719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:20.502719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:20.502719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:20.502719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:20.502719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:20.502719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 04:21:20.502719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:20.502719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 233/479] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:21:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:20.509024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cdb39-5e60-4d85-a684-5f3e281868ed None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:20.617476 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cdb39-5e60-4d85-a684-5f3e281868ed None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:20.652635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ce6b0-82cd-4c88-b8a9-e866e7247d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:20.653274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ce6b0-82cd-4c88-b8a9-e866e7247d94 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:20.653550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ce6b0-82cd-4c88-b8a9-e866e7247d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:20.653820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ce6b0-82cd-4c88-b8a9-e866e7247d94 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:20.654484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ce6b0-82cd-4c88-b8a9-e866e7247d94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:20.654790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ce6b0-82cd-4c88-b8a9-e866e7247d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:20.656232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ce6b0-82cd-4c88-b8a9-e866e7247d94 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:20.665521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 247/480] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:21.384735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991804e-60ed-4aaf-8bca-5675ed4c4452 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:21.385442 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991804e-60ed-4aaf-8bca-5675ed4c4452 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:21.385442 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991804e-60ed-4aaf-8bca-5675ed4c4452 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:21.386888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 234/481] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:21.410904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba958757-9b7c-4e9b-b34c-3c30151bb4b1 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:21.411612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba958757-9b7c-4e9b-b34c-3c30151bb4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:21.411612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba958757-9b7c-4e9b-b34c-3c30151bb4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:21.440325 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ba958757-9b7c-4e9b-b34c-3c30151bb4b1 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:21.440325 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ba958757-9b7c-4e9b-b34c-3c30151bb4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:21.507863 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:21.526981 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 248/482] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:21.951959 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991804e-60ed-4aaf-8bca-5675ed4c4452 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:22.036452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:22.075577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceefb7e-551c-42b7-883a-8045602b1149 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:22.075901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceefb7e-551c-42b7-883a-8045602b1149 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:22.076122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceefb7e-551c-42b7-883a-8045602b1149 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:22.077762 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 249/483] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:21:22.082677 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84695976-f3a1-4850-9378-d4f07efc0e51 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:22.082971 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84695976-f3a1-4850-9378-d4f07efc0e51 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:22.083231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84695976-f3a1-4850-9378-d4f07efc0e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:22.096711 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991804e-60ed-4aaf-8bca-5675ed4c4452 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:22.108925 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-84695976-f3a1-4850-9378-d4f07efc0e51 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:22.110137 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-84695976-f3a1-4850-9378-d4f07efc0e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:22.161170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dceda-5e84-4749-b302-4becea2b092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:22.161853 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dceda-5e84-4749-b302-4becea2b092e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:22.162166 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dceda-5e84-4749-b302-4becea2b092e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:22.162500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dceda-5e84-4749-b302-4becea2b092e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:22.185839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dceda-5e84-4749-b302-4becea2b092e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-632dceda-5e84-4749-b302-4becea2b092e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:22.190606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:22.191463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:22.192238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:22.192238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:22.192238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:22.192238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:22.192238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:22.192238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:22.192238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:22.192238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:22.192238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:22.192238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:22.192238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:22.192238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:22.192238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 235/484] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:22.201501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dceda-5e84-4749-b302-4becea2b092e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:22.251677 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 250/485] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:22.316718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dceda-5e84-4749-b302-4becea2b092e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:22.338132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:22.356634 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f101d8-deb7-4f4f-b15a-78e7a63ebc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:22.357284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f101d8-deb7-4f4f-b15a-78e7a63ebc29 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:22.357557 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f101d8-deb7-4f4f-b15a-78e7a63ebc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:22.357824 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f101d8-deb7-4f4f-b15a-78e7a63ebc29 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:22.358494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f101d8-deb7-4f4f-b15a-78e7a63ebc29 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:22.358793 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f101d8-deb7-4f4f-b15a-78e7a63ebc29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:22.360190 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f101d8-deb7-4f4f-b15a-78e7a63ebc29 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:22.373640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 236/486] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:22.379771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84695976-f3a1-4850-9378-d4f07efc0e51 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:22.499027 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6abfb-54f5-4e5a-99a2-2a6878e2005a None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:22.499534 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6abfb-54f5-4e5a-99a2-2a6878e2005a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:22.499534 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6abfb-54f5-4e5a-99a2-2a6878e2005a None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:22.502252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 237/487] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:21:22.506913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb915-ff5d-48c4-94a9-9caf5eaa2875 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:22.507441 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb915-ff5d-48c4-94a9-9caf5eaa2875 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:22.507974 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb915-ff5d-48c4-94a9-9caf5eaa2875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:22.527065 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-62ddb915-ff5d-48c4-94a9-9caf5eaa2875 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:22.528543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-62ddb915-ff5d-48c4-94a9-9caf5eaa2875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:22.548548 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84695976-f3a1-4850-9378-d4f07efc0e51 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:22.576425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:22.610505 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6e1af-e0b8-4de1-9d90-5b361e909ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:22.611498 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6e1af-e0b8-4de1-9d90-5b361e909ace None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:22.611965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6e1af-e0b8-4de1-9d90-5b361e909ace None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:22.612439 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6e1af-e0b8-4de1-9d90-5b361e909ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:22.630497 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6e1af-e0b8-4de1-9d90-5b361e909ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:22.633554 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6e1af-e0b8-4de1-9d90-5b361e909ace None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:22.649220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 238/488] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:21:22.650256 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddb915-ff5d-48c4-94a9-9caf5eaa2875 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-dfa6e1af-e0b8-4de1-9d90-5b361e909ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:22.655300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:22.656332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:22.657179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:22.657179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:22.657179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:22.660893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 251/489] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:22.663545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6e1af-e0b8-4de1-9d90-5b361e909ace None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:22.805892 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6e1af-e0b8-4de1-9d90-5b361e909ace None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:22.808403 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddb915-ff5d-48c4-94a9-9caf5eaa2875 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:22.837840 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:22.841501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893783f-2fe3-4e1a-a3e4-858230d39659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:22.842244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893783f-2fe3-4e1a-a3e4-858230d39659 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:22.842684 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893783f-2fe3-4e1a-a3e4-858230d39659 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:22.842947 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893783f-2fe3-4e1a-a3e4-858230d39659 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:22.843598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893783f-2fe3-4e1a-a3e4-858230d39659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:22.843891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893783f-2fe3-4e1a-a3e4-858230d39659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:22.845313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893783f-2fe3-4e1a-a3e4-858230d39659 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:22.858579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 252/490] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:22.863677 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893783f-2fe3-4e1a-a3e4-858230d39659 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:22.883906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaa097-67f7-4f0d-a231-a4717156ef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:22.884535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaa097-67f7-4f0d-a231-a4717156ef16 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:22.884810 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaa097-67f7-4f0d-a231-a4717156ef16 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:22.885121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaa097-67f7-4f0d-a231-a4717156ef16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:22.905247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaa097-67f7-4f0d-a231-a4717156ef16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-20eaa097-67f7-4f0d-a231-a4717156ef16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:22.911218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:22.912653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:22.913467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:22.913467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:22.913467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:22.913467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:22.913467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:22.913467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:22.913467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:22.913467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:22.913467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:22.913467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:22.913467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:22.913467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:22.914072 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 239/491] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:22.920547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaa097-67f7-4f0d-a231-a4717156ef16 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:22.925341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:23.037314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893783f-2fe3-4e1a-a3e4-858230d39659 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:23.055194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaa097-67f7-4f0d-a231-a4717156ef16 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:23.078272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fafe9-3df1-46b8-a6b1-231e438d72c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:23.078928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fafe9-3df1-46b8-a6b1-231e438d72c6 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:23.079268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fafe9-3df1-46b8-a6b1-231e438d72c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:23.079657 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fafe9-3df1-46b8-a6b1-231e438d72c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:23.087275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fafe9-3df1-46b8-a6b1-231e438d72c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:23.088816 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fafe9-3df1-46b8-a6b1-231e438d72c6 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:23.100516 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32340f-2223-4436-a023-6899417a617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:23.101220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32340f-2223-4436-a023-6899417a617c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:23.101493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32340f-2223-4436-a023-6899417a617c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:23.101814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32340f-2223-4436-a023-6899417a617c None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:23.102485 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32340f-2223-4436-a023-6899417a617c None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:23.102783 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32340f-2223-4436-a023-6899417a617c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-071fafe9-3df1-46b8-a6b1-231e438d72c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:23.103214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:23.104967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:23.107105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:23.107105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:23.107105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:23.107105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:23.107105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:23.107105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:23.107105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:23.107105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:23.107105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:21:23.107105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:23.108331 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32340f-2223-4436-a023-6899417a617c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:23.108472 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 253/492] 10.222.0.50 () {56 vars in 1093 bytes} [Sat Sep 17 04:21:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:23.108472 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fafe9-3df1-46b8-a6b1-231e438d72c6 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:23.125363 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 240/493] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:23.126288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32340f-2223-4436-a023-6899417a617c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:23.164347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:23.218967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:23.229157 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fafe9-3df1-46b8-a6b1-231e438d72c6 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:23.237065 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32340f-2223-4436-a023-6899417a617c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:23.265502 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d10903-9e58-4a93-8fad-bf77fb7fb735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:23.266123 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d10903-9e58-4a93-8fad-bf77fb7fb735 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:23.266398 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d10903-9e58-4a93-8fad-bf77fb7fb735 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:23.266663 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d10903-9e58-4a93-8fad-bf77fb7fb735 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:23.272237 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b8dda-9067-45ad-88f6-e960cb002caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:23.272845 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b8dda-9067-45ad-88f6-e960cb002caf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:23.273152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b8dda-9067-45ad-88f6-e960cb002caf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:23.273425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b8dda-9067-45ad-88f6-e960cb002caf None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:23.274157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b8dda-9067-45ad-88f6-e960cb002caf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:23.274462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b8dda-9067-45ad-88f6-e960cb002caf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:23.275887 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b8dda-9067-45ad-88f6-e960cb002caf None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:23.277723 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d10903-9e58-4a93-8fad-bf77fb7fb735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-67d10903-9e58-4a93-8fad-bf77fb7fb735 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:23.283660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:23.284515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:23.285651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:23.285651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:23.285651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:23.285651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:23.285651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:23.285651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:23.285651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:23.285651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:23.285651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:23.285651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:23.285651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:23.285651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:23.289312 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 254/494] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:23.290671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d10903-9e58-4a93-8fad-bf77fb7fb735 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:23.319468 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 241/495] 10.222.0.50 () {56 vars in 1133 bytes} [Sat Sep 17 04:21:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:23.320744 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020355-7103-4381-9847-bc3ca8dfe7e5 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:23.321237 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020355-7103-4381-9847-bc3ca8dfe7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:23.321360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020355-7103-4381-9847-bc3ca8dfe7e5 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:23.322709 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 242/496] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:23.326040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4020355-7103-4381-9847-bc3ca8dfe7e5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:23.408879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d10903-9e58-4a93-8fad-bf77fb7fb735 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:23.431685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:23.442402 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4020355-7103-4381-9847-bc3ca8dfe7e5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:23.449702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc62c6-81b0-4598-a832-ffd50c9fc34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:23.449702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc62c6-81b0-4598-a832-ffd50c9fc34c None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:23.449702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc62c6-81b0-4598-a832-ffd50c9fc34c None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:23.449702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc62c6-81b0-4598-a832-ffd50c9fc34c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:23.456156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc62c6-81b0-4598-a832-ffd50c9fc34c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:23.457659 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc62c6-81b0-4598-a832-ffd50c9fc34c None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-17cc62c6-81b0-4598-a832-ffd50c9fc34c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:23.473099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:23.474136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:23.476404 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:23.476404 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:23.476404 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:23.478125 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 255/497] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:23.479101 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc62c6-81b0-4598-a832-ffd50c9fc34c None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:23.481818 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:23.493410 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3aabc4-60a3-4218-9e8e-6049a186aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:23.493986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3aabc4-60a3-4218-9e8e-6049a186aecb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:23.494232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3aabc4-60a3-4218-9e8e-6049a186aecb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:23.494496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3aabc4-60a3-4218-9e8e-6049a186aecb None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:23.495156 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3aabc4-60a3-4218-9e8e-6049a186aecb None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:23.495448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3aabc4-60a3-4218-9e8e-6049a186aecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:23.496841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3aabc4-60a3-4218-9e8e-6049a186aecb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:23.505619 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 243/498] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:23.506827 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3d8e2-85ec-44ab-a8a9-785e792abb5d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:23.507108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3d8e2-85ec-44ab-a8a9-785e792abb5d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:23.507376 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3d8e2-85ec-44ab-a8a9-785e792abb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:23.526524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-cfe3d8e2-85ec-44ab-a8a9-785e792abb5d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:23.527728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cfe3d8e2-85ec-44ab-a8a9-785e792abb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:23.580150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc62c6-81b0-4598-a832-ffd50c9fc34c None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:23.593504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 244/499] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:23.594331 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3d8e2-85ec-44ab-a8a9-785e792abb5d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:23.616542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47a7f6-d1b0-4231-b5d6-e5a66d52c8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:23.617184 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47a7f6-d1b0-4231-b5d6-e5a66d52c8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:23.617495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47a7f6-d1b0-4231-b5d6-e5a66d52c8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:23.617761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47a7f6-d1b0-4231-b5d6-e5a66d52c8d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:23.684195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:23.690419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47a7f6-d1b0-4231-b5d6-e5a66d52c8d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:23.691891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47a7f6-d1b0-4231-b5d6-e5a66d52c8d1 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:23.694042 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:23.700368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3d8e2-85ec-44ab-a8a9-785e792abb5d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:23.737670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d849e8-fcc1-46eb-bb97-979d7b04abf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:23.738277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d849e8-fcc1-46eb-bb97-979d7b04abf5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:23.738546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d849e8-fcc1-46eb-bb97-979d7b04abf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:23.738864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d849e8-fcc1-46eb-bb97-979d7b04abf5 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:23.739501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d849e8-fcc1-46eb-bb97-979d7b04abf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:23.739893 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d849e8-fcc1-46eb-bb97-979d7b04abf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:23.741452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d849e8-fcc1-46eb-bb97-979d7b04abf5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:23.757370 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 245/500] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:23.757370 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767d24-9112-45c6-8618-eab2a011e83b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:23.757370 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767d24-9112-45c6-8618-eab2a011e83b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:23.757370 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767d24-9112-45c6-8618-eab2a011e83b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:23.757370 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 246/501] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:23.757370 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767d24-9112-45c6-8618-eab2a011e83b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:23.802488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 256/502] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:23.803334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47a7f6-d1b0-4231-b5d6-e5a66d52c8d1 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:23.868660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767d24-9112-45c6-8618-eab2a011e83b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:23.902482 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5167c7-d270-416b-a8ae-01e30f00efea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:23.903105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5167c7-d270-416b-a8ae-01e30f00efea None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:23.903284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47a7f6-d1b0-4231-b5d6-e5a66d52c8d1 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:23.903377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5167c7-d270-416b-a8ae-01e30f00efea None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:23.903637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5167c7-d270-416b-a8ae-01e30f00efea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:23.904778 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:23.914362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5167c7-d270-416b-a8ae-01e30f00efea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:23.915810 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5167c7-d270-416b-a8ae-01e30f00efea None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:23.918298 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ce5167c7-d270-416b-a8ae-01e30f00efea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:23.930262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:23.931167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:23.931989 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:23.931989 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:23.931989 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:23.931989 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 247/503] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:23.932616 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03247c6-5956-4b8d-869b-2dcf216f6da5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:23.932891 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03247c6-5956-4b8d-869b-2dcf216f6da5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:23.933182 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03247c6-5956-4b8d-869b-2dcf216f6da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:23.942402 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da69d84-1e84-4c01-9f67-2a18352b8ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:23.943497 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69d84-1e84-4c01-9f67-2a18352b8ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:23.943924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69d84-1e84-4c01-9f67-2a18352b8ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:23.944262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69d84-1e84-4c01-9f67-2a18352b8ec0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:23.951569 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da69d84-1e84-4c01-9f67-2a18352b8ec0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:23.952144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c03247c6-5956-4b8d-869b-2dcf216f6da5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:23.953032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da69d84-1e84-4c01-9f67-2a18352b8ec0 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:23.953354 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c03247c6-5956-4b8d-869b-2dcf216f6da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-3da69d84-1e84-4c01-9f67-2a18352b8ec0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:23.965537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:23.966619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:23.967674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:23.967674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:23.967674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:23.967674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:23.967674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:23.967674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:23.967674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:23.967674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:23.967674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 04:21:23.967674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:23.967674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 257/504] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:23.967674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da69d84-1e84-4c01-9f67-2a18352b8ec0 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:24.021140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 248/505] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:24.023108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03247c6-5956-4b8d-869b-2dcf216f6da5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:24.072805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da69d84-1e84-4c01-9f67-2a18352b8ec0 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:24.107606 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ca515-ae83-42e2-a3cf-cc3f324c275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:24.108227 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ca515-ae83-42e2-a3cf-cc3f324c275d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:24.108504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ca515-ae83-42e2-a3cf-cc3f324c275d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:24.108772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ca515-ae83-42e2-a3cf-cc3f324c275d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:24.120362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ca515-ae83-42e2-a3cf-cc3f324c275d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:24.121413 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03247c6-5956-4b8d-869b-2dcf216f6da5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:24.121851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ca515-ae83-42e2-a3cf-cc3f324c275d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-660ca515-ae83-42e2-a3cf-cc3f324c275d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:24.137510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:24.138390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:24.139222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:24.139222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:24.139222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:24.139222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 258/506] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:24.139869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ca515-ae83-42e2-a3cf-cc3f324c275d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:24.156918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:24.160033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:24.170175 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c706e7-64fc-40d3-ab9e-afd3bc668fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:24.174258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c706e7-64fc-40d3-ab9e-afd3bc668fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:24.174258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c706e7-64fc-40d3-ab9e-afd3bc668fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:24.174258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c706e7-64fc-40d3-ab9e-afd3bc668fb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:24.182012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c706e7-64fc-40d3-ab9e-afd3bc668fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-29c706e7-64fc-40d3-ab9e-afd3bc668fb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:24.186879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:24.187812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:24.188593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:24.188593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:24.188593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:24.188593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:24.188593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:24.188593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:24.188593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:24.188593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:24.188593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:24.188593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:24.188593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:24.188593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:24.188593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 249/507] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:24.189268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c706e7-64fc-40d3-ab9e-afd3bc668fb5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:24.254926 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ca515-ae83-42e2-a3cf-cc3f324c275d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:24.290709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c6084-ae39-478d-9772-d315f8422194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:24.291315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c6084-ae39-478d-9772-d315f8422194 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:24.291622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c6084-ae39-478d-9772-d315f8422194 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:24.292196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c6084-ae39-478d-9772-d315f8422194 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:24.292843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c6084-ae39-478d-9772-d315f8422194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:24.293481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c6084-ae39-478d-9772-d315f8422194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:24.294874 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c6084-ae39-478d-9772-d315f8422194 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:24.304372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c706e7-64fc-40d3-ab9e-afd3bc668fb5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:24.306841 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 259/508] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:24.307638 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c6084-ae39-478d-9772-d315f8422194 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:24.339389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fc4aa-4057-44af-af40-4d4f7dec4bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:24.339981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc4aa-4057-44af-af40-4d4f7dec4bcb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:24.340255 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc4aa-4057-44af-af40-4d4f7dec4bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:24.340524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc4aa-4057-44af-af40-4d4f7dec4bcb None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:24.341282 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fc4aa-4057-44af-af40-4d4f7dec4bcb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:24.341580 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fc4aa-4057-44af-af40-4d4f7dec4bcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:24.343022 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fc4aa-4057-44af-af40-4d4f7dec4bcb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:24.360293 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 250/509] 10.222.0.50 () {56 vars in 1137 bytes} [Sat Sep 17 04:21:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:24.361118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fc4aa-4057-44af-af40-4d4f7dec4bcb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:24.439836 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:24.443791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:24.464070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c6084-ae39-478d-9772-d315f8422194 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:24.496588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fc4aa-4057-44af-af40-4d4f7dec4bcb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:24.498785 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca34c5-431c-47fb-b715-5a13a64a2ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:24.499387 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca34c5-431c-47fb-b715-5a13a64a2ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:24.499664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca34c5-431c-47fb-b715-5a13a64a2ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:24.499938 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca34c5-431c-47fb-b715-5a13a64a2ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:24.500573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca34c5-431c-47fb-b715-5a13a64a2ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:24.500875 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca34c5-431c-47fb-b715-5a13a64a2ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:24.502281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca34c5-431c-47fb-b715-5a13a64a2ac6 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:24.514261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 260/510] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:24.516063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca34c5-431c-47fb-b715-5a13a64a2ac6 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:24.533237 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bf4c8-4034-4c59-a39c-f18968007038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:24.533844 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bf4c8-4034-4c59-a39c-f18968007038 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:24.534118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bf4c8-4034-4c59-a39c-f18968007038 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:24.534389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bf4c8-4034-4c59-a39c-f18968007038 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:24.535047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bf4c8-4034-4c59-a39c-f18968007038 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:24.535347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bf4c8-4034-4c59-a39c-f18968007038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:24.536769 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bf4c8-4034-4c59-a39c-f18968007038 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:24.545336 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 251/511] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:24.546112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bf4c8-4034-4c59-a39c-f18968007038 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:24.614794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca34c5-431c-47fb-b715-5a13a64a2ac6 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:24.646845 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bf4c8-4034-4c59-a39c-f18968007038 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:24.648720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662512f-ef89-45e2-a817-fa7988a57831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:24.649383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662512f-ef89-45e2-a817-fa7988a57831 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:24.649661 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662512f-ef89-45e2-a817-fa7988a57831 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:24.649933 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662512f-ef89-45e2-a817-fa7988a57831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:24.651796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:24.653663 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:24.661280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662512f-ef89-45e2-a817-fa7988a57831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:24.662861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662512f-ef89-45e2-a817-fa7988a57831 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-7662512f-ef89-45e2-a817-fa7988a57831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:24.677598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:24.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:24.679489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:24.679489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:24.679489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:24.679489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 261/512] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:24.679699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662512f-ef89-45e2-a817-fa7988a57831 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:24.681973 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1461eb-a785-4578-9421-a3fe91ad2c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:24.682606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1461eb-a785-4578-9421-a3fe91ad2c35 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:24.682883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1461eb-a785-4578-9421-a3fe91ad2c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:24.683150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1461eb-a785-4578-9421-a3fe91ad2c35 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:24.690999 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1461eb-a785-4578-9421-a3fe91ad2c35 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:24.692478 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1461eb-a785-4578-9421-a3fe91ad2c35 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8c1461eb-a785-4578-9421-a3fe91ad2c35 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:24.705612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:24.706549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:24.707452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:24.707452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:24.707452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:24.707452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:24.707452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:24.707452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:24.707452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:24.707452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:24.707452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 04:21:24.707452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:24.707452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 252/513] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:24.707991 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1461eb-a785-4578-9421-a3fe91ad2c35 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:24.788884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662512f-ef89-45e2-a817-fa7988a57831 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:24.805870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1461eb-a785-4578-9421-a3fe91ad2c35 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:24.822237 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d375941-172d-420f-8bc7-5c0b384da088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:24.822837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d375941-172d-420f-8bc7-5c0b384da088 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:24.823115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d375941-172d-420f-8bc7-5c0b384da088 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:24.823383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d375941-172d-420f-8bc7-5c0b384da088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:24.839527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d4298-0423-4ecc-aae0-917ae738f5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:24.840145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d4298-0423-4ecc-aae0-917ae738f5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:24.840416 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d4298-0423-4ecc-aae0-917ae738f5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:24.840681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d4298-0423-4ecc-aae0-917ae738f5e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:24.847406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d4298-0423-4ecc-aae0-917ae738f5e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:24.848648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d4298-0423-4ecc-aae0-917ae738f5e5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ab8d4298-0423-4ecc-aae0-917ae738f5e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:24.860646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:24.861628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:24.862645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:24.862645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:24.862645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:24.862645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:24.862645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:24.862645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:24.862645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:24.862645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:24.862645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 253/514] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:24.862645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d4298-0423-4ecc-aae0-917ae738f5e5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:24.878992 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:24.892559 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d375941-172d-420f-8bc7-5c0b384da088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:24.894058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d375941-172d-420f-8bc7-5c0b384da088 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:24.894166 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:24.964960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d4298-0423-4ecc-aae0-917ae738f5e5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:24.992003 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 262/515] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:24.992837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d375941-172d-420f-8bc7-5c0b384da088 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:24.998938 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029f524-3d73-4595-ba5f-044822cab697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:24.999588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029f524-3d73-4595-ba5f-044822cab697 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:24.999859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029f524-3d73-4595-ba5f-044822cab697 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:25.000127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029f524-3d73-4595-ba5f-044822cab697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:25.011691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029f524-3d73-4595-ba5f-044822cab697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:25.013177 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029f524-3d73-4595-ba5f-044822cab697 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7029f524-3d73-4595-ba5f-044822cab697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:25.027703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:25.028771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:25.029640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:25.029640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:25.029640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:25.029640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 254/516] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:25.029640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029f524-3d73-4595-ba5f-044822cab697 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:25.078966 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:25.093439 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d375941-172d-420f-8bc7-5c0b384da088 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:25.110406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:25.128047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a4246-82c1-46e9-a7c1-c02538167ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:25.128653 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a4246-82c1-46e9-a7c1-c02538167ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:25.128932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a4246-82c1-46e9-a7c1-c02538167ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:25.129238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a4246-82c1-46e9-a7c1-c02538167ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:25.129877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a4246-82c1-46e9-a7c1-c02538167ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:25.130179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a4246-82c1-46e9-a7c1-c02538167ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:25.131885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029f524-3d73-4595-ba5f-044822cab697 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:25.132686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a4246-82c1-46e9-a7c1-c02538167ae9 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:25.143834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 263/517] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:25.144706 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a4246-82c1-46e9-a7c1-c02538167ae9 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:25.172524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32cc43-5668-4776-a414-3b4dd4b63c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:25.173147 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32cc43-5668-4776-a414-3b4dd4b63c95 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:25.173422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32cc43-5668-4776-a414-3b4dd4b63c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:25.173687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32cc43-5668-4776-a414-3b4dd4b63c95 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:25.174412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32cc43-5668-4776-a414-3b4dd4b63c95 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:25.174710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32cc43-5668-4776-a414-3b4dd4b63c95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:25.176123 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32cc43-5668-4776-a414-3b4dd4b63c95 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:25.194468 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 255/518] 10.222.0.50 () {56 vars in 1137 bytes} [Sat Sep 17 04:21:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:25.195266 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32cc43-5668-4776-a414-3b4dd4b63c95 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:25.242908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a4246-82c1-46e9-a7c1-c02538167ae9 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:25.276285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f63d19-761c-49b5-b3b3-0d2b19db4c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:25.276888 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f63d19-761c-49b5-b3b3-0d2b19db4c93 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:25.277194 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f63d19-761c-49b5-b3b3-0d2b19db4c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:25.277466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f63d19-761c-49b5-b3b3-0d2b19db4c93 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:25.278154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f63d19-761c-49b5-b3b3-0d2b19db4c93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:25.278459 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f63d19-761c-49b5-b3b3-0d2b19db4c93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:25.279886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f63d19-761c-49b5-b3b3-0d2b19db4c93 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:25.291502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32cc43-5668-4776-a414-3b4dd4b63c95 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:25.297352 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 264/519] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:25.298155 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f63d19-761c-49b5-b3b3-0d2b19db4c93 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:25.307094 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:25.325658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528abce8-6188-4247-aae9-2eac93a37b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:25.326280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528abce8-6188-4247-aae9-2eac93a37b62 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:25.326551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528abce8-6188-4247-aae9-2eac93a37b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:25.326821 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528abce8-6188-4247-aae9-2eac93a37b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:25.329833 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:25.337152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528abce8-6188-4247-aae9-2eac93a37b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:25.338742 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528abce8-6188-4247-aae9-2eac93a37b62 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-528abce8-6188-4247-aae9-2eac93a37b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:25.354079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:25.354968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:25.355799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:25.355799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:25.355799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:25.355799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 256/520] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:25.356209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528abce8-6188-4247-aae9-2eac93a37b62 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:25.404429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f63d19-761c-49b5-b3b3-0d2b19db4c93 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:25.438861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a06b0-82eb-46b0-8072-4e216f52e0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:25.439469 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a06b0-82eb-46b0-8072-4e216f52e0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:25.439742 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a06b0-82eb-46b0-8072-4e216f52e0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:25.440015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a06b0-82eb-46b0-8072-4e216f52e0c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:25.440651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a06b0-82eb-46b0-8072-4e216f52e0c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:25.440959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a06b0-82eb-46b0-8072-4e216f52e0c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:25.442369 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a06b0-82eb-46b0-8072-4e216f52e0c1 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:25.458294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 265/521] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:25.458294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a06b0-82eb-46b0-8072-4e216f52e0c1 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:25.458598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528abce8-6188-4247-aae9-2eac93a37b62 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:25.492051 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598644dc-4b93-495f-9fc9-486a27be9467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:25.492647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598644dc-4b93-495f-9fc9-486a27be9467 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:25.492922 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598644dc-4b93-495f-9fc9-486a27be9467 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:25.493220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598644dc-4b93-495f-9fc9-486a27be9467 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:25.493859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598644dc-4b93-495f-9fc9-486a27be9467 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:25.495288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598644dc-4b93-495f-9fc9-486a27be9467 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:25.520892 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:25.555348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a06b0-82eb-46b0-8072-4e216f52e0c1 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:25.586464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3d75d-9500-4787-9d18-c8cbd1d37b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:25.586987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3d75d-9500-4787-9d18-c8cbd1d37b66 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:25.587262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3d75d-9500-4787-9d18-c8cbd1d37b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:25.587529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3d75d-9500-4787-9d18-c8cbd1d37b66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:25.626142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 257/522] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:21:25 2022] POST /identity/v3/users => generated 247 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:21:25.627198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598644dc-4b93-495f-9fc9-486a27be9467 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:25.662655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3d75d-9500-4787-9d18-c8cbd1d37b66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:25.664657 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3d75d-9500-4787-9d18-c8cbd1d37b66 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:25.683109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:25.741284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:25.746306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598644dc-4b93-495f-9fc9-486a27be9467 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:25.784148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f43620-7b30-424a-971b-0f3328869bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:25.784955 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 266/523] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:25.785087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f43620-7b30-424a-971b-0f3328869bdb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:25.785361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f43620-7b30-424a-971b-0f3328869bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:25.785638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f43620-7b30-424a-971b-0f3328869bdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:25.785797 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3d75d-9500-4787-9d18-c8cbd1d37b66 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:25.786384 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f43620-7b30-424a-971b-0f3328869bdb None admin] RBAC: Adding query filter params (role.id=b1cf59e6d9dd49179551b98cee02776c, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=eb70408fecfe41e0b2ea9a53c7ae0823) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:25.786760 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f43620-7b30-424a-971b-0f3328869bdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:25.789437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f43620-7b30-424a-971b-0f3328869bdb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:25.801062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 258/524] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:21:25 2022] GET /identity/v3/role_assignments?user.id=eb70408fecfe41e0b2ea9a53c7ae0823&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=b1cf59e6d9dd49179551b98cee02776c => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:25.801062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f43620-7b30-424a-971b-0f3328869bdb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:25.911010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3d75d-9500-4787-9d18-c8cbd1d37b66 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:25.946116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f43620-7b30-424a-971b-0f3328869bdb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:25.959083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:25.959666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42515e3c-ab63-4ffb-8fde-5834f732f6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:25.961240 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42515e3c-ab63-4ffb-8fde-5834f732f6de None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:25.961855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42515e3c-ab63-4ffb-8fde-5834f732f6de None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:25.962360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42515e3c-ab63-4ffb-8fde-5834f732f6de None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:25.963465 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42515e3c-ab63-4ffb-8fde-5834f732f6de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:25.963938 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42515e3c-ab63-4ffb-8fde-5834f732f6de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:25.966176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42515e3c-ab63-4ffb-8fde-5834f732f6de None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:25.982062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 267/525] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:25.983131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42515e3c-ab63-4ffb-8fde-5834f732f6de None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:26.003795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e2d39-a6df-415c-b923-a69b8162af16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:26.004442 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e2d39-a6df-415c-b923-a69b8162af16 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:26.004719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e2d39-a6df-415c-b923-a69b8162af16 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:26.005036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e2d39-a6df-415c-b923-a69b8162af16 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:26.015738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e2d39-a6df-415c-b923-a69b8162af16 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:26.017438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e2d39-a6df-415c-b923-a69b8162af16 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:26.027395 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7e4e2d39-a6df-415c-b923-a69b8162af16 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:26.030936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:26.032005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:26.033134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:26.033134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:26.033134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:26.033134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:26.033134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:26.033134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:26.033134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:26.033134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:26.033134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 04:21:26.033134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:26.034893 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 259/526] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:26.035788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e2d39-a6df-415c-b923-a69b8162af16 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:26.114393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42515e3c-ab63-4ffb-8fde-5834f732f6de None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:26.156720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4232c-79d3-46a2-856d-cee2394cf249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:26.159946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4232c-79d3-46a2-856d-cee2394cf249 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:26.159946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4232c-79d3-46a2-856d-cee2394cf249 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:26.159946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4232c-79d3-46a2-856d-cee2394cf249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:26.174871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4232c-79d3-46a2-856d-cee2394cf249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:26.176479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4232c-79d3-46a2-856d-cee2394cf249 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:26.178601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e2d39-a6df-415c-b923-a69b8162af16 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-18a4232c-79d3-46a2-856d-cee2394cf249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:26.192586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:26.193667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:26.194664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:26.194664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:26.194664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:26.200529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 268/527] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:26.200529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4232c-79d3-46a2-856d-cee2394cf249 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:26.227479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d11102-9f5c-43c7-9345-69aae00eca8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:26.228258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d11102-9f5c-43c7-9345-69aae00eca8e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:26.229019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d11102-9f5c-43c7-9345-69aae00eca8e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:26.229019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d11102-9f5c-43c7-9345-69aae00eca8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:26.236210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d11102-9f5c-43c7-9345-69aae00eca8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:26.237892 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d11102-9f5c-43c7-9345-69aae00eca8e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-19d11102-9f5c-43c7-9345-69aae00eca8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:26.250537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:26.251589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:26.252579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:26.252579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:26.252579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:26.252579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:26.252579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:26.252579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:26.252579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:26.252579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:26.254402 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 260/528] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:26.259986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d11102-9f5c-43c7-9345-69aae00eca8e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:26.292454 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:26.313491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:26.322396 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4232c-79d3-46a2-856d-cee2394cf249 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:26.359726 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31a2fd-88b1-4cf6-b79a-4e08286d80e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:26.360690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31a2fd-88b1-4cf6-b79a-4e08286d80e8 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:26.361131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31a2fd-88b1-4cf6-b79a-4e08286d80e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:26.361613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31a2fd-88b1-4cf6-b79a-4e08286d80e8 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:26.362510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31a2fd-88b1-4cf6-b79a-4e08286d80e8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:26.362951 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31a2fd-88b1-4cf6-b79a-4e08286d80e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:26.365657 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31a2fd-88b1-4cf6-b79a-4e08286d80e8 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:26.370827 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d11102-9f5c-43c7-9345-69aae00eca8e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:26.408343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 269/529] 10.222.0.50 () {56 vars in 1139 bytes} [Sat Sep 17 04:21:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:26.408769 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698875bf-6926-450c-884a-0be4abb73a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:26.409579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698875bf-6926-450c-884a-0be4abb73a8e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:26.409852 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31a2fd-88b1-4cf6-b79a-4e08286d80e8 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:26.410041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698875bf-6926-450c-884a-0be4abb73a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:26.410427 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698875bf-6926-450c-884a-0be4abb73a8e None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:26.411348 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698875bf-6926-450c-884a-0be4abb73a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:26.412355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698875bf-6926-450c-884a-0be4abb73a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:26.414201 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698875bf-6926-450c-884a-0be4abb73a8e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:26.432079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 261/530] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:26.432079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698875bf-6926-450c-884a-0be4abb73a8e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:26.530191 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:26.543937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698875bf-6926-450c-884a-0be4abb73a8e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:26.562561 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31a2fd-88b1-4cf6-b79a-4e08286d80e8 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:26.582171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334cce5-51fc-4801-a806-4c93406e3ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:26.583046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334cce5-51fc-4801-a806-4c93406e3ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:26.583343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334cce5-51fc-4801-a806-4c93406e3ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:26.583935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334cce5-51fc-4801-a806-4c93406e3ec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:26.608154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a5f25-0da1-49b7-acd2-73d0725d85b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:26.609129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a5f25-0da1-49b7-acd2-73d0725d85b6 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:26.609712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a5f25-0da1-49b7-acd2-73d0725d85b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:26.610132 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a5f25-0da1-49b7-acd2-73d0725d85b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:26.611326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a5f25-0da1-49b7-acd2-73d0725d85b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:26.612478 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a5f25-0da1-49b7-acd2-73d0725d85b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:26.614306 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a5f25-0da1-49b7-acd2-73d0725d85b6 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:26.618902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:26.633153 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 270/531] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:26.634669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a5f25-0da1-49b7-acd2-73d0725d85b6 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:26.676493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334cce5-51fc-4801-a806-4c93406e3ec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:26.678832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334cce5-51fc-4801-a806-4c93406e3ec8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:26.768036 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a5f25-0da1-49b7-acd2-73d0725d85b6 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:26.794879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:26.804121 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c248c-f08c-4d38-87c9-de9525b0c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:26.804839 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c248c-f08c-4d38-87c9-de9525b0c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:26.808086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c248c-f08c-4d38-87c9-de9525b0c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:26.808086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c248c-f08c-4d38-87c9-de9525b0c1b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:26.810498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 262/532] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:26.811598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334cce5-51fc-4801-a806-4c93406e3ec8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:26.812943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c248c-f08c-4d38-87c9-de9525b0c1b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:26.814738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c248c-f08c-4d38-87c9-de9525b0c1b7 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-890c248c-f08c-4d38-87c9-de9525b0c1b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:26.829214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:26.830104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:26.830924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:26.830924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:26.830924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:26.830924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:26.830924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:26.830924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:26.830924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:26.830924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:26.830924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 271/533] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:26.833029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c248c-f08c-4d38-87c9-de9525b0c1b7 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:26.896533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:26.947048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334cce5-51fc-4801-a806-4c93406e3ec8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:26.953707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c248c-f08c-4d38-87c9-de9525b0c1b7 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:26.991594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad652c7-c5d8-4e13-8d1c-127b1dc6d1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:26.992264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad652c7-c5d8-4e13-8d1c-127b1dc6d1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:26.992543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad652c7-c5d8-4e13-8d1c-127b1dc6d1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:26.992816 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad652c7-c5d8-4e13-8d1c-127b1dc6d1b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:26.998489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59c3c-96d7-4156-b10f-c639925190af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:26.999422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59c3c-96d7-4156-b10f-c639925190af None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:26.999903 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59c3c-96d7-4156-b10f-c639925190af None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:27.000442 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59c3c-96d7-4156-b10f-c639925190af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:27.001405 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a59c3c-96d7-4156-b10f-c639925190af None admin] RBAC: Adding query filter params (role.id=b1cf59e6d9dd49179551b98cee02776c, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=81ba9aba795f423a8ffabe419b64507a) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:27.001916 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a59c3c-96d7-4156-b10f-c639925190af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:27.003972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a59c3c-96d7-4156-b10f-c639925190af None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:27.004485 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad652c7-c5d8-4e13-8d1c-127b1dc6d1b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:27.006247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad652c7-c5d8-4e13-8d1c-127b1dc6d1b2 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:27.021231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 263/534] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:21:26 2022] GET /identity/v3/role_assignments?user.id=81ba9aba795f423a8ffabe419b64507a&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=b1cf59e6d9dd49179551b98cee02776c => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:27.022357 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59c3c-96d7-4156-b10f-c639925190af None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-aad652c7-c5d8-4e13-8d1c-127b1dc6d1b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:27.024114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:27.025107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:27.025939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:27.025939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:27.025939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:27.029413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 272/535] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:27.040660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad652c7-c5d8-4e13-8d1c-127b1dc6d1b2 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:27.133433 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:27.206024 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59c3c-96d7-4156-b10f-c639925190af None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:27.277292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924d6b7-75e8-4ae1-8a84-963c2271a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:27.278268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924d6b7-75e8-4ae1-8a84-963c2271a389 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:27.278740 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924d6b7-75e8-4ae1-8a84-963c2271a389 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:27.279195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924d6b7-75e8-4ae1-8a84-963c2271a389 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:27.280355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924d6b7-75e8-4ae1-8a84-963c2271a389 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:27.280868 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924d6b7-75e8-4ae1-8a84-963c2271a389 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:27.283274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924d6b7-75e8-4ae1-8a84-963c2271a389 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:27.308131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad652c7-c5d8-4e13-8d1c-127b1dc6d1b2 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:27.325155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 264/536] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:27.330046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:27.330162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924d6b7-75e8-4ae1-8a84-963c2271a389 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:27.369274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b56f5-f11a-4662-b6ae-e403e0faf47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:27.369930 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b56f5-f11a-4662-b6ae-e403e0faf47d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:27.370471 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b56f5-f11a-4662-b6ae-e403e0faf47d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:27.370988 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b56f5-f11a-4662-b6ae-e403e0faf47d None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:27.371841 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b56f5-f11a-4662-b6ae-e403e0faf47d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:27.372146 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b56f5-f11a-4662-b6ae-e403e0faf47d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:27.374216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b56f5-f11a-4662-b6ae-e403e0faf47d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:27.406569 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 273/537] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:27.422433 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b56f5-f11a-4662-b6ae-e403e0faf47d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:27.526899 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924d6b7-75e8-4ae1-8a84-963c2271a389 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:27.541935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:27.572429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a066be-4c24-4a9a-985b-24e5d09c0439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:27.573318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a066be-4c24-4a9a-985b-24e5d09c0439 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:27.573791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a066be-4c24-4a9a-985b-24e5d09c0439 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:27.574231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a066be-4c24-4a9a-985b-24e5d09c0439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:27.575162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a066be-4c24-4a9a-985b-24e5d09c0439 None admin] RBAC: Adding query filter params (role.id=b1cf59e6d9dd49179551b98cee02776c, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=60f50529feb44143b0627131d9aab8d0) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:27.575613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a066be-4c24-4a9a-985b-24e5d09c0439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:27.577232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a066be-4c24-4a9a-985b-24e5d09c0439 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:27.589560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 265/538] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:21:27 2022] GET /identity/v3/role_assignments?user.id=60f50529feb44143b0627131d9aab8d0&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=b1cf59e6d9dd49179551b98cee02776c => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:27.619327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b56f5-f11a-4662-b6ae-e403e0faf47d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:27.657684 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39462c43-cf35-42dc-86a8-ff37d0fb6c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:27.658606 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39462c43-cf35-42dc-86a8-ff37d0fb6c17 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:27.659047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39462c43-cf35-42dc-86a8-ff37d0fb6c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:27.659457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39462c43-cf35-42dc-86a8-ff37d0fb6c17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:27.667570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39462c43-cf35-42dc-86a8-ff37d0fb6c17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:27.669451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39462c43-cf35-42dc-86a8-ff37d0fb6c17 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-39462c43-cf35-42dc-86a8-ff37d0fb6c17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:27.681799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:27.682832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:27.683885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:27.683885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:27.683885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:27.683885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:27.683885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:27.683885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:27.683885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:27.683885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:27.686008 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 274/539] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:27.691852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a066be-4c24-4a9a-985b-24e5d09c0439 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:27.810481 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a066be-4c24-4a9a-985b-24e5d09c0439 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:27.848305 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be4486-5224-43ac-ad3c-476531cea09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:27.848909 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be4486-5224-43ac-ad3c-476531cea09b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:27.849251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be4486-5224-43ac-ad3c-476531cea09b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:27.849522 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be4486-5224-43ac-ad3c-476531cea09b None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:27.850212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be4486-5224-43ac-ad3c-476531cea09b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:27.850514 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be4486-5224-43ac-ad3c-476531cea09b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:27.852088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be4486-5224-43ac-ad3c-476531cea09b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:27.864877 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 266/540] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:27.870824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39462c43-cf35-42dc-86a8-ff37d0fb6c17 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:27.915588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:27.978555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39462c43-cf35-42dc-86a8-ff37d0fb6c17 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:28.018284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accc8eb-8cb0-4ad5-a4f5-8f065f410d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:28.018901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc8eb-8cb0-4ad5-a4f5-8f065f410d67 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:28.019183 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc8eb-8cb0-4ad5-a4f5-8f065f410d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:28.019455 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc8eb-8cb0-4ad5-a4f5-8f065f410d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:28.020190 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accc8eb-8cb0-4ad5-a4f5-8f065f410d67 None admin] RBAC: Adding query filter params (role.id=b1cf59e6d9dd49179551b98cee02776c, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=6469c8860be943168b67ea7fa28bf19d) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:28.020561 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accc8eb-8cb0-4ad5-a4f5-8f065f410d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:28.022107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accc8eb-8cb0-4ad5-a4f5-8f065f410d67 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:28.028331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 275/541] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:21:27 2022] GET /identity/v3/role_assignments?user.id=6469c8860be943168b67ea7fa28bf19d&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=b1cf59e6d9dd49179551b98cee02776c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:28.209147 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeac22f-cf28-4dbe-98c7-d6fa34f53405 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:28.209466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeac22f-cf28-4dbe-98c7-d6fa34f53405 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:28.209790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeac22f-cf28-4dbe-98c7-d6fa34f53405 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:28.211478 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 267/542] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:28.216727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478cab3-ece3-4163-a330-efed94ab291b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:28.217020 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478cab3-ece3-4163-a330-efed94ab291b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:28.217300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478cab3-ece3-4163-a330-efed94ab291b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:28.236562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-1478cab3-ece3-4163-a330-efed94ab291b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:28.237793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1478cab3-ece3-4163-a330-efed94ab291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:28.311254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e830a00-475e-42c8-b6e9-f1126a1fc166 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:28.311583 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e830a00-475e-42c8-b6e9-f1126a1fc166 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:28.311811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e830a00-475e-42c8-b6e9-f1126a1fc166 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:28.313815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 268/543] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:21:28.320162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ed19d-2dd8-43c8-a1f4-a76b5d153749 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:28.320495 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ed19d-2dd8-43c8-a1f4-a76b5d153749 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:28.321040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ed19d-2dd8-43c8-a1f4-a76b5d153749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:28.338586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 276/544] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:28.347042 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-576ed19d-2dd8-43c8-a1f4-a76b5d153749 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:28.348411 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-576ed19d-2dd8-43c8-a1f4-a76b5d153749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:28.404507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:28.445936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 269/545] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:21:28.609920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478cab3-ece3-4163-a330-efed94ab291b None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:28.642342 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:28.735879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478cab3-ece3-4163-a330-efed94ab291b None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:28.790215 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc26c-72f8-4291-93b1-d2e555af1219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:28.791115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc26c-72f8-4291-93b1-d2e555af1219 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:28.791547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc26c-72f8-4291-93b1-d2e555af1219 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:28.791958 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc26c-72f8-4291-93b1-d2e555af1219 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:28.805823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dc26c-72f8-4291-93b1-d2e555af1219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:28.810202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ed19d-2dd8-43c8-a1f4-a76b5d153749 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-c71dc26c-72f8-4291-93b1-d2e555af1219 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:28.811470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:28.812438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:28.813436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:28.813436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:28.813436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:28.813436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:28.813436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:28.813436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:28.813436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:28.813436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:28.813436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:28.813436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:28.813436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:28.813436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:28.815609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 277/546] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:28.821906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc26c-72f8-4291-93b1-d2e555af1219 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:28.926805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:28.948221 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc26c-72f8-4291-93b1-d2e555af1219 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:28.986767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f1e7b-d149-463e-b1a3-98eb61c76ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:28.987329 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1e7b-d149-463e-b1a3-98eb61c76ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:28.987601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1e7b-d149-463e-b1a3-98eb61c76ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:28.987920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1e7b-d149-463e-b1a3-98eb61c76ae2 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:28.993019 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f1e7b-d149-463e-b1a3-98eb61c76ae2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:28.993019 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f1e7b-d149-463e-b1a3-98eb61c76ae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:28.993019 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f1e7b-d149-463e-b1a3-98eb61c76ae2 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:29.001430 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 278/547] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:29.010697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f1e7b-d149-463e-b1a3-98eb61c76ae2 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:29.019860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ed19d-2dd8-43c8-a1f4-a76b5d153749 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:29.101320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5b537-4574-4da1-a98d-9d1150f625d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:29.102371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5b537-4574-4da1-a98d-9d1150f625d3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:29.102826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5b537-4574-4da1-a98d-9d1150f625d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:29.103272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5b537-4574-4da1-a98d-9d1150f625d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:29.127283 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f1e7b-d149-463e-b1a3-98eb61c76ae2 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:29.131035 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5b537-4574-4da1-a98d-9d1150f625d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e6d5b537-4574-4da1-a98d-9d1150f625d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:29.136130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:29.136975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:29.138306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:29.138306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:29.138306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:29.138306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:29.138306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:29.138306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:29.138306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:29.138306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:29.138306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:29.138306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:29.138306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:29.138306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:29.142791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 270/548] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:29.155329 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5b537-4574-4da1-a98d-9d1150f625d3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:29.201319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35909380-b58d-4b7b-8de7-62a7885415f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:29.202190 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909380-b58d-4b7b-8de7-62a7885415f6 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:29.202607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909380-b58d-4b7b-8de7-62a7885415f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:29.203197 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909380-b58d-4b7b-8de7-62a7885415f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:29.209464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:29.227920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35909380-b58d-4b7b-8de7-62a7885415f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:29.230565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35909380-b58d-4b7b-8de7-62a7885415f6 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:29.245489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-35909380-b58d-4b7b-8de7-62a7885415f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:29.259031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:29.261481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:29.262319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:29.262319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:29.262319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:29.262319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 279/549] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:29.272936 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35909380-b58d-4b7b-8de7-62a7885415f6 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:29.357920 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5b537-4574-4da1-a98d-9d1150f625d3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:29.422785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa9de-df8d-4117-bff1-b0d9428c633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:29.423415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa9de-df8d-4117-bff1-b0d9428c633b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:29.423690 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa9de-df8d-4117-bff1-b0d9428c633b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:29.423960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa9de-df8d-4117-bff1-b0d9428c633b None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:29.424654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aa9de-df8d-4117-bff1-b0d9428c633b None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:29.424958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aa9de-df8d-4117-bff1-b0d9428c633b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:29.426426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aa9de-df8d-4117-bff1-b0d9428c633b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:29.446808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 271/550] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:29.452502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa9de-df8d-4117-bff1-b0d9428c633b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:29.457097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35909380-b58d-4b7b-8de7-62a7885415f6 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:29.510590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769297fd-d1ba-4d23-ba70-7734c2cf6040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:29.511138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769297fd-d1ba-4d23-ba70-7734c2cf6040 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:29.511414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769297fd-d1ba-4d23-ba70-7734c2cf6040 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:29.511684 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769297fd-d1ba-4d23-ba70-7734c2cf6040 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:29.512332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769297fd-d1ba-4d23-ba70-7734c2cf6040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:29.512633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769297fd-d1ba-4d23-ba70-7734c2cf6040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:29.514029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769297fd-d1ba-4d23-ba70-7734c2cf6040 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:29.536697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 280/551] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:29.538010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e750b40-a1a0-478a-8d5b-8dc10431e018 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:29.538289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e750b40-a1a0-478a-8d5b-8dc10431e018 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:29.538556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e750b40-a1a0-478a-8d5b-8dc10431e018 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:29.544445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 281/552] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:29.545374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e750b40-a1a0-478a-8d5b-8dc10431e018 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:29.597774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:29.607882 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:29.616884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa9de-df8d-4117-bff1-b0d9428c633b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:29.664689 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8114732-3332-4267-ac71-d111b06346da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:29.665078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e750b40-a1a0-478a-8d5b-8dc10431e018 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:29.665912 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8114732-3332-4267-ac71-d111b06346da None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:29.666650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8114732-3332-4267-ac71-d111b06346da None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:29.667121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8114732-3332-4267-ac71-d111b06346da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:29.682400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8114732-3332-4267-ac71-d111b06346da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:29.684887 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8114732-3332-4267-ac71-d111b06346da None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:29.706040 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049613a-08f4-40e3-bef9-6e5b862fe9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-d8114732-3332-4267-ac71-d111b06346da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:29.706250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:29.707088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:29.708016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:29.708016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:29.708016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:29.708271 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049613a-08f4-40e3-bef9-6e5b862fe9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:29.708271 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049613a-08f4-40e3-bef9-6e5b862fe9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:29.708271 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049613a-08f4-40e3-bef9-6e5b862fe9f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:29.711306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 272/553] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:29.712840 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c658d9a-5a0a-46b0-ab4f-c4204a51fb57 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:29.713300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c658d9a-5a0a-46b0-ab4f-c4204a51fb57 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:29.713730 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c658d9a-5a0a-46b0-ab4f-c4204a51fb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:29.719804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049613a-08f4-40e3-bef9-6e5b862fe9f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:29.721811 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049613a-08f4-40e3-bef9-6e5b862fe9f8 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:29.734875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1c658d9a-5a0a-46b0-ab4f-c4204a51fb57 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-3049613a-08f4-40e3-bef9-6e5b862fe9f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:29.736037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:29.736909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:29.738013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:29.738013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:29.738013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:29.738013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:29.738013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:29.738013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:29.738013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:29.738013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:29.738013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 04:21:29.738013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:29.739111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1c658d9a-5a0a-46b0-ab4f-c4204a51fb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:29.742344 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 282/554] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:21:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:29.743299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049613a-08f4-40e3-bef9-6e5b862fe9f8 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:29.815434 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 273/555] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:29.816174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c658d9a-5a0a-46b0-ab4f-c4204a51fb57 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:29.853394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049613a-08f4-40e3-bef9-6e5b862fe9f8 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:29.872497 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:29.897405 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:29.901723 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060a8fd-12a0-4876-b1f1-08fd466ce395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:29.902426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060a8fd-12a0-4876-b1f1-08fd466ce395 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:29.902779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060a8fd-12a0-4876-b1f1-08fd466ce395 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:29.903117 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060a8fd-12a0-4876-b1f1-08fd466ce395 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:29.903848 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060a8fd-12a0-4876-b1f1-08fd466ce395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:29.904220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060a8fd-12a0-4876-b1f1-08fd466ce395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:29.906827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060a8fd-12a0-4876-b1f1-08fd466ce395 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:29.931801 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 283/556] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:29.933206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c658d9a-5a0a-46b0-ab4f-c4204a51fb57 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:29.937513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060a8fd-12a0-4876-b1f1-08fd466ce395 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:29.978788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196375a-280f-4f7a-969e-43ea5561c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:29.979804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196375a-280f-4f7a-969e-43ea5561c47b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:29.980275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196375a-280f-4f7a-969e-43ea5561c47b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:29.980922 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196375a-280f-4f7a-969e-43ea5561c47b None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:29.983026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196375a-280f-4f7a-969e-43ea5561c47b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:29.983555 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196375a-280f-4f7a-969e-43ea5561c47b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:29.986022 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196375a-280f-4f7a-969e-43ea5561c47b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:30.004819 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 274/557] 10.222.0.50 () {56 vars in 1135 bytes} [Sat Sep 17 04:21:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:30.014150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196375a-280f-4f7a-969e-43ea5561c47b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:30.071999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060a8fd-12a0-4876-b1f1-08fd466ce395 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:30.112379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d67ed5-27ff-4f7d-b79d-da13917fefcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:30.112379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d67ed5-27ff-4f7d-b79d-da13917fefcc None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:30.112799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d67ed5-27ff-4f7d-b79d-da13917fefcc None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:30.112959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d67ed5-27ff-4f7d-b79d-da13917fefcc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:30.121124 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d67ed5-27ff-4f7d-b79d-da13917fefcc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:30.122590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d67ed5-27ff-4f7d-b79d-da13917fefcc None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-86d67ed5-27ff-4f7d-b79d-da13917fefcc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:30.136023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:30.137491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:30.139012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:30.139012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:30.139012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:30.139012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:30.139012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:30.139012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:30.139012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:30.139012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:30.139012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:21:30.139012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:30.139012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 284/558] 10.222.0.50 () {56 vars in 1093 bytes} [Sat Sep 17 04:21:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:30.139012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d67ed5-27ff-4f7d-b79d-da13917fefcc None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:30.156110 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196375a-280f-4f7a-969e-43ea5561c47b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:30.178705 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:30.184594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:30.197554 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad8942-14b8-4fa7-8cfe-1e29ba23ae96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:30.198713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad8942-14b8-4fa7-8cfe-1e29ba23ae96 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:30.199161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad8942-14b8-4fa7-8cfe-1e29ba23ae96 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:30.199579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad8942-14b8-4fa7-8cfe-1e29ba23ae96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:30.256806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d67ed5-27ff-4f7d-b79d-da13917fefcc None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:30.283089 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad8942-14b8-4fa7-8cfe-1e29ba23ae96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:30.284822 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad8942-14b8-4fa7-8cfe-1e29ba23ae96 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:30.302804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a31ed-63a7-4f3b-bee6-98dc91a8131a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:30.303878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a31ed-63a7-4f3b-bee6-98dc91a8131a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:30.304612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a31ed-63a7-4f3b-bee6-98dc91a8131a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:30.305144 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a31ed-63a7-4f3b-bee6-98dc91a8131a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:30.319677 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a31ed-63a7-4f3b-bee6-98dc91a8131a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-410a31ed-63a7-4f3b-bee6-98dc91a8131a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:30.333673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:30.334893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:30.335922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:30.335922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:30.335922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:30.335922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:30.335922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:30.335922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:30.335922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:30.335922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:30.335922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:30.335922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:30.335922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:30.335922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:30.335922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 285/559] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:30.335922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a31ed-63a7-4f3b-bee6-98dc91a8131a None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:30.417406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 275/560] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:30.418959 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad8942-14b8-4fa7-8cfe-1e29ba23ae96 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:30.439220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:30.445596 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a31ed-63a7-4f3b-bee6-98dc91a8131a None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:30.457511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:30.484498 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df912db9-e40e-405f-aa7d-4fcc92282ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:30.485501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df912db9-e40e-405f-aa7d-4fcc92282ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:30.485965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df912db9-e40e-405f-aa7d-4fcc92282ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:30.486417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df912db9-e40e-405f-aa7d-4fcc92282ed5 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:30.487370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df912db9-e40e-405f-aa7d-4fcc92282ed5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:30.487930 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df912db9-e40e-405f-aa7d-4fcc92282ed5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:30.489973 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df912db9-e40e-405f-aa7d-4fcc92282ed5 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:30.512125 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 286/561] 10.222.0.50 () {56 vars in 1133 bytes} [Sat Sep 17 04:21:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:30.513385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df912db9-e40e-405f-aa7d-4fcc92282ed5 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:30.556011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad8942-14b8-4fa7-8cfe-1e29ba23ae96 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:30.603408 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f6678-d393-43bb-97b0-a27fca002739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:30.603957 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f6678-d393-43bb-97b0-a27fca002739 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:30.604236 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f6678-d393-43bb-97b0-a27fca002739 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:30.604508 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f6678-d393-43bb-97b0-a27fca002739 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:30.605202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f6678-d393-43bb-97b0-a27fca002739 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:30.605826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f6678-d393-43bb-97b0-a27fca002739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:30.607565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f6678-d393-43bb-97b0-a27fca002739 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:30.617041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 276/562] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:30.617869 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f6678-d393-43bb-97b0-a27fca002739 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:30.629773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df912db9-e40e-405f-aa7d-4fcc92282ed5 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:30.668164 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248dd6a-69df-41bf-aec0-d863ac522b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:30.668801 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248dd6a-69df-41bf-aec0-d863ac522b2b None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:30.669108 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248dd6a-69df-41bf-aec0-d863ac522b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:30.669383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248dd6a-69df-41bf-aec0-d863ac522b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:30.680508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248dd6a-69df-41bf-aec0-d863ac522b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:30.681985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248dd6a-69df-41bf-aec0-d863ac522b2b None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-7248dd6a-69df-41bf-aec0-d863ac522b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:30.697281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:30.698394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:30.699460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:30.699460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:30.699460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:30.699460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 287/563] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:30.700065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d47b6-cf94-46a7-a912-fa2b21c0097a None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:30.700171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d47b6-cf94-46a7-a912-fa2b21c0097a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:30.700401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d47b6-cf94-46a7-a912-fa2b21c0097a None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:30.701641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 288/564] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:30.702381 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d47b6-cf94-46a7-a912-fa2b21c0097a None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:30.711476 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:30.715668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:30.725247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f6678-d393-43bb-97b0-a27fca002739 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:30.760067 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2b511-791f-46b9-abee-ed4c09eb8861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:30.760952 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2b511-791f-46b9-abee-ed4c09eb8861 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:30.761268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2b511-791f-46b9-abee-ed4c09eb8861 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:30.761538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2b511-791f-46b9-abee-ed4c09eb8861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:30.771897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2b511-791f-46b9-abee-ed4c09eb8861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:30.774002 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2b511-791f-46b9-abee-ed4c09eb8861 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-06e2b511-791f-46b9-abee-ed4c09eb8861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:30.789830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:30.790807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:30.791668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:30.791668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:30.791668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:30.791668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 277/565] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:30.792103 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd001f2a-1703-4794-b70d-002790933c5d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:30.792351 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd001f2a-1703-4794-b70d-002790933c5d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:30.792590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd001f2a-1703-4794-b70d-002790933c5d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:30.793872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 278/566] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:30.794564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd001f2a-1703-4794-b70d-002790933c5d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:30.806458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d47b6-cf94-46a7-a912-fa2b21c0097a None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:30.839711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e845a-c35f-4427-b298-1e673a21d7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:30.840327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e845a-c35f-4427-b298-1e673a21d7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:30.840602 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e845a-c35f-4427-b298-1e673a21d7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:30.840870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e845a-c35f-4427-b298-1e673a21d7b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:30.851651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e845a-c35f-4427-b298-1e673a21d7b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:30.853171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e845a-c35f-4427-b298-1e673a21d7b9 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-544e845a-c35f-4427-b298-1e673a21d7b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:30.868707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:30.869803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:30.870697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:30.870697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:30.870697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:30.870697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 289/567] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:30.871192 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984368c2-db06-4ded-8dbc-c694bd5fb8e2 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:30.871491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984368c2-db06-4ded-8dbc-c694bd5fb8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:30.871743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984368c2-db06-4ded-8dbc-c694bd5fb8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:30.890216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-984368c2-db06-4ded-8dbc-c694bd5fb8e2 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:30.891393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-984368c2-db06-4ded-8dbc-c694bd5fb8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:30.899755 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd001f2a-1703-4794-b70d-002790933c5d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:30.932881 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73b9b2-e157-4630-bafe-eae01b9591c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:30.933578 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73b9b2-e157-4630-bafe-eae01b9591c7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:30.933771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73b9b2-e157-4630-bafe-eae01b9591c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:30.934039 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73b9b2-e157-4630-bafe-eae01b9591c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:30.934673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73b9b2-e157-4630-bafe-eae01b9591c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:30.934971 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73b9b2-e157-4630-bafe-eae01b9591c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:30.936327 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73b9b2-e157-4630-bafe-eae01b9591c7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:30.943699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:30.947715 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 279/568] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:30.948476 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73b9b2-e157-4630-bafe-eae01b9591c7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:30.951115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:30.957460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 290/569] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:30.959169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c344529-f65a-4ff3-8b03-9aa917dc5b0d None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:30.959446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c344529-f65a-4ff3-8b03-9aa917dc5b0d None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:30.959712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c344529-f65a-4ff3-8b03-9aa917dc5b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:30.977821 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-8c344529-f65a-4ff3-8b03-9aa917dc5b0d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:30.978979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8c344529-f65a-4ff3-8b03-9aa917dc5b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:31.057016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 291/570] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:31.057016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c344529-f65a-4ff3-8b03-9aa917dc5b0d None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:31.080480 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73b9b2-e157-4630-bafe-eae01b9591c7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:31.128804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac9cb0-4882-4da3-a24b-c13eccfc01a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:31.129660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac9cb0-4882-4da3-a24b-c13eccfc01a2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:31.130128 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac9cb0-4882-4da3-a24b-c13eccfc01a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:31.130745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac9cb0-4882-4da3-a24b-c13eccfc01a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:31.131387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac9cb0-4882-4da3-a24b-c13eccfc01a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:31.131789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac9cb0-4882-4da3-a24b-c13eccfc01a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:31.133807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac9cb0-4882-4da3-a24b-c13eccfc01a2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:31.151316 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 280/571] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:31.153019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac9cb0-4882-4da3-a24b-c13eccfc01a2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:31.159289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c344529-f65a-4ff3-8b03-9aa917dc5b0d None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:31.178625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:31.196863 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafdc40-e778-4977-b595-96cb765dd39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:31.205216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafdc40-e778-4977-b595-96cb765dd39c None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:31.205216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafdc40-e778-4977-b595-96cb765dd39c None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:31.205216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafdc40-e778-4977-b595-96cb765dd39c None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:31.205216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafdc40-e778-4977-b595-96cb765dd39c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:31.205216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafdc40-e778-4977-b595-96cb765dd39c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:31.205216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafdc40-e778-4977-b595-96cb765dd39c None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:31.220410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 292/572] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:31.220410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafdc40-e778-4977-b595-96cb765dd39c None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:31.238288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:31.278278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac9cb0-4882-4da3-a24b-c13eccfc01a2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:31.313014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed516a5-e5ad-45aa-bad9-23ee1e0bc148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:31.313754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed516a5-e5ad-45aa-bad9-23ee1e0bc148 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:31.314126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed516a5-e5ad-45aa-bad9-23ee1e0bc148 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:31.314491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed516a5-e5ad-45aa-bad9-23ee1e0bc148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:31.322178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed516a5-e5ad-45aa-bad9-23ee1e0bc148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:31.325248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed516a5-e5ad-45aa-bad9-23ee1e0bc148 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:31.334795 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafdc40-e778-4977-b595-96cb765dd39c None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-eed516a5-e5ad-45aa-bad9-23ee1e0bc148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:31.335440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:31.336422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:31.337627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:31.337627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:31.337627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:31.337627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:31.337627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:31.337627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:31.337627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:31.337627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:31.338425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 281/573] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:31.339206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed516a5-e5ad-45aa-bad9-23ee1e0bc148 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:31.372031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4e8b2-4b9a-49b3-8dd2-19efbf101fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:31.372654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4e8b2-4b9a-49b3-8dd2-19efbf101fef None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:31.372931 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4e8b2-4b9a-49b3-8dd2-19efbf101fef None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:31.373230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4e8b2-4b9a-49b3-8dd2-19efbf101fef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:31.379934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4e8b2-4b9a-49b3-8dd2-19efbf101fef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:31.381328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4e8b2-4b9a-49b3-8dd2-19efbf101fef None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-c4a4e8b2-4b9a-49b3-8dd2-19efbf101fef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:31.393573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:31.394564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:31.395448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:31.395448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:31.395448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:31.395448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:31.395448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:31.395448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:31.395448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:31.395448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:31.395448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 293/574] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:31.395448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4e8b2-4b9a-49b3-8dd2-19efbf101fef None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:31.435534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:31.445451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed516a5-e5ad-45aa-bad9-23ee1e0bc148 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:31.467239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:31.479601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d972623-da16-43d1-85a5-569fb5ad961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:31.480229 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d972623-da16-43d1-85a5-569fb5ad961f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:31.480506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d972623-da16-43d1-85a5-569fb5ad961f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:31.480770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d972623-da16-43d1-85a5-569fb5ad961f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:31.488964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d972623-da16-43d1-85a5-569fb5ad961f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:31.491665 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d972623-da16-43d1-85a5-569fb5ad961f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:31.494633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4e8b2-4b9a-49b3-8dd2-19efbf101fef None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-4d972623-da16-43d1-85a5-569fb5ad961f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:31.503214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:31.504289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:31.506054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:31.506054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:31.506054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:31.506054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:31.506054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:31.506054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:31.506054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:31.506054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:31.506054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 04:21:31.506054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:31.506054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 282/575] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:31.506054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d972623-da16-43d1-85a5-569fb5ad961f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:31.531719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da752c-820f-4e31-9b71-b8f5627d6033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:31.532338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da752c-820f-4e31-9b71-b8f5627d6033 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:31.532615 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da752c-820f-4e31-9b71-b8f5627d6033 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:31.532890 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da752c-820f-4e31-9b71-b8f5627d6033 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:31.543230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da752c-820f-4e31-9b71-b8f5627d6033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-27da752c-820f-4e31-9b71-b8f5627d6033 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:31.548359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:31.549444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:31.550273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:31.550273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:31.550273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:31.550273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:31.550273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:31.550273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:31.550273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:31.550273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:31.550273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:31.550273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:31.550273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:31.550273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:31.550273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 294/576] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:31.550273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da752c-820f-4e31-9b71-b8f5627d6033 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:31.610399 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d972623-da16-43d1-85a5-569fb5ad961f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:31.644099 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470031b4-9fb6-4613-831f-367367506826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:31.644750 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470031b4-9fb6-4613-831f-367367506826 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:31.645052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470031b4-9fb6-4613-831f-367367506826 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:31.645325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470031b4-9fb6-4613-831f-367367506826 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:31.646723 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:31.650191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da752c-820f-4e31-9b71-b8f5627d6033 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:31.655874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470031b4-9fb6-4613-831f-367367506826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-470031b4-9fb6-4613-831f-367367506826 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:31.661135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:31.662163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:31.662981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:31.662981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:31.662981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:31.662981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:31.662981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:31.662981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:31.662981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:31.662981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:31.662981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:31.662981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:31.662981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:31.662981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:31.662981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 283/577] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:31.662981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470031b4-9fb6-4613-831f-367367506826 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:31.687269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c13c0-cdc5-4554-95ec-a2338818ba78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:31.687871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c13c0-cdc5-4554-95ec-a2338818ba78 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:31.688147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c13c0-cdc5-4554-95ec-a2338818ba78 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:31.688419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c13c0-cdc5-4554-95ec-a2338818ba78 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:31.689141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c13c0-cdc5-4554-95ec-a2338818ba78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:31.689449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c13c0-cdc5-4554-95ec-a2338818ba78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:31.690883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c13c0-cdc5-4554-95ec-a2338818ba78 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:31.703824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 295/578] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:31.704757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c13c0-cdc5-4554-95ec-a2338818ba78 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:31.708421 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:31.767731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470031b4-9fb6-4613-831f-367367506826 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:31.799726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57213c0f-aa48-4785-a5a8-3e784216af81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:31.800320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57213c0f-aa48-4785-a5a8-3e784216af81 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:31.800604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57213c0f-aa48-4785-a5a8-3e784216af81 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:31.800873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57213c0f-aa48-4785-a5a8-3e784216af81 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:31.801589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57213c0f-aa48-4785-a5a8-3e784216af81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:31.802415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57213c0f-aa48-4785-a5a8-3e784216af81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:31.803831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57213c0f-aa48-4785-a5a8-3e784216af81 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:31.804066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c13c0-cdc5-4554-95ec-a2338818ba78 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:31.815425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 284/579] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:31.816211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57213c0f-aa48-4785-a5a8-3e784216af81 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:31.838802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542edb9c-a845-4879-9821-e489ecf1f723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:31.839393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542edb9c-a845-4879-9821-e489ecf1f723 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:31.839673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542edb9c-a845-4879-9821-e489ecf1f723 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:31.839937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542edb9c-a845-4879-9821-e489ecf1f723 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:31.840646 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542edb9c-a845-4879-9821-e489ecf1f723 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:31.840957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542edb9c-a845-4879-9821-e489ecf1f723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:31.842388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542edb9c-a845-4879-9821-e489ecf1f723 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:31.858859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 296/580] 10.222.0.50 () {56 vars in 1137 bytes} [Sat Sep 17 04:21:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:31.859652 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542edb9c-a845-4879-9821-e489ecf1f723 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:31.876584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:31.917186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57213c0f-aa48-4785-a5a8-3e784216af81 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:31.918620 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:31.951444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdec76-cc72-442e-a941-229ee31bba89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:31.952046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdec76-cc72-442e-a941-229ee31bba89 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:31.952318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdec76-cc72-442e-a941-229ee31bba89 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:31.952585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdec76-cc72-442e-a941-229ee31bba89 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:31.953263 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdec76-cc72-442e-a941-229ee31bba89 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:31.953561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdec76-cc72-442e-a941-229ee31bba89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:31.954919 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdec76-cc72-442e-a941-229ee31bba89 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:31.956898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542edb9c-a845-4879-9821-e489ecf1f723 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:31.962967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 285/581] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:31.963702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdec76-cc72-442e-a941-229ee31bba89 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:31.990694 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63581b1-d2af-4d69-899d-4c524f9f6787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:31.991296 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63581b1-d2af-4d69-899d-4c524f9f6787 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:31.991567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63581b1-d2af-4d69-899d-4c524f9f6787 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:31.991835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63581b1-d2af-4d69-899d-4c524f9f6787 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:31.992478 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63581b1-d2af-4d69-899d-4c524f9f6787 None admin] RBAC: Adding query filter params (name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:31.992777 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63581b1-d2af-4d69-899d-4c524f9f6787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:31.994165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63581b1-d2af-4d69-899d-4c524f9f6787 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:32.001893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 297/582] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:32.002638 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63581b1-d2af-4d69-899d-4c524f9f6787 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:32.064490 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdec76-cc72-442e-a941-229ee31bba89 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:32.081818 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:32.096838 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529f5db-8443-4165-9a6f-4349815f883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:32.097543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529f5db-8443-4165-9a6f-4349815f883b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:32.097871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529f5db-8443-4165-9a6f-4349815f883b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:32.102610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529f5db-8443-4165-9a6f-4349815f883b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:32.102610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529f5db-8443-4165-9a6f-4349815f883b None admin] RBAC: Adding query filter params (role.id=b1cf59e6d9dd49179551b98cee02776c, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=c653cb8c86534dc2b963f39f5e1d3e0d) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:32.102610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529f5db-8443-4165-9a6f-4349815f883b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:32.102610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529f5db-8443-4165-9a6f-4349815f883b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:32.103085 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63581b1-d2af-4d69-899d-4c524f9f6787 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:32.106432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 286/583] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:21:31 2022] GET /identity/v3/role_assignments?user.id=c653cb8c86534dc2b963f39f5e1d3e0d&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=b1cf59e6d9dd49179551b98cee02776c => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:32.107209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529f5db-8443-4165-9a6f-4349815f883b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:32.141530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:32.149022 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81024fc-6bd5-4d48-bedd-1b108b37f565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:32.149745 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81024fc-6bd5-4d48-bedd-1b108b37f565 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:32.150028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81024fc-6bd5-4d48-bedd-1b108b37f565 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:32.150322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81024fc-6bd5-4d48-bedd-1b108b37f565 None admin] PATH_INFO: `/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/eb70408fecfe41e0b2ea9a53c7ae0823/roles/b1cf59e6d9dd49179551b98cee02776c` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:32.167372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81024fc-6bd5-4d48-bedd-1b108b37f565 None admin] RBAC: Authorizing `identity:create_grant(project_id=d50a1cd322404bd4b0fa7a8c388dc217, user_id=eb70408fecfe41e0b2ea9a53c7ae0823, role_id=b1cf59e6d9dd49179551b98cee02776c)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:32.168781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81024fc-6bd5-4d48-bedd-1b108b37f565 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:32.227707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529f5db-8443-4165-9a6f-4349815f883b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:32.257021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 298/584] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:21:32 2022] PUT /identity/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/eb70408fecfe41e0b2ea9a53c7ae0823/roles/b1cf59e6d9dd49179551b98cee02776c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:21:32.257021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81024fc-6bd5-4d48-bedd-1b108b37f565 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:32.276661 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32999ce4-23cb-4836-920f-ec250e2a2262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:32.277555 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32999ce4-23cb-4836-920f-ec250e2a2262 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:32.277945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32999ce4-23cb-4836-920f-ec250e2a2262 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:32.278330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32999ce4-23cb-4836-920f-ec250e2a2262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:32.292254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32999ce4-23cb-4836-920f-ec250e2a2262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:32.294152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32999ce4-23cb-4836-920f-ec250e2a2262 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-32999ce4-23cb-4836-920f-ec250e2a2262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:32.311873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:32.313115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:32.314157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:32.314157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:32.314157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:32.318646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 287/585] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:32.319811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32999ce4-23cb-4836-920f-ec250e2a2262 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:32.417008 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:32.433529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81024fc-6bd5-4d48-bedd-1b108b37f565 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:32.439102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32999ce4-23cb-4836-920f-ec250e2a2262 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:32.470021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:32.480229 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c2130-590e-4cec-a67f-0345bf337453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:32.481031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c2130-590e-4cec-a67f-0345bf337453 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:32.481406 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c2130-590e-4cec-a67f-0345bf337453 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:32.481804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c2130-590e-4cec-a67f-0345bf337453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:32.482910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e2596-cb0e-456f-87d1-06678b9d5705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:32.483711 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e2596-cb0e-456f-87d1-06678b9d5705 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:32.484278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e2596-cb0e-456f-87d1-06678b9d5705 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:32.484697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e2596-cb0e-456f-87d1-06678b9d5705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:32.493843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c2130-590e-4cec-a67f-0345bf337453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:32.496039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c2130-590e-4cec-a67f-0345bf337453 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:32.498897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e2596-cb0e-456f-87d1-06678b9d5705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:32.501087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e2596-cb0e-456f-87d1-06678b9d5705 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-c88c2130-590e-4cec-a67f-0345bf337453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:32.515384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:32.516348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:32.517470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:32.517470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:32.517470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:32.517470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 299/586] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:32.518307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c2130-590e-4cec-a67f-0345bf337453 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-bc8e2596-cb0e-456f-87d1-06678b9d5705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:32.520333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:32.522429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:32.523397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:32.523397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:32.523397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:32.526142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 288/587] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:32.527236 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e2596-cb0e-456f-87d1-06678b9d5705 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:32.649882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e2596-cb0e-456f-87d1-06678b9d5705 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:32.653436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c2130-590e-4cec-a67f-0345bf337453 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:32.683124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:32.695176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18209a0-bb98-45a2-ae82-01cea7e266a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:32.695176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18209a0-bb98-45a2-ae82-01cea7e266a5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:32.695176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18209a0-bb98-45a2-ae82-01cea7e266a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:32.695176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18209a0-bb98-45a2-ae82-01cea7e266a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:32.695602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18209a0-bb98-45a2-ae82-01cea7e266a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:32.695602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18209a0-bb98-45a2-ae82-01cea7e266a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:32.695602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18209a0-bb98-45a2-ae82-01cea7e266a5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:32.699034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7bff0-0798-435e-965e-e0cd513af6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:32.699811 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7bff0-0798-435e-965e-e0cd513af6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:32.700234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7bff0-0798-435e-965e-e0cd513af6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:32.700648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7bff0-0798-435e-965e-e0cd513af6a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:32.701963 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7bff0-0798-435e-965e-e0cd513af6a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:32.702419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7bff0-0798-435e-965e-e0cd513af6a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:32.704764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7bff0-0798-435e-965e-e0cd513af6a2 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:32.706384 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 289/588] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:32.707839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18209a0-bb98-45a2-ae82-01cea7e266a5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:32.721423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 300/589] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:32.722704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7bff0-0798-435e-965e-e0cd513af6a2 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:32.781441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:32.826486 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18209a0-bb98-45a2-ae82-01cea7e266a5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:32.861961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7bff0-0798-435e-965e-e0cd513af6a2 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:32.866426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce780-5783-45b0-9daf-457a46602c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:32.867046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce780-5783-45b0-9daf-457a46602c44 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:32.867322 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce780-5783-45b0-9daf-457a46602c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:32.867594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce780-5783-45b0-9daf-457a46602c44 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:32.868239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ce780-5783-45b0-9daf-457a46602c44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:32.868544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ce780-5783-45b0-9daf-457a46602c44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:32.869972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ce780-5783-45b0-9daf-457a46602c44 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:32.882637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 290/590] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:32.883504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce780-5783-45b0-9daf-457a46602c44 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:32.903527 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b352172-7aa4-45f9-b177-5c82f0aa74a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:32.904521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b352172-7aa4-45f9-b177-5c82f0aa74a3 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:32.905044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b352172-7aa4-45f9-b177-5c82f0aa74a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:32.905535 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b352172-7aa4-45f9-b177-5c82f0aa74a3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:32.914254 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b352172-7aa4-45f9-b177-5c82f0aa74a3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:32.916165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b352172-7aa4-45f9-b177-5c82f0aa74a3 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-6b352172-7aa4-45f9-b177-5c82f0aa74a3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:32.929747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:32.930692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:32.931610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:32.931610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:32.931610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:32.931610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:32.931610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:32.931610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:32.931610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:32.931610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:32.931610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 04:21:32.931610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:32.934253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 301/591] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:32.935283 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b352172-7aa4-45f9-b177-5c82f0aa74a3 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:32.940928 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:32.991417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce780-5783-45b0-9daf-457a46602c44 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:33.031139 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87323c-15ba-402a-9bdf-fa1c7df7bc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:33.031777 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87323c-15ba-402a-9bdf-fa1c7df7bc3d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:33.032061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87323c-15ba-402a-9bdf-fa1c7df7bc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:33.032334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87323c-15ba-402a-9bdf-fa1c7df7bc3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:33.039779 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87323c-15ba-402a-9bdf-fa1c7df7bc3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:33.041277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87323c-15ba-402a-9bdf-fa1c7df7bc3d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:33.048832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:33.053047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b352172-7aa4-45f9-b177-5c82f0aa74a3 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1a87323c-15ba-402a-9bdf-fa1c7df7bc3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:33.054196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:33.055048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:33.055918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:33.055918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:33.055918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:33.055918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:33.055918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:33.055918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:33.055918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:33.055918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:33.055918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 291/592] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:33.056390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87323c-15ba-402a-9bdf-fa1c7df7bc3d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:33.094887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100ea20-b3db-45c4-919b-e49267bd9561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:33.095981 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ea20-b3db-45c4-919b-e49267bd9561 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:33.096462 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ea20-b3db-45c4-919b-e49267bd9561 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:33.096931 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ea20-b3db-45c4-919b-e49267bd9561 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:33.105284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100ea20-b3db-45c4-919b-e49267bd9561 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:33.107144 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100ea20-b3db-45c4-919b-e49267bd9561 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-b100ea20-b3db-45c4-919b-e49267bd9561 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:33.119298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:33.120204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:33.121143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:33.121143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:33.121143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:33.121143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:33.121143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:33.121143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:33.121143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:33.121143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:33.121143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 04:21:33.121143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:33.123730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 302/593] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:33.124793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100ea20-b3db-45c4-919b-e49267bd9561 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:33.167451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87323c-15ba-402a-9bdf-fa1c7df7bc3d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:33.182187 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:33.206140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c7c39-bf3d-4b34-861b-829f1859218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:33.206751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c7c39-bf3d-4b34-861b-829f1859218f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:33.207029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c7c39-bf3d-4b34-861b-829f1859218f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:33.207302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c7c39-bf3d-4b34-861b-829f1859218f None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:33.208101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c7c39-bf3d-4b34-861b-829f1859218f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:33.208468 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c7c39-bf3d-4b34-861b-829f1859218f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:33.210095 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c7c39-bf3d-4b34-861b-829f1859218f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:33.230460 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 292/594] 10.222.0.50 () {56 vars in 1139 bytes} [Sat Sep 17 04:21:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:33.231368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c7c39-bf3d-4b34-861b-829f1859218f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:33.236913 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100ea20-b3db-45c4-919b-e49267bd9561 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:33.276261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92735b0c-9ec7-412d-b5b1-9cca19440b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:33.277225 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735b0c-9ec7-412d-b5b1-9cca19440b44 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:33.277805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735b0c-9ec7-412d-b5b1-9cca19440b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:33.278287 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735b0c-9ec7-412d-b5b1-9cca19440b44 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:33.279181 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92735b0c-9ec7-412d-b5b1-9cca19440b44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:33.279767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92735b0c-9ec7-412d-b5b1-9cca19440b44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:33.281541 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92735b0c-9ec7-412d-b5b1-9cca19440b44 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:33.294857 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 303/595] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:33.296014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92735b0c-9ec7-412d-b5b1-9cca19440b44 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:33.319428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:33.343826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c7c39-bf3d-4b34-861b-829f1859218f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:33.380778 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da353b8-9348-4015-9a30-48a68a0b6f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:33.381744 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da353b8-9348-4015-9a30-48a68a0b6f9d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:33.382207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da353b8-9348-4015-9a30-48a68a0b6f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:33.383695 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da353b8-9348-4015-9a30-48a68a0b6f9d None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:33.384577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da353b8-9348-4015-9a30-48a68a0b6f9d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:33.385306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da353b8-9348-4015-9a30-48a68a0b6f9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:33.386874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da353b8-9348-4015-9a30-48a68a0b6f9d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:33.452761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 293/596] 10.222.0.50 () {56 vars in 1137 bytes} [Sat Sep 17 04:21:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:33.454373 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da353b8-9348-4015-9a30-48a68a0b6f9d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:33.473077 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92735b0c-9ec7-412d-b5b1-9cca19440b44 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:33.490367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:33.514821 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb64af-76de-44fb-be51-6a2348a7788b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:33.515704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb64af-76de-44fb-be51-6a2348a7788b None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:33.516157 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb64af-76de-44fb-be51-6a2348a7788b None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:33.516563 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb64af-76de-44fb-be51-6a2348a7788b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:33.530906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb64af-76de-44fb-be51-6a2348a7788b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:33.533450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb64af-76de-44fb-be51-6a2348a7788b None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-ffeb64af-76de-44fb-be51-6a2348a7788b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:33.554177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:33.555273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:33.556336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:33.556336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:33.556336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:33.558628 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 304/597] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:33.559650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb64af-76de-44fb-be51-6a2348a7788b None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:33.578001 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da353b8-9348-4015-9a30-48a68a0b6f9d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:33.625484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40769dfa-b89f-417b-9809-99dc492dc539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:33.626627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40769dfa-b89f-417b-9809-99dc492dc539 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:33.627436 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40769dfa-b89f-417b-9809-99dc492dc539 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:33.627853 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40769dfa-b89f-417b-9809-99dc492dc539 None admin] PATH_INFO: `/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/81ba9aba795f423a8ffabe419b64507a/roles/b1cf59e6d9dd49179551b98cee02776c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:33.641888 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:33.645419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40769dfa-b89f-417b-9809-99dc492dc539 None admin] RBAC: Authorizing `identity:create_grant(project_id=d50a1cd322404bd4b0fa7a8c388dc217, user_id=81ba9aba795f423a8ffabe419b64507a, role_id=b1cf59e6d9dd49179551b98cee02776c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:33.647985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40769dfa-b89f-417b-9809-99dc492dc539 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:33.676475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb64af-76de-44fb-be51-6a2348a7788b None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:33.713238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638749e-6d70-4f7f-85dd-6eceba8a3207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:33.713867 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638749e-6d70-4f7f-85dd-6eceba8a3207 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:33.714141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638749e-6d70-4f7f-85dd-6eceba8a3207 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:33.714410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638749e-6d70-4f7f-85dd-6eceba8a3207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:33.725209 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638749e-6d70-4f7f-85dd-6eceba8a3207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:33.726661 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638749e-6d70-4f7f-85dd-6eceba8a3207 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:33.734330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 294/598] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:21:33 2022] PUT /identity/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/81ba9aba795f423a8ffabe419b64507a/roles/b1cf59e6d9dd49179551b98cee02776c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:21:33.735152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40769dfa-b89f-417b-9809-99dc492dc539 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-b638749e-6d70-4f7f-85dd-6eceba8a3207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:33.752976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:33.754464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:33.755908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:33.755908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:33.755908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:33.759290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 305/599] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:33.765713 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638749e-6d70-4f7f-85dd-6eceba8a3207 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:33.832445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:33.857770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40769dfa-b89f-417b-9809-99dc492dc539 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:33.912280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638749e-6d70-4f7f-85dd-6eceba8a3207 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:33.941376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:33.950181 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfca97-a1d6-4bd8-af01-af0232796308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:33.950805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfca97-a1d6-4bd8-af01-af0232796308 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:33.951083 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfca97-a1d6-4bd8-af01-af0232796308 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:33.951352 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfca97-a1d6-4bd8-af01-af0232796308 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:33.952002 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfca97-a1d6-4bd8-af01-af0232796308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:33.952306 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfca97-a1d6-4bd8-af01-af0232796308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:33.952638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b0fdc-e7ba-4bd0-937f-c724b81b557e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:33.953348 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b0fdc-e7ba-4bd0-937f-c724b81b557e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:33.958658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b0fdc-e7ba-4bd0-937f-c724b81b557e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:33.958806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfca97-a1d6-4bd8-af01-af0232796308 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:33.958945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b0fdc-e7ba-4bd0-937f-c724b81b557e None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:33.958945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b0fdc-e7ba-4bd0-937f-c724b81b557e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:33.958945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b0fdc-e7ba-4bd0-937f-c724b81b557e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:33.958945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b0fdc-e7ba-4bd0-937f-c724b81b557e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:33.967269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 306/600] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:33.972388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfca97-a1d6-4bd8-af01-af0232796308 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:33.985793 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 295/601] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:33.991929 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b0fdc-e7ba-4bd0-937f-c724b81b557e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:34.084370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfca97-a1d6-4bd8-af01-af0232796308 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:34.132576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b0fdc-e7ba-4bd0-937f-c724b81b557e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:34.162260 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee08e1e-9a1c-40a7-8c7d-116480951a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:34.162918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee08e1e-9a1c-40a7-8c7d-116480951a92 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:34.163198 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee08e1e-9a1c-40a7-8c7d-116480951a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:34.163468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee08e1e-9a1c-40a7-8c7d-116480951a92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:34.174336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee08e1e-9a1c-40a7-8c7d-116480951a92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:34.175774 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee08e1e-9a1c-40a7-8c7d-116480951a92 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-6ee08e1e-9a1c-40a7-8c7d-116480951a92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:34.200186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:34.201380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:34.202432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:34.202432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:34.202432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:34.202432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:34.202432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:34.202432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:34.202432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:34.202432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:34.202874 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 307/602] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:34.211974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee08e1e-9a1c-40a7-8c7d-116480951a92 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:34.218882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c058855-d275-4fee-bf24-ee23563af845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:34.219526 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c058855-d275-4fee-bf24-ee23563af845 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:34.219794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c058855-d275-4fee-bf24-ee23563af845 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:34.220101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c058855-d275-4fee-bf24-ee23563af845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:34.234305 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c058855-d275-4fee-bf24-ee23563af845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:34.235771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c058855-d275-4fee-bf24-ee23563af845 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:34.238329 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7c058855-d275-4fee-bf24-ee23563af845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:34.251837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:34.252748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:34.253650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:34.253650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:34.253650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:34.253650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:34.253650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:34.253650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:34.253650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:34.253650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:34.253650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 296/603] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:34.259394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c058855-d275-4fee-bf24-ee23563af845 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:34.311416 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:34.400359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee08e1e-9a1c-40a7-8c7d-116480951a92 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:34.423167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c058855-d275-4fee-bf24-ee23563af845 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:34.435853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c09c8f-f3bf-49d2-93ee-9523ae62864d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:34.436493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c09c8f-f3bf-49d2-93ee-9523ae62864d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:34.436773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c09c8f-f3bf-49d2-93ee-9523ae62864d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:34.437071 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c09c8f-f3bf-49d2-93ee-9523ae62864d None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:34.437770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c09c8f-f3bf-49d2-93ee-9523ae62864d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:34.438080 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c09c8f-f3bf-49d2-93ee-9523ae62864d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:34.439523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c09c8f-f3bf-49d2-93ee-9523ae62864d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:34.452565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 308/604] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:34.458911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffb975-072c-4d28-a060-fb1ca73ab68f None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:34.459198 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffb975-072c-4d28-a060-fb1ca73ab68f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:34.459475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffb975-072c-4d28-a060-fb1ca73ab68f None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:34.461053 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 309/605] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:34.461768 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffb975-072c-4d28-a060-fb1ca73ab68f None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:34.468927 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d4b5a-1e46-4c5c-a024-69e8397f58dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:34.469615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4b5a-1e46-4c5c-a024-69e8397f58dc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:34.469887 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4b5a-1e46-4c5c-a024-69e8397f58dc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:34.470155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4b5a-1e46-4c5c-a024-69e8397f58dc None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:34.470950 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d4b5a-1e46-4c5c-a024-69e8397f58dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:34.471254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d4b5a-1e46-4c5c-a024-69e8397f58dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:34.472776 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d4b5a-1e46-4c5c-a024-69e8397f58dc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:34.486692 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 297/606] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:34.488106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51912-c1c9-41e0-abc3-a76242d6eb1f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:34.488393 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51912-c1c9-41e0-abc3-a76242d6eb1f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:34.488664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51912-c1c9-41e0-abc3-a76242d6eb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:34.508960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ced51912-c1c9-41e0-abc3-a76242d6eb1f None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:34.510564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ced51912-c1c9-41e0-abc3-a76242d6eb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:34.567506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:34.576107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffb975-072c-4d28-a060-fb1ca73ab68f None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:34.578621 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:34.582467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 298/607] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:34.583577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced51912-c1c9-41e0-abc3-a76242d6eb1f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:34.613767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344ba54-d76a-4775-b349-b9bc0f67a8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:34.614966 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344ba54-d76a-4775-b349-b9bc0f67a8b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:34.615249 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344ba54-d76a-4775-b349-b9bc0f67a8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:34.615516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344ba54-d76a-4775-b349-b9bc0f67a8b2 None admin] PATH_INFO: `/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/60f50529feb44143b0627131d9aab8d0/roles/b1cf59e6d9dd49179551b98cee02776c` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:34.631879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344ba54-d76a-4775-b349-b9bc0f67a8b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d50a1cd322404bd4b0fa7a8c388dc217, user_id=60f50529feb44143b0627131d9aab8d0, role_id=b1cf59e6d9dd49179551b98cee02776c)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:34.633360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344ba54-d76a-4775-b349-b9bc0f67a8b2 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:34.696392 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced51912-c1c9-41e0-abc3-a76242d6eb1f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:34.734204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515ad19-fab7-4118-b7c9-afe26ff83342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:34.735252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515ad19-fab7-4118-b7c9-afe26ff83342 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:34.735717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515ad19-fab7-4118-b7c9-afe26ff83342 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:34.736181 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515ad19-fab7-4118-b7c9-afe26ff83342 None admin] PATH_INFO: `/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/6469c8860be943168b67ea7fa28bf19d/roles/b1cf59e6d9dd49179551b98cee02776c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:34.740642 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 310/608] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:21:34 2022] PUT /identity/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/60f50529feb44143b0627131d9aab8d0/roles/b1cf59e6d9dd49179551b98cee02776c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:21:34.753254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515ad19-fab7-4118-b7c9-afe26ff83342 None admin] RBAC: Authorizing `identity:create_grant(project_id=d50a1cd322404bd4b0fa7a8c388dc217, user_id=6469c8860be943168b67ea7fa28bf19d, role_id=b1cf59e6d9dd49179551b98cee02776c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:34.755289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515ad19-fab7-4118-b7c9-afe26ff83342 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:34.818133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d7c4-6a6d-46a5-a65d-5dab3e2442fa None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:34.818825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d7c4-6a6d-46a5-a65d-5dab3e2442fa None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:34.819287 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d7c4-6a6d-46a5-a65d-5dab3e2442fa None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:34.820835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 311/609] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:21:34.826780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1c6b3-2876-4873-9d2f-ef4a6725a187 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:34.827336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1c6b3-2876-4873-9d2f-ef4a6725a187 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:34.827820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1c6b3-2876-4873-9d2f-ef4a6725a187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:34.854313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-39a1c6b3-2876-4873-9d2f-ef4a6725a187 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:34.855526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-39a1c6b3-2876-4873-9d2f-ef4a6725a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:34.856616 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 299/610] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:21:34 2022] PUT /identity/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/6469c8860be943168b67ea7fa28bf19d/roles/b1cf59e6d9dd49179551b98cee02776c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:21:34.893749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515ad19-fab7-4118-b7c9-afe26ff83342 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:34.967966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:34.977970 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 312/611] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 04:21:35.033153 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515ad19-fab7-4118-b7c9-afe26ff83342 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:35.076630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839b7ea-8867-416e-873e-0f0c9fd5695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:35.077311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839b7ea-8867-416e-873e-0f0c9fd5695e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:35.077590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839b7ea-8867-416e-873e-0f0c9fd5695e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:35.077903 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839b7ea-8867-416e-873e-0f0c9fd5695e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:35.093583 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839b7ea-8867-416e-873e-0f0c9fd5695e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8839b7ea-8867-416e-873e-0f0c9fd5695e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:35.098551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:35.099627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:35.100808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:35.100808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:35.100808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:35.100808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:35.100808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:35.100808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:35.100808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:35.100808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:35.100808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:35.100808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:35.100808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:35.100808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:35.100808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 300/612] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:35.105918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1c6b3-2876-4873-9d2f-ef4a6725a187 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:35.210430 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:35.228131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1c6b3-2876-4873-9d2f-ef4a6725a187 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:35.266707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6447a-6aec-46f9-b8bd-f38c76480e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:35.276555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6447a-6aec-46f9-b8bd-f38c76480e2e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:35.276555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6447a-6aec-46f9-b8bd-f38c76480e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:35.276555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6447a-6aec-46f9-b8bd-f38c76480e2e None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:35.276555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6447a-6aec-46f9-b8bd-f38c76480e2e None admin] RBAC: Adding query filter params (name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:35.276555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6447a-6aec-46f9-b8bd-f38c76480e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:35.276555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6447a-6aec-46f9-b8bd-f38c76480e2e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:35.279469 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 313/613] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:35.284716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839b7ea-8867-416e-873e-0f0c9fd5695e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:35.292302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6447a-6aec-46f9-b8bd-f38c76480e2e None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:35.405920 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839b7ea-8867-416e-873e-0f0c9fd5695e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:35.421350 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:35.443962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748675f-a4eb-4d8d-983a-90eddde825ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:35.444632 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748675f-a4eb-4d8d-983a-90eddde825ca None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:35.444906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748675f-a4eb-4d8d-983a-90eddde825ca None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:35.445327 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748675f-a4eb-4d8d-983a-90eddde825ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:35.457416 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748675f-a4eb-4d8d-983a-90eddde825ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:35.460216 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748675f-a4eb-4d8d-983a-90eddde825ca None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-4748675f-a4eb-4d8d-983a-90eddde825ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:35.477484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:35.478685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:35.479735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:35.479735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:35.479735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:35.479735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 301/614] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:35.484902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748675f-a4eb-4d8d-983a-90eddde825ca None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:35.566785 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6447a-6aec-46f9-b8bd-f38c76480e2e None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:35.597315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748675f-a4eb-4d8d-983a-90eddde825ca None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:35.604704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a4229-99f0-453b-8423-3e753f86efb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:35.605537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a4229-99f0-453b-8423-3e753f86efb8 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:35.605919 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a4229-99f0-453b-8423-3e753f86efb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:35.606308 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a4229-99f0-453b-8423-3e753f86efb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:35.633619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a4229-99f0-453b-8423-3e753f86efb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:35.636125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899f8b5-63c3-42ed-a053-881ef7d5e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:35.636815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899f8b5-63c3-42ed-a053-881ef7d5e9ef None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:35.637186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899f8b5-63c3-42ed-a053-881ef7d5e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:35.637526 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899f8b5-63c3-42ed-a053-881ef7d5e9ef None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:35.638242 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899f8b5-63c3-42ed-a053-881ef7d5e9ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:35.638615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899f8b5-63c3-42ed-a053-881ef7d5e9ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-826a4229-99f0-453b-8423-3e753f86efb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:35.639746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:35.640817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:35.641853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:35.641853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:35.641853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:35.641853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:35.641853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:35.641853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:35.641853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:35.641853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:35.641853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:35.641853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:35.641853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:35.641853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:35.642609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899f8b5-63c3-42ed-a053-881ef7d5e9ef None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:35.643384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 314/615] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:35.649449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a4229-99f0-453b-8423-3e753f86efb8 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:35.655910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 302/616] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:35.662815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899f8b5-63c3-42ed-a053-881ef7d5e9ef None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:35.667578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:35.680734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:35.836768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899f8b5-63c3-42ed-a053-881ef7d5e9ef None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:35.849149 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a4229-99f0-453b-8423-3e753f86efb8 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:35.902651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b716-5d6f-4781-91e3-bca59a5c8136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:35.903287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b716-5d6f-4781-91e3-bca59a5c8136 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:35.903564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b716-5d6f-4781-91e3-bca59a5c8136 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:35.903834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b716-5d6f-4781-91e3-bca59a5c8136 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:35.913703 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828bd00-fd32-4d0c-8559-5e1cee5a5fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:35.914322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828bd00-fd32-4d0c-8559-5e1cee5a5fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:35.914600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828bd00-fd32-4d0c-8559-5e1cee5a5fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:35.914874 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828bd00-fd32-4d0c-8559-5e1cee5a5fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:35.915547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828bd00-fd32-4d0c-8559-5e1cee5a5fb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:35.915858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828bd00-fd32-4d0c-8559-5e1cee5a5fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:35.917265 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828bd00-fd32-4d0c-8559-5e1cee5a5fb7 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:35.920403 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306b716-5d6f-4781-91e3-bca59a5c8136 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:35.921875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306b716-5d6f-4781-91e3-bca59a5c8136 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:35.935734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 315/617] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:35.936763 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828bd00-fd32-4d0c-8559-5e1cee5a5fb7 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-4306b716-5d6f-4781-91e3-bca59a5c8136 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:35.943394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:35.944400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:35.945545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:35.945545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:35.945545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:35.945545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:35.945545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:35.945545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:35.945545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:35.945545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:35.945545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 04:21:35.945545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:35.947485 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 303/618] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:21:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:35.958957 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b716-5d6f-4781-91e3-bca59a5c8136 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:36.022193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:36.059413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828bd00-fd32-4d0c-8559-5e1cee5a5fb7 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:36.094512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a487c-c0f4-49f3-b706-7571197fb4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:36.095058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a487c-c0f4-49f3-b706-7571197fb4ec None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:36.095329 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a487c-c0f4-49f3-b706-7571197fb4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:36.095592 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a487c-c0f4-49f3-b706-7571197fb4ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:36.107829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a487c-c0f4-49f3-b706-7571197fb4ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:36.109308 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a487c-c0f4-49f3-b706-7571197fb4ec None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-d03a487c-c0f4-49f3-b706-7571197fb4ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:36.125542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:36.126537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:36.127407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:36.127407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:36.127407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:36.130746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 316/619] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:36.133079 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a487c-c0f4-49f3-b706-7571197fb4ec None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:36.174698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:36.254456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a487c-c0f4-49f3-b706-7571197fb4ec None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:36.256276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b716-5d6f-4781-91e3-bca59a5c8136 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:36.281714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:36.291523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c87dd-b729-4d64-b8ff-da2792a84000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:36.292466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c87dd-b729-4d64-b8ff-da2792a84000 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:36.292916 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c87dd-b729-4d64-b8ff-da2792a84000 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:36.293469 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c87dd-b729-4d64-b8ff-da2792a84000 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:36.294333 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c87dd-b729-4d64-b8ff-da2792a84000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:36.294871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c87dd-b729-4d64-b8ff-da2792a84000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:36.296411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c87dd-b729-4d64-b8ff-da2792a84000 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:36.313182 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 317/620] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:36.315317 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c87dd-b729-4d64-b8ff-da2792a84000 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:36.338987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572798fd-51e7-4567-b0de-0374c331b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:36.339564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572798fd-51e7-4567-b0de-0374c331b696 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:36.339915 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572798fd-51e7-4567-b0de-0374c331b696 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:36.340263 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572798fd-51e7-4567-b0de-0374c331b696 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:36.341098 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572798fd-51e7-4567-b0de-0374c331b696 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:36.341473 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572798fd-51e7-4567-b0de-0374c331b696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:36.343133 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572798fd-51e7-4567-b0de-0374c331b696 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:36.381717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 304/621] 10.222.0.50 () {56 vars in 1135 bytes} [Sat Sep 17 04:21:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:36.387061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572798fd-51e7-4567-b0de-0374c331b696 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:36.424259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c87dd-b729-4d64-b8ff-da2792a84000 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:36.464803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddca12-38f6-43b1-b254-d4fdea50dfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:36.465908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddca12-38f6-43b1-b254-d4fdea50dfcf None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:36.466374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddca12-38f6-43b1-b254-d4fdea50dfcf None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:36.466814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddca12-38f6-43b1-b254-d4fdea50dfcf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:36.475441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddca12-38f6-43b1-b254-d4fdea50dfcf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:36.477478 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddca12-38f6-43b1-b254-d4fdea50dfcf None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-26ddca12-38f6-43b1-b254-d4fdea50dfcf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:36.490603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:36.491567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:36.492512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:36.492512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:36.492512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:36.492512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:36.492512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:36.492512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:36.492512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:36.492512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:36.492512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:21:36.492512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:36.494753 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 318/622] 10.222.0.50 () {56 vars in 1093 bytes} [Sat Sep 17 04:21:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:36.500691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddca12-38f6-43b1-b254-d4fdea50dfcf None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:36.577383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:36.581330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572798fd-51e7-4567-b0de-0374c331b696 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:36.616230 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:36.625672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d5adc-e6e9-40ce-89f5-27ad4b0e3a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:36.626305 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d5adc-e6e9-40ce-89f5-27ad4b0e3a91 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:36.626585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d5adc-e6e9-40ce-89f5-27ad4b0e3a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:36.626855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d5adc-e6e9-40ce-89f5-27ad4b0e3a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:36.642913 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddca12-38f6-43b1-b254-d4fdea50dfcf None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:36.643061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d5adc-e6e9-40ce-89f5-27ad4b0e3a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:36.645936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d5adc-e6e9-40ce-89f5-27ad4b0e3a91 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0f0d5adc-e6e9-40ce-89f5-27ad4b0e3a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:36.667865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:36.668862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:36.670445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:36.670445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:36.670445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:36.670445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 305/623] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:36.670674 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f623d-9e2a-40f1-ae0b-2b34c8e99dff None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:36.670889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f623d-9e2a-40f1-ae0b-2b34c8e99dff None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:36.671072 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f623d-9e2a-40f1-ae0b-2b34c8e99dff None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:36.677525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 306/624] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:36.678445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f623d-9e2a-40f1-ae0b-2b34c8e99dff None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:36.683358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7cabf-5e28-41e5-a0ac-462caf524eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:36.684204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7cabf-5e28-41e5-a0ac-462caf524eca None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:36.684678 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7cabf-5e28-41e5-a0ac-462caf524eca None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:36.685219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7cabf-5e28-41e5-a0ac-462caf524eca None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:36.686151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7cabf-5e28-41e5-a0ac-462caf524eca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:36.686659 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7cabf-5e28-41e5-a0ac-462caf524eca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:36.688390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7cabf-5e28-41e5-a0ac-462caf524eca None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:36.715184 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 319/625] 10.222.0.50 () {56 vars in 1133 bytes} [Sat Sep 17 04:21:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:36.716965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84711-5edc-4f72-bdcd-d3f88fea30f7 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:36.717485 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84711-5edc-4f72-bdcd-d3f88fea30f7 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:36.718002 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84711-5edc-4f72-bdcd-d3f88fea30f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:36.736959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-54b84711-5edc-4f72-bdcd-d3f88fea30f7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:36.738480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-54b84711-5edc-4f72-bdcd-d3f88fea30f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:36.789361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f623d-9e2a-40f1-ae0b-2b34c8e99dff None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:36.811159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 320/626] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:36.812368 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b84711-5edc-4f72-bdcd-d3f88fea30f7 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:36.841946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b3226-71db-4ba2-8188-5346e91aeee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:36.842426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:36.842624 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b3226-71db-4ba2-8188-5346e91aeee5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:36.842916 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b3226-71db-4ba2-8188-5346e91aeee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:36.843195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b3226-71db-4ba2-8188-5346e91aeee5 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:36.844113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b3226-71db-4ba2-8188-5346e91aeee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:36.844305 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b3226-71db-4ba2-8188-5346e91aeee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:36.845822 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b3226-71db-4ba2-8188-5346e91aeee5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:36.876411 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 307/627] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:36.882226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b3226-71db-4ba2-8188-5346e91aeee5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:36.921764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b84711-5edc-4f72-bdcd-d3f88fea30f7 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:36.957138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:36.974667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e3e06-8456-4803-a040-f667e6d01f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:36.979612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e3e06-8456-4803-a040-f667e6d01f80 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:36.979612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e3e06-8456-4803-a040-f667e6d01f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:36.979612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e3e06-8456-4803-a040-f667e6d01f80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:37.029014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b3226-71db-4ba2-8188-5346e91aeee5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:37.066453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef769f-1fc5-4db5-86fd-8b3f5164fc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:37.067630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef769f-1fc5-4db5-86fd-8b3f5164fc5c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:37.068532 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef769f-1fc5-4db5-86fd-8b3f5164fc5c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:37.068862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef769f-1fc5-4db5-86fd-8b3f5164fc5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:37.080550 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef769f-1fc5-4db5-86fd-8b3f5164fc5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:37.082732 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e3e06-8456-4803-a040-f667e6d01f80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:37.084407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e3e06-8456-4803-a040-f667e6d01f80 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:37.086841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef769f-1fc5-4db5-86fd-8b3f5164fc5c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3fef769f-1fc5-4db5-86fd-8b3f5164fc5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:37.108032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:37.109231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:37.110184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:37.110184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:37.110184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:37.110184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:37.110184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:37.110184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:37.110184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:37.110184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:37.113639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 308/628] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:37.120242 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef769f-1fc5-4db5-86fd-8b3f5164fc5c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:37.139295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:37.286804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 321/629] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:37.287913 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e3e06-8456-4803-a040-f667e6d01f80 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:37.310839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:37.315113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef769f-1fc5-4db5-86fd-8b3f5164fc5c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:37.354786 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bb95a-d274-47e4-ac40-1cb86796fe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:37.355528 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bb95a-d274-47e4-ac40-1cb86796fe84 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:37.355831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bb95a-d274-47e4-ac40-1cb86796fe84 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:37.356078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bb95a-d274-47e4-ac40-1cb86796fe84 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:37.356779 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bb95a-d274-47e4-ac40-1cb86796fe84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:37.357097 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bb95a-d274-47e4-ac40-1cb86796fe84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:37.358543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bb95a-d274-47e4-ac40-1cb86796fe84 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:37.371327 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 309/630] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:37.376291 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bb95a-d274-47e4-ac40-1cb86796fe84 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:37.397250 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e3e06-8456-4803-a040-f667e6d01f80 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:37.429270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:37.438010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966821f1-cbd2-46c9-96ba-b156b4083fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:37.442761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966821f1-cbd2-46c9-96ba-b156b4083fcb None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:37.442761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966821f1-cbd2-46c9-96ba-b156b4083fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:37.442761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966821f1-cbd2-46c9-96ba-b156b4083fcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:37.449989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966821f1-cbd2-46c9-96ba-b156b4083fcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-966821f1-cbd2-46c9-96ba-b156b4083fcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:37.455849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:37.456741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:37.457648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:37.457648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:37.457648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:37.457648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:37.457648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:37.457648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:37.457648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:37.457648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:37.457648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:37.457648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:37.457648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:37.457648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:37.459057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 322/631] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:37.460879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254a001-8e17-4372-bea6-46820aac08e7 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:37.461264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254a001-8e17-4372-bea6-46820aac08e7 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:37.461607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254a001-8e17-4372-bea6-46820aac08e7 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:37.463155 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 323/632] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:37.464013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254a001-8e17-4372-bea6-46820aac08e7 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:37.491656 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bb95a-d274-47e4-ac40-1cb86796fe84 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:37.530451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08702faf-71c2-42d7-b106-54417383dc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:37.531077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702faf-71c2-42d7-b106-54417383dc1b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:37.531355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702faf-71c2-42d7-b106-54417383dc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:37.531638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702faf-71c2-42d7-b106-54417383dc1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:37.543027 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08702faf-71c2-42d7-b106-54417383dc1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:37.544421 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08702faf-71c2-42d7-b106-54417383dc1b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-08702faf-71c2-42d7-b106-54417383dc1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:37.558897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:37.559847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:37.560758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:37.560758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:37.560758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:37.560758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 310/633] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:37.561194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08702faf-71c2-42d7-b106-54417383dc1b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:37.573222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254a001-8e17-4372-bea6-46820aac08e7 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:37.575545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:37.607643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853df19-d52a-4b28-a2f5-8af6cd86e594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:37.608299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853df19-d52a-4b28-a2f5-8af6cd86e594 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:37.608579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853df19-d52a-4b28-a2f5-8af6cd86e594 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:37.608853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853df19-d52a-4b28-a2f5-8af6cd86e594 None admin] PATH_INFO: `/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/c653cb8c86534dc2b963f39f5e1d3e0d/roles/b1cf59e6d9dd49179551b98cee02776c` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:37.623510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853df19-d52a-4b28-a2f5-8af6cd86e594 None admin] RBAC: Authorizing `identity:create_grant(project_id=d50a1cd322404bd4b0fa7a8c388dc217, user_id=c653cb8c86534dc2b963f39f5e1d3e0d, role_id=b1cf59e6d9dd49179551b98cee02776c)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:37.624939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853df19-d52a-4b28-a2f5-8af6cd86e594 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:37.658559 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08702faf-71c2-42d7-b106-54417383dc1b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:37.676253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 324/634] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:21:37 2022] PUT /identity/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/c653cb8c86534dc2b963f39f5e1d3e0d/roles/b1cf59e6d9dd49179551b98cee02776c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:21:37.678379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ee913-dd5f-4f45-a207-4b398315fb59 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:37.678658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ee913-dd5f-4f45-a207-4b398315fb59 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:37.678929 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ee913-dd5f-4f45-a207-4b398315fb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:37.695482 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a55f9-de04-460b-a2f9-12c2f2a863eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:37.696433 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a55f9-de04-460b-a2f9-12c2f2a863eb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:37.699088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a55f9-de04-460b-a2f9-12c2f2a863eb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:37.699088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a55f9-de04-460b-a2f9-12c2f2a863eb None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:37.699088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a55f9-de04-460b-a2f9-12c2f2a863eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:37.699088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a55f9-de04-460b-a2f9-12c2f2a863eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:37.700314 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a55f9-de04-460b-a2f9-12c2f2a863eb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:37.705543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ce6ee913-dd5f-4f45-a207-4b398315fb59 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:37.706794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ce6ee913-dd5f-4f45-a207-4b398315fb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:37.717691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 311/635] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:37.717691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f1532-9c3a-4323-9c73-47668cf6ac2c None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:37.717691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f1532-9c3a-4323-9c73-47668cf6ac2c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:37.717691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f1532-9c3a-4323-9c73-47668cf6ac2c None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:37.718974 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 312/636] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:37.720011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f1532-9c3a-4323-9c73-47668cf6ac2c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:37.746004 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:37.790392 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 325/637] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:37.791803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ee913-dd5f-4f45-a207-4b398315fb59 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:37.819832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:37.841134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f1532-9c3a-4323-9c73-47668cf6ac2c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:37.887585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec1621-81ff-4c0a-b8ea-d3a5ef69c143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:37.888349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec1621-81ff-4c0a-b8ea-d3a5ef69c143 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:37.888686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec1621-81ff-4c0a-b8ea-d3a5ef69c143 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:37.888963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec1621-81ff-4c0a-b8ea-d3a5ef69c143 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:37.889657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec1621-81ff-4c0a-b8ea-d3a5ef69c143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:37.889963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec1621-81ff-4c0a-b8ea-d3a5ef69c143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:37.891462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec1621-81ff-4c0a-b8ea-d3a5ef69c143 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:37.905165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 313/638] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:37.906402 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ea06a-d03c-46e8-bd88-c28a50cea6ce None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:37.906691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ea06a-d03c-46e8-bd88-c28a50cea6ce None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:37.906960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ea06a-d03c-46e8-bd88-c28a50cea6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:37.929372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ee913-dd5f-4f45-a207-4b398315fb59 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:37.932961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9e8ea06a-d03c-46e8-bd88-c28a50cea6ce None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:37.934347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9e8ea06a-d03c-46e8-bd88-c28a50cea6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:37.974622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad37ab1-2a41-4749-9c6f-a9f8947ff564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:37.975498 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad37ab1-2a41-4749-9c6f-a9f8947ff564 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:37.975919 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad37ab1-2a41-4749-9c6f-a9f8947ff564 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:37.976326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad37ab1-2a41-4749-9c6f-a9f8947ff564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:37.989962 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad37ab1-2a41-4749-9c6f-a9f8947ff564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:37.992583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad37ab1-2a41-4749-9c6f-a9f8947ff564 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-6ad37ab1-2a41-4749-9c6f-a9f8947ff564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:38.012577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:38.013760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:38.014911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:38.014911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:38.014911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:38.015077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 314/639] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:38.016789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 326/640] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:38.025218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ea06a-d03c-46e8-bd88-c28a50cea6ce None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:38.029973 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad37ab1-2a41-4749-9c6f-a9f8947ff564 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:38.073683 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:38.095268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:38.142779 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ea06a-d03c-46e8-bd88-c28a50cea6ce None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:38.187870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43d670-9791-4b25-aa34-be0f5c6aeb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:38.188917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d670-9791-4b25-aa34-be0f5c6aeb14 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:38.189229 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d670-9791-4b25-aa34-be0f5c6aeb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:38.189508 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d670-9791-4b25-aa34-be0f5c6aeb14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:38.192096 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad37ab1-2a41-4749-9c6f-a9f8947ff564 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:38.198266 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43d670-9791-4b25-aa34-be0f5c6aeb14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:38.199746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43d670-9791-4b25-aa34-be0f5c6aeb14 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0c43d670-9791-4b25-aa34-be0f5c6aeb14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:38.216227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:38.217227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:38.218124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:38.218124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:38.218124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:38.218124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:38.218124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:38.218124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:38.218124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:38.218124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:38.218124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 315/641] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:38.224288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43d670-9791-4b25-aa34-be0f5c6aeb14 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:38.235354 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8b43a-68b0-4e4d-8bbe-9cd3db9907a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:38.235959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b43a-68b0-4e4d-8bbe-9cd3db9907a3 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:38.236235 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b43a-68b0-4e4d-8bbe-9cd3db9907a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:38.236505 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b43a-68b0-4e4d-8bbe-9cd3db9907a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:38.237229 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8b43a-68b0-4e4d-8bbe-9cd3db9907a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:38.237532 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8b43a-68b0-4e4d-8bbe-9cd3db9907a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:38.239575 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8b43a-68b0-4e4d-8bbe-9cd3db9907a3 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:38.252298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 327/642] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:38.253211 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8b43a-68b0-4e4d-8bbe-9cd3db9907a3 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:38.342058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:38.360265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43d670-9791-4b25-aa34-be0f5c6aeb14 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:38.361842 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8b43a-68b0-4e4d-8bbe-9cd3db9907a3 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:38.388082 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:38.399244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dc987-1bb6-4e3a-a46a-d263f5beb6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:38.399441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b8301-cdc0-484b-ad7f-f2c1e760d1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:38.399875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dc987-1bb6-4e3a-a46a-d263f5beb6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:38.399981 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8301-cdc0-484b-ad7f-f2c1e760d1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:38.400161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dc987-1bb6-4e3a-a46a-d263f5beb6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:38.400275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8301-cdc0-484b-ad7f-f2c1e760d1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:38.400424 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dc987-1bb6-4e3a-a46a-d263f5beb6d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:38.400516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8301-cdc0-484b-ad7f-f2c1e760d1c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:38.401120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b8301-cdc0-484b-ad7f-f2c1e760d1c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:38.401426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b8301-cdc0-484b-ad7f-f2c1e760d1c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:38.403028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b8301-cdc0-484b-ad7f-f2c1e760d1c5 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:38.410472 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dc987-1bb6-4e3a-a46a-d263f5beb6d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:38.421276 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 328/643] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:38.421276 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b8301-cdc0-484b-ad7f-f2c1e760d1c5 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-429dc987-1bb6-4e3a-a46a-d263f5beb6d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:38.421525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:38.422450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:38.423342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:38.423342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:38.423342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:38.423342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:38.423342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:38.423342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:38.423342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:38.423342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:38.423342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:38.423342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:38.423342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:38.423342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:38.423342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 316/644] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:38.423342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dc987-1bb6-4e3a-a46a-d263f5beb6d7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:38.527382 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dc987-1bb6-4e3a-a46a-d263f5beb6d7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:38.529017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b8301-cdc0-484b-ad7f-f2c1e760d1c5 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:38.561619 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aefb9-411c-490b-80ab-d15636b1781e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:38.562266 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aefb9-411c-490b-80ab-d15636b1781e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:38.562591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aefb9-411c-490b-80ab-d15636b1781e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:38.562857 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aefb9-411c-490b-80ab-d15636b1781e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:38.563115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e3ec7-435a-44a3-97e7-8b3793014be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:38.563739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3ec7-435a-44a3-97e7-8b3793014be0 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:38.564018 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3ec7-435a-44a3-97e7-8b3793014be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:38.564291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3ec7-435a-44a3-97e7-8b3793014be0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:38.571829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e3ec7-435a-44a3-97e7-8b3793014be0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:38.573260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45aefb9-411c-490b-80ab-d15636b1781e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:38.573387 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e3ec7-435a-44a3-97e7-8b3793014be0 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:38.575855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-f45aefb9-411c-490b-80ab-d15636b1781e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:38.577997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:38.578923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:38.579931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:38.579931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:38.579931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:38.579931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:38.579931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:38.579931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:38.579931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:38.579931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:38.579931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:38.579931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:38.579931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:38.579931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:38.584412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 317/645] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:38.585686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aefb9-411c-490b-80ab-d15636b1781e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-426e3ec7-435a-44a3-97e7-8b3793014be0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:38.587547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:38.599897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:38.600864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:38.600864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:38.600864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:38.600864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:38.600864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:38.600864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:38.600864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:38.600864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:38.600864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 04:21:38.600864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:38.600864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 329/646] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:38.600864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e3ec7-435a-44a3-97e7-8b3793014be0 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:38.644708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:38.697773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e3ec7-435a-44a3-97e7-8b3793014be0 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:38.703279 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aefb9-411c-490b-80ab-d15636b1781e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:38.734301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2e37-5df2-4ae0-b3d9-22bf50498bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:38.734915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2e37-5df2-4ae0-b3d9-22bf50498bad None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:38.735195 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2e37-5df2-4ae0-b3d9-22bf50498bad None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:38.735467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2e37-5df2-4ae0-b3d9-22bf50498bad None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:38.736134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2e37-5df2-4ae0-b3d9-22bf50498bad None admin] RBAC: Adding query filter params (name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:38.736440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2e37-5df2-4ae0-b3d9-22bf50498bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:38.737856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2e37-5df2-4ae0-b3d9-22bf50498bad None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:38.744129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dae03-7f34-4b81-80ab-1adfda1fc872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:38.744726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dae03-7f34-4b81-80ab-1adfda1fc872 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:38.745020 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dae03-7f34-4b81-80ab-1adfda1fc872 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:38.745309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dae03-7f34-4b81-80ab-1adfda1fc872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:38.746036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dae03-7f34-4b81-80ab-1adfda1fc872 None admin] RBAC: Adding query filter params (role.id=b1cf59e6d9dd49179551b98cee02776c, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=eb70408fecfe41e0b2ea9a53c7ae0823) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:38.746338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dae03-7f34-4b81-80ab-1adfda1fc872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:38.747763 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dae03-7f34-4b81-80ab-1adfda1fc872 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:38.752686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 330/647] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:38.752686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2e37-5df2-4ae0-b3d9-22bf50498bad None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:38.754022 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 318/648] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:21:38 2022] GET /identity/v3/role_assignments?user.id=eb70408fecfe41e0b2ea9a53c7ae0823&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=b1cf59e6d9dd49179551b98cee02776c => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:38.755332 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dae03-7f34-4b81-80ab-1adfda1fc872 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:38.836515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:38.886892 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2e37-5df2-4ae0-b3d9-22bf50498bad None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:38.896005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dae03-7f34-4b81-80ab-1adfda1fc872 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:38.906891 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:38.935918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9568825-a802-409d-9eb9-c65d20be221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:38.936972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9568825-a802-409d-9eb9-c65d20be221a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:38.937142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd4db9-a1b7-459b-803d-4853db48462c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:38.937352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9568825-a802-409d-9eb9-c65d20be221a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:38.937553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9568825-a802-409d-9eb9-c65d20be221a None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:38.937650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd4db9-a1b7-459b-803d-4853db48462c None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:38.937902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd4db9-a1b7-459b-803d-4853db48462c None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:38.938172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd4db9-a1b7-459b-803d-4853db48462c None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:38.938278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9568825-a802-409d-9eb9-c65d20be221a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:38.938584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9568825-a802-409d-9eb9-c65d20be221a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:38.938828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd4db9-a1b7-459b-803d-4853db48462c None admin] RBAC: Adding query filter params (name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:38.939128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd4db9-a1b7-459b-803d-4853db48462c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:38.940031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9568825-a802-409d-9eb9-c65d20be221a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:38.940478 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd4db9-a1b7-459b-803d-4853db48462c None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:38.956533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 331/649] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:38.958461 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd4db9-a1b7-459b-803d-4853db48462c None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:38.962792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 319/650] 10.222.0.50 () {56 vars in 1137 bytes} [Sat Sep 17 04:21:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:38.968369 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9568825-a802-409d-9eb9-c65d20be221a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:39.084749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd4db9-a1b7-459b-803d-4853db48462c None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:39.092374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9568825-a802-409d-9eb9-c65d20be221a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:39.109674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:39.120558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c831115-555f-4c42-88d5-b43eecb444da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:39.121223 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c831115-555f-4c42-88d5-b43eecb444da None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:39.121503 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c831115-555f-4c42-88d5-b43eecb444da None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:39.131563 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c831115-555f-4c42-88d5-b43eecb444da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:39.133304 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c831115-555f-4c42-88d5-b43eecb444da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:39.135023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c831115-555f-4c42-88d5-b43eecb444da None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:39.140173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505fb08-51d2-42f5-9d4d-a94dd5cc328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:39.141086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505fb08-51d2-42f5-9d4d-a94dd5cc328d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:39.141671 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505fb08-51d2-42f5-9d4d-a94dd5cc328d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:39.142602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505fb08-51d2-42f5-9d4d-a94dd5cc328d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:39.154478 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505fb08-51d2-42f5-9d4d-a94dd5cc328d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-4c831115-555f-4c42-88d5-b43eecb444da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:39.155881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:39.156786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:39.157706 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:39.157706 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:39.157706 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:39.159507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505fb08-51d2-42f5-9d4d-a94dd5cc328d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:39.167919 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 332/651] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:39.168815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c831115-555f-4c42-88d5-b43eecb444da None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-f505fb08-51d2-42f5-9d4d-a94dd5cc328d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:39.178323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:39.179251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:39.180149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:39.180149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:39.180149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:39.180149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 320/652] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:39.180767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505fb08-51d2-42f5-9d4d-a94dd5cc328d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:39.206525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:39.291915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c831115-555f-4c42-88d5-b43eecb444da None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:39.307741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505fb08-51d2-42f5-9d4d-a94dd5cc328d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:39.337623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf51b7-8da9-43b1-ba5e-6141b6556605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:39.338395 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf51b7-8da9-43b1-ba5e-6141b6556605 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:39.338751 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf51b7-8da9-43b1-ba5e-6141b6556605 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:39.339033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf51b7-8da9-43b1-ba5e-6141b6556605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:39.346414 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbf2c6-acd9-4337-81d7-ed26c94be4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:39.347268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbf2c6-acd9-4337-81d7-ed26c94be4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:39.347721 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbf2c6-acd9-4337-81d7-ed26c94be4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:39.348274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbf2c6-acd9-4337-81d7-ed26c94be4b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:39.349734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbf2c6-acd9-4337-81d7-ed26c94be4b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:39.350228 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbf2c6-acd9-4337-81d7-ed26c94be4b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:39.352301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbf2c6-acd9-4337-81d7-ed26c94be4b3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:39.370019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 321/653] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:39.371661 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbf2c6-acd9-4337-81d7-ed26c94be4b3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:39.399261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:39.427222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf51b7-8da9-43b1-ba5e-6141b6556605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:39.428951 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf51b7-8da9-43b1-ba5e-6141b6556605 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:39.471381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:39.494487 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbf2c6-acd9-4337-81d7-ed26c94be4b3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:39.531981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe11b03-7bbf-4923-a57b-d81b0da242f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:39.532935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe11b03-7bbf-4923-a57b-d81b0da242f3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:39.533429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe11b03-7bbf-4923-a57b-d81b0da242f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:39.533876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe11b03-7bbf-4923-a57b-d81b0da242f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:39.534690 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe11b03-7bbf-4923-a57b-d81b0da242f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:39.535184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe11b03-7bbf-4923-a57b-d81b0da242f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:39.540921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 333/654] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:39.540921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf51b7-8da9-43b1-ba5e-6141b6556605 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:39.541673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe11b03-7bbf-4923-a57b-d81b0da242f3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:39.555348 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 322/655] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:39.556537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe11b03-7bbf-4923-a57b-d81b0da242f3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:39.619954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:39.644711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf51b7-8da9-43b1-ba5e-6141b6556605 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:39.665327 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe11b03-7bbf-4923-a57b-d81b0da242f3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:39.683471 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf64ba-52a9-416b-a2b8-62c3fadda4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:39.684384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf64ba-52a9-416b-a2b8-62c3fadda4ef None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:39.684871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf64ba-52a9-416b-a2b8-62c3fadda4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:39.685339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf64ba-52a9-416b-a2b8-62c3fadda4ef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:39.693719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf64ba-52a9-416b-a2b8-62c3fadda4ef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:39.695426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf64ba-52a9-416b-a2b8-62c3fadda4ef None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:39.703542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fea70f-84a2-4385-8075-56d3f4806310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:39.704253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fea70f-84a2-4385-8075-56d3f4806310 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:39.704593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fea70f-84a2-4385-8075-56d3f4806310 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:39.704923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fea70f-84a2-4385-8075-56d3f4806310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:39.713300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-7aaf64ba-52a9-416b-a2b8-62c3fadda4ef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:39.713522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:39.714411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:39.715339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:39.715339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:39.715339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:39.715339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:39.715339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:39.715339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:39.715339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:39.715339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:39.715339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 04:21:39.715339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:39.718154 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fea70f-84a2-4385-8075-56d3f4806310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:39.719577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fea70f-84a2-4385-8075-56d3f4806310 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:39.724584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 334/656] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:39.724584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf64ba-52a9-416b-a2b8-62c3fadda4ef None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e6fea70f-84a2-4385-8075-56d3f4806310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:39.748164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:39.749213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:39.750107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:39.750107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:39.750107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:39.753098 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 323/657] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:39.754183 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fea70f-84a2-4385-8075-56d3f4806310 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:39.851571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf64ba-52a9-416b-a2b8-62c3fadda4ef None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:39.891302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63565af-2ee9-4a23-8712-391a04cec446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:39.892464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63565af-2ee9-4a23-8712-391a04cec446 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:39.893267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63565af-2ee9-4a23-8712-391a04cec446 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:39.893964 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63565af-2ee9-4a23-8712-391a04cec446 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:39.898242 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:39.900080 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fea70f-84a2-4385-8075-56d3f4806310 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:39.905221 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63565af-2ee9-4a23-8712-391a04cec446 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:39.906851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63565af-2ee9-4a23-8712-391a04cec446 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-d63565af-2ee9-4a23-8712-391a04cec446 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:39.921989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:39.923127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:39.924274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:39.924274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:39.924274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:39.924274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:39.924274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:39.924274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:39.924274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:39.924274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:39.924274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 04:21:39.924274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:39.927597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 335/658] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:39.929204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63565af-2ee9-4a23-8712-391a04cec446 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:39.940525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfde0df-2e54-4f5c-a34f-22fb69db992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:39.941332 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfde0df-2e54-4f5c-a34f-22fb69db992c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:39.941454 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfde0df-2e54-4f5c-a34f-22fb69db992c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:39.941692 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfde0df-2e54-4f5c-a34f-22fb69db992c None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:39.943071 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfde0df-2e54-4f5c-a34f-22fb69db992c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:39.943460 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfde0df-2e54-4f5c-a34f-22fb69db992c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:39.944942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfde0df-2e54-4f5c-a34f-22fb69db992c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:39.963434 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 324/659] 10.222.0.50 () {56 vars in 1137 bytes} [Sat Sep 17 04:21:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:39.964496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfde0df-2e54-4f5c-a34f-22fb69db992c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:40.015989 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:40.042922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63565af-2ee9-4a23-8712-391a04cec446 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:40.078145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad23489-0881-47ac-b377-684a5fc29eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:40.078754 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad23489-0881-47ac-b377-684a5fc29eee None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:40.079033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad23489-0881-47ac-b377-684a5fc29eee None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:40.079130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfde0df-2e54-4f5c-a34f-22fb69db992c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:40.079320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad23489-0881-47ac-b377-684a5fc29eee None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:40.080220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad23489-0881-47ac-b377-684a5fc29eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:40.080713 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad23489-0881-47ac-b377-684a5fc29eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:40.083046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad23489-0881-47ac-b377-684a5fc29eee None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:40.102399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 336/660] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:40.102399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b9e1c-43d7-4c7f-8ede-9fa031907570 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:40.102399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b9e1c-43d7-4c7f-8ede-9fa031907570 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:40.102399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b9e1c-43d7-4c7f-8ede-9fa031907570 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:40.103099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 337/661] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:40.103828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b9e1c-43d7-4c7f-8ede-9fa031907570 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:40.123670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80e478-e832-4072-86cd-922b346c97c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:40.124282 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80e478-e832-4072-86cd-922b346c97c7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:40.124564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80e478-e832-4072-86cd-922b346c97c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:40.124839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80e478-e832-4072-86cd-922b346c97c7 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:40.125600 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80e478-e832-4072-86cd-922b346c97c7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:40.125907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80e478-e832-4072-86cd-922b346c97c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:40.127345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80e478-e832-4072-86cd-922b346c97c7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:40.155764 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 325/662] 10.222.0.50 () {56 vars in 1139 bytes} [Sat Sep 17 04:21:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:40.161827 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80e478-e832-4072-86cd-922b346c97c7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:40.168023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:40.215585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b9e1c-43d7-4c7f-8ede-9fa031907570 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:40.251580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc2ea3-3502-4fe4-bb16-c544f3b810bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:40.252165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc2ea3-3502-4fe4-bb16-c544f3b810bf None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:40.252441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc2ea3-3502-4fe4-bb16-c544f3b810bf None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:40.252764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc2ea3-3502-4fe4-bb16-c544f3b810bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:40.266965 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80e478-e832-4072-86cd-922b346c97c7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:40.274275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:40.302563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a082d-6d42-47a4-b5ac-02a7f5eedb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:40.303188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a082d-6d42-47a4-b5ac-02a7f5eedb27 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:40.303454 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a082d-6d42-47a4-b5ac-02a7f5eedb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:40.303724 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a082d-6d42-47a4-b5ac-02a7f5eedb27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:40.310875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a082d-6d42-47a4-b5ac-02a7f5eedb27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:40.312325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a082d-6d42-47a4-b5ac-02a7f5eedb27 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-691a082d-6d42-47a4-b5ac-02a7f5eedb27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:40.324330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:40.329225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:40.330118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:40.330118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:40.330118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:40.330118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:40.330118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:40.330118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:40.330118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:40.330118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:40.330118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 326/663] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:40.330610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc2ea3-3502-4fe4-bb16-c544f3b810bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:40.331032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b3d4-fa4d-4a90-b5d0-c10d48dbc07f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:40.331032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b3d4-fa4d-4a90-b5d0-c10d48dbc07f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:40.331032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b3d4-fa4d-4a90-b5d0-c10d48dbc07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:40.331245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc2ea3-3502-4fe4-bb16-c544f3b810bf None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:40.347326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0ad2b3d4-fa4d-4a90-b5d0-c10d48dbc07f None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:40.349268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0ad2b3d4-fa4d-4a90-b5d0-c10d48dbc07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:40.390504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:40.425530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 327/664] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:40.427766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2b3d4-fa4d-4a90-b5d0-c10d48dbc07f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:40.450681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 338/665] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:40.451834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc2ea3-3502-4fe4-bb16-c544f3b810bf None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:40.563119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:40.569015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc2ea3-3502-4fe4-bb16-c544f3b810bf None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:40.572541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2b3d4-fa4d-4a90-b5d0-c10d48dbc07f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:40.610595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91098be2-52f1-4690-9a94-d1e11003c47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:40.611231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91098be2-52f1-4690-9a94-d1e11003c47a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:40.611473 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91098be2-52f1-4690-9a94-d1e11003c47a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:40.611742 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91098be2-52f1-4690-9a94-d1e11003c47a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:40.614612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fde7d6-03f9-45b2-98b2-249b5e3ff644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:40.616341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fde7d6-03f9-45b2-98b2-249b5e3ff644 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:40.616824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fde7d6-03f9-45b2-98b2-249b5e3ff644 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:40.617345 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fde7d6-03f9-45b2-98b2-249b5e3ff644 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:40.618223 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fde7d6-03f9-45b2-98b2-249b5e3ff644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:40.618765 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fde7d6-03f9-45b2-98b2-249b5e3ff644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:40.621070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fde7d6-03f9-45b2-98b2-249b5e3ff644 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:40.635182 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 339/666] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:40.635827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fde7d6-03f9-45b2-98b2-249b5e3ff644 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:40.657667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:40.694946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91098be2-52f1-4690-9a94-d1e11003c47a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:40.696825 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91098be2-52f1-4690-9a94-d1e11003c47a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:40.762199 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fde7d6-03f9-45b2-98b2-249b5e3ff644 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:40.799379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03c5b2-1b76-4bc2-a174-bc4bb388c79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:40.800004 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c5b2-1b76-4bc2-a174-bc4bb388c79a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:40.800283 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c5b2-1b76-4bc2-a174-bc4bb388c79a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:40.800542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c5b2-1b76-4bc2-a174-bc4bb388c79a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:40.801594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:40.808574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 328/667] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:40.814125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91098be2-52f1-4690-9a94-d1e11003c47a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:40.816604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03c5b2-1b76-4bc2-a174-bc4bb388c79a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:40.818328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03c5b2-1b76-4bc2-a174-bc4bb388c79a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-8c03c5b2-1b76-4bc2-a174-bc4bb388c79a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:40.833791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:40.834780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:40.835650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:40.835650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:40.835650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:40.835650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 340/668] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:40.836445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03c5b2-1b76-4bc2-a174-bc4bb388c79a None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:40.908616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:40.920621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91098be2-52f1-4690-9a94-d1e11003c47a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:40.943942 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03c5b2-1b76-4bc2-a174-bc4bb388c79a None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:40.957196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad3ca2-0042-4d32-ad71-c54acc32f465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:40.958515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad3ca2-0042-4d32-ad71-c54acc32f465 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:40.959037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad3ca2-0042-4d32-ad71-c54acc32f465 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:40.959253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad3ca2-0042-4d32-ad71-c54acc32f465 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:40.960007 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad3ca2-0042-4d32-ad71-c54acc32f465 None admin] RBAC: Adding query filter params (role.id=b1cf59e6d9dd49179551b98cee02776c, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=81ba9aba795f423a8ffabe419b64507a) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:40.960319 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad3ca2-0042-4d32-ad71-c54acc32f465 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:40.961848 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad3ca2-0042-4d32-ad71-c54acc32f465 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:40.977221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 329/669] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:21:40 2022] GET /identity/v3/role_assignments?user.id=81ba9aba795f423a8ffabe419b64507a&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=b1cf59e6d9dd49179551b98cee02776c => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:40.978521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad3ca2-0042-4d32-ad71-c54acc32f465 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:40.992804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e2c3-8ba2-4c67-bae7-306f25f80100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:40.994464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e2c3-8ba2-4c67-bae7-306f25f80100 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:40.994970 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e2c3-8ba2-4c67-bae7-306f25f80100 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:40.995466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e2c3-8ba2-4c67-bae7-306f25f80100 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:41.013521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039e2c3-8ba2-4c67-bae7-306f25f80100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-8039e2c3-8ba2-4c67-bae7-306f25f80100 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:41.021912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:41.022891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:41.023719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:41.023719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:41.023719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:41.023719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:41.023719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:41.023719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:41.023719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:41.023719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:41.023719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:41.023719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:41.023719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:41.023719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:41.026912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 341/670] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:41.027965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e2c3-8ba2-4c67-bae7-306f25f80100 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:41.060926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:41.123216 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad3ca2-0042-4d32-ad71-c54acc32f465 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:41.143550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e2c3-8ba2-4c67-bae7-306f25f80100 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:41.168514 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532b654-c725-461d-ae0f-ed29031cb198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:41.169371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532b654-c725-461d-ae0f-ed29031cb198 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:41.169721 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532b654-c725-461d-ae0f-ed29031cb198 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:41.169994 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532b654-c725-461d-ae0f-ed29031cb198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:41.182715 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532b654-c725-461d-ae0f-ed29031cb198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:41.183333 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:41.184127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532b654-c725-461d-ae0f-ed29031cb198 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:41.192890 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90949872-9bea-43c2-ad2f-5109a74c9c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:41.193643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949872-9bea-43c2-ad2f-5109a74c9c16 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:41.193921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949872-9bea-43c2-ad2f-5109a74c9c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:41.194241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949872-9bea-43c2-ad2f-5109a74c9c16 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:41.194891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90949872-9bea-43c2-ad2f-5109a74c9c16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:41.195195 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90949872-9bea-43c2-ad2f-5109a74c9c16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:41.196565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90949872-9bea-43c2-ad2f-5109a74c9c16 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-5532b654-c725-461d-ae0f-ed29031cb198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:41.202232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:41.205159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:41.206165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:41.206165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:41.206165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:41.206165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 330/671] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:41.206165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532b654-c725-461d-ae0f-ed29031cb198 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:41.208670 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 342/672] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:41.210023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c357907-659d-4f15-8c27-3738d3bb9c6b None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:41.210292 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c357907-659d-4f15-8c27-3738d3bb9c6b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:41.210569 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c357907-659d-4f15-8c27-3738d3bb9c6b None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:41.211772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 343/673] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:41.212480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c357907-659d-4f15-8c27-3738d3bb9c6b None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:41.322132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532b654-c725-461d-ae0f-ed29031cb198 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:41.326994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c357907-659d-4f15-8c27-3738d3bb9c6b None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:41.338715 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:41.360793 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f5205-7bd2-489e-a830-d66ca5e6b690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:41.361161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3eea67-8d3a-46aa-b0ad-9301afa5ff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:41.361590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eea67-8d3a-46aa-b0ad-9301afa5ff13 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:41.361665 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f5205-7bd2-489e-a830-d66ca5e6b690 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:41.361734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eea67-8d3a-46aa-b0ad-9301afa5ff13 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:41.361815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f5205-7bd2-489e-a830-d66ca5e6b690 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:41.362029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eea67-8d3a-46aa-b0ad-9301afa5ff13 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:41.362122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f5205-7bd2-489e-a830-d66ca5e6b690 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:41.362581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3eea67-8d3a-46aa-b0ad-9301afa5ff13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:41.362684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f5205-7bd2-489e-a830-d66ca5e6b690 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:41.362882 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3eea67-8d3a-46aa-b0ad-9301afa5ff13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:41.362985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f5205-7bd2-489e-a830-d66ca5e6b690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:41.364400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3eea67-8d3a-46aa-b0ad-9301afa5ff13 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:41.364496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f5205-7bd2-489e-a830-d66ca5e6b690 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:41.376286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 331/674] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:41.382130 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 344/675] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:41.382130 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbdca3-9561-4317-af40-f6ba446fd7ae None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:41.382130 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbdca3-9561-4317-af40-f6ba446fd7ae None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:41.382130 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbdca3-9561-4317-af40-f6ba446fd7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:41.382500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f5205-7bd2-489e-a830-d66ca5e6b690 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:41.398920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-bacbdca3-9561-4317-af40-f6ba446fd7ae None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:41.400146 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-bacbdca3-9561-4317-af40-f6ba446fd7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:41.448343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:41.471454 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 345/676] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:41.472561 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbdca3-9561-4317-af40-f6ba446fd7ae None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:41.493017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f5205-7bd2-489e-a830-d66ca5e6b690 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:41.526250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b13eac-9d67-4b3c-88e7-8cf16685187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:41.526874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b13eac-9d67-4b3c-88e7-8cf16685187f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:41.527147 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b13eac-9d67-4b3c-88e7-8cf16685187f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:41.527410 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b13eac-9d67-4b3c-88e7-8cf16685187f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:41.534795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b13eac-9d67-4b3c-88e7-8cf16685187f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:41.536342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b13eac-9d67-4b3c-88e7-8cf16685187f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-19b13eac-9d67-4b3c-88e7-8cf16685187f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:41.547631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:41.548536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:41.549466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:41.549466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:41.549466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:41.549466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:41.549466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:41.549466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:41.549466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:41.549466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:41.554516 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 332/677] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:41.555368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b13eac-9d67-4b3c-88e7-8cf16685187f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:41.596425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbdca3-9561-4317-af40-f6ba446fd7ae None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:41.604325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:41.633717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edc16c-6642-4de3-bb66-f3450128253e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:41.634910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edc16c-6642-4de3-bb66-f3450128253e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:41.635375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edc16c-6642-4de3-bb66-f3450128253e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:41.635830 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edc16c-6642-4de3-bb66-f3450128253e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:41.647172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edc16c-6642-4de3-bb66-f3450128253e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:41.648862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edc16c-6642-4de3-bb66-f3450128253e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-56edc16c-6642-4de3-bb66-f3450128253e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:41.664796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:41.665782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:41.666683 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:41.666683 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:41.666683 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:41.668759 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 346/678] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:41.669744 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edc16c-6642-4de3-bb66-f3450128253e None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:41.684638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b13eac-9d67-4b3c-88e7-8cf16685187f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:41.707995 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:41.723054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d10ed-3861-4001-aad0-edc3e598ac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:41.723958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d10ed-3861-4001-aad0-edc3e598ac26 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:41.724070 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d10ed-3861-4001-aad0-edc3e598ac26 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:41.725324 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d10ed-3861-4001-aad0-edc3e598ac26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:41.731594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d10ed-3861-4001-aad0-edc3e598ac26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:41.733148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d10ed-3861-4001-aad0-edc3e598ac26 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-615d10ed-3861-4001-aad0-edc3e598ac26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:41.745918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:41.746837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:41.747734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:41.747734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:41.747734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:41.747734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:41.747734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:41.747734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:41.747734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:41.747734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:41.747734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 333/679] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:41.748213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d10ed-3861-4001-aad0-edc3e598ac26 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:41.794792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edc16c-6642-4de3-bb66-f3450128253e None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:41.835251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967e5f6-a1eb-49c1-bd72-ceed966583f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:41.835984 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967e5f6-a1eb-49c1-bd72-ceed966583f8 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:41.836245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967e5f6-a1eb-49c1-bd72-ceed966583f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:41.836513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967e5f6-a1eb-49c1-bd72-ceed966583f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:41.837227 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967e5f6-a1eb-49c1-bd72-ceed966583f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:41.837524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967e5f6-a1eb-49c1-bd72-ceed966583f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:41.838944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967e5f6-a1eb-49c1-bd72-ceed966583f8 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:41.855793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 347/680] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:41.855793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967e5f6-a1eb-49c1-bd72-ceed966583f8 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:41.857174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:41.865036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d10ed-3861-4001-aad0-edc3e598ac26 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:41.902717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af8d62-b291-443a-b652-b8099f61a4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:41.903256 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8d62-b291-443a-b652-b8099f61a4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:41.903521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8d62-b291-443a-b652-b8099f61a4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:41.903793 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8d62-b291-443a-b652-b8099f61a4c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:41.904438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af8d62-b291-443a-b652-b8099f61a4c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:41.904741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af8d62-b291-443a-b652-b8099f61a4c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:41.906146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af8d62-b291-443a-b652-b8099f61a4c2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:41.918378 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 334/681] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:41.919180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af8d62-b291-443a-b652-b8099f61a4c2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:41.961650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:41.971121 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967e5f6-a1eb-49c1-bd72-ceed966583f8 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:42.010840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440be665-353c-4372-8ae0-16c3e1d12e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:42.011468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440be665-353c-4372-8ae0-16c3e1d12e6d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:42.011744 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440be665-353c-4372-8ae0-16c3e1d12e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:42.012015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440be665-353c-4372-8ae0-16c3e1d12e6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:42.023396 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440be665-353c-4372-8ae0-16c3e1d12e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-440be665-353c-4372-8ae0-16c3e1d12e6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:42.028151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:42.029374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:42.030219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:42.030219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:42.030219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:42.030219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:42.030219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:42.030219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:42.030219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:42.030219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:42.030219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:42.030219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:42.030219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:42.030219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:42.030869 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af8d62-b291-443a-b652-b8099f61a4c2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:42.030943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 348/682] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:21:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:42.030943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440be665-353c-4372-8ae0-16c3e1d12e6d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:42.072697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4958b43-ad50-4a46-bd66-607e6a8631f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:42.073949 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4958b43-ad50-4a46-bd66-607e6a8631f7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:42.074226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4958b43-ad50-4a46-bd66-607e6a8631f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:42.074811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4958b43-ad50-4a46-bd66-607e6a8631f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:42.075658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4958b43-ad50-4a46-bd66-607e6a8631f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:42.075965 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4958b43-ad50-4a46-bd66-607e6a8631f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:42.077411 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4958b43-ad50-4a46-bd66-607e6a8631f7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:42.093411 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 335/683] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:42.093411 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4958b43-ad50-4a46-bd66-607e6a8631f7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:42.105882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:42.142936 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440be665-353c-4372-8ae0-16c3e1d12e6d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:42.183247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7314dbf-3fc4-400a-819c-34a82d2ec00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:42.183856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7314dbf-3fc4-400a-819c-34a82d2ec00f None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:42.184133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7314dbf-3fc4-400a-819c-34a82d2ec00f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:42.184400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7314dbf-3fc4-400a-819c-34a82d2ec00f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:42.185147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7314dbf-3fc4-400a-819c-34a82d2ec00f None admin] RBAC: Adding query filter params (role.id=b1cf59e6d9dd49179551b98cee02776c, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=60f50529feb44143b0627131d9aab8d0) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:42.185447 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7314dbf-3fc4-400a-819c-34a82d2ec00f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:42.186868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7314dbf-3fc4-400a-819c-34a82d2ec00f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:42.193035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 349/684] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:21:42 2022] GET /identity/v3/role_assignments?user.id=60f50529feb44143b0627131d9aab8d0&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=b1cf59e6d9dd49179551b98cee02776c => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:42.193819 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7314dbf-3fc4-400a-819c-34a82d2ec00f None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:42.209074 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4958b43-ad50-4a46-bd66-607e6a8631f7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:42.241435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:42.261344 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85ed13-67a6-46a3-840e-67cb6db34404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:42.262970 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85ed13-67a6-46a3-840e-67cb6db34404 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:42.263454 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85ed13-67a6-46a3-840e-67cb6db34404 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:42.264271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85ed13-67a6-46a3-840e-67cb6db34404 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:42.278070 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85ed13-67a6-46a3-840e-67cb6db34404 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:42.280873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85ed13-67a6-46a3-840e-67cb6db34404 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1d85ed13-67a6-46a3-840e-67cb6db34404 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:42.298360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:42.299367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:42.300292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:42.300292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:42.300292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:42.300292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:42.300292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:42.300292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:42.300292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:42.300292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:42.300292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 04:21:42.300292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:42.308210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 336/685] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:21:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:42.308210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85ed13-67a6-46a3-840e-67cb6db34404 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:42.344152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7314dbf-3fc4-400a-819c-34a82d2ec00f None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:42.389921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50f73c-ea37-4af0-8079-400d955c6d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:42.390819 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50f73c-ea37-4af0-8079-400d955c6d8e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:42.391106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50f73c-ea37-4af0-8079-400d955c6d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:42.391379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50f73c-ea37-4af0-8079-400d955c6d8e None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:42.392253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50f73c-ea37-4af0-8079-400d955c6d8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:42.392872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50f73c-ea37-4af0-8079-400d955c6d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:42.394351 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50f73c-ea37-4af0-8079-400d955c6d8e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:42.407061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 350/686] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:42.407706 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50f73c-ea37-4af0-8079-400d955c6d8e None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:42.414835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:42.444081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85ed13-67a6-46a3-840e-67cb6db34404 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:42.489845 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa9ae3-77a9-4ea9-bce8-fae6cec066de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:42.490748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa9ae3-77a9-4ea9-bce8-fae6cec066de None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:42.491172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa9ae3-77a9-4ea9-bce8-fae6cec066de None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:42.491575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa9ae3-77a9-4ea9-bce8-fae6cec066de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:42.492441 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa9ae3-77a9-4ea9-bce8-fae6cec066de None admin] RBAC: Adding query filter params (role.id=b1cf59e6d9dd49179551b98cee02776c, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=6469c8860be943168b67ea7fa28bf19d) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:42.492882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa9ae3-77a9-4ea9-bce8-fae6cec066de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:42.494719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa9ae3-77a9-4ea9-bce8-fae6cec066de None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:42.497954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:42.513313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 337/687] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:21:42 2022] GET /identity/v3/role_assignments?user.id=6469c8860be943168b67ea7fa28bf19d&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=b1cf59e6d9dd49179551b98cee02776c => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:42.513313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa9ae3-77a9-4ea9-bce8-fae6cec066de None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:42.541760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50f73c-ea37-4af0-8079-400d955c6d8e None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:42.608827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696318f-7bff-4ee4-8ad0-5355e56cbd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:42.609477 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696318f-7bff-4ee4-8ad0-5355e56cbd2d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:42.609750 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696318f-7bff-4ee4-8ad0-5355e56cbd2d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:42.610016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696318f-7bff-4ee4-8ad0-5355e56cbd2d None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:42.610749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696318f-7bff-4ee4-8ad0-5355e56cbd2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:42.611051 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696318f-7bff-4ee4-8ad0-5355e56cbd2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:42.612492 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696318f-7bff-4ee4-8ad0-5355e56cbd2d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:42.654078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 351/688] 10.222.0.50 () {56 vars in 1135 bytes} [Sat Sep 17 04:21:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:42.656718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696318f-7bff-4ee4-8ad0-5355e56cbd2d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:42.719418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa9ae3-77a9-4ea9-bce8-fae6cec066de None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:42.774256 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f2a56-be3c-4bd9-bd90-a8758202a1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:42.775254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f2a56-be3c-4bd9-bd90-a8758202a1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:42.775717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f2a56-be3c-4bd9-bd90-a8758202a1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:42.776190 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f2a56-be3c-4bd9-bd90-a8758202a1c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:42.784234 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:42.790157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f2a56-be3c-4bd9-bd90-a8758202a1c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:42.791951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f2a56-be3c-4bd9-bd90-a8758202a1c2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-c86f2a56-be3c-4bd9-bd90-a8758202a1c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:42.807459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:42.808445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:42.809359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:42.809359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:42.809359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:42.815765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 338/689] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:42.817346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f2a56-be3c-4bd9-bd90-a8758202a1c2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:42.831329 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696318f-7bff-4ee4-8ad0-5355e56cbd2d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:42.873918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da308ee-7c6a-4283-ae5e-68030034d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:42.874663 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da308ee-7c6a-4283-ae5e-68030034d6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:42.875689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da308ee-7c6a-4283-ae5e-68030034d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:42.876038 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da308ee-7c6a-4283-ae5e-68030034d6c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:42.881743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:42.924855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f2a56-be3c-4bd9-bd90-a8758202a1c2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:42.955332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da308ee-7c6a-4283-ae5e-68030034d6c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:42.956970 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da308ee-7c6a-4283-ae5e-68030034d6c2 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:42.961040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611179f-38b0-4fc2-8c4a-17b8159495c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:42.961907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611179f-38b0-4fc2-8c4a-17b8159495c8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:42.962390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611179f-38b0-4fc2-8c4a-17b8159495c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:42.962877 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611179f-38b0-4fc2-8c4a-17b8159495c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:42.963719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611179f-38b0-4fc2-8c4a-17b8159495c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:42.964257 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611179f-38b0-4fc2-8c4a-17b8159495c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:42.965859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611179f-38b0-4fc2-8c4a-17b8159495c8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:42.983252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 339/690] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:42.984926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611179f-38b0-4fc2-8c4a-17b8159495c8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:43.074410 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:43.094594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 352/691] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 04:21:43.100462 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da308ee-7c6a-4283-ae5e-68030034d6c2 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:43.149243 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611179f-38b0-4fc2-8c4a-17b8159495c8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:43.194382 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b0fba-173f-4c8a-a358-1736022c8935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:43.195606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b0fba-173f-4c8a-a358-1736022c8935 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:43.197340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b0fba-173f-4c8a-a358-1736022c8935 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:43.197824 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b0fba-173f-4c8a-a358-1736022c8935 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:43.201334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:43.210337 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b0fba-173f-4c8a-a358-1736022c8935 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:43.211847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b0fba-173f-4c8a-a358-1736022c8935 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-c70b0fba-173f-4c8a-a358-1736022c8935 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:43.236445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:43.237452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:43.239872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:43.239872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:43.239872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:43.239872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:43.239872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:43.239872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:43.239872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:43.239872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:43.239872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:21:43.239872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:43.239872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 340/692] 10.222.0.50 () {56 vars in 1093 bytes} [Sat Sep 17 04:21:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:43.246805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b0fba-173f-4c8a-a358-1736022c8935 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:43.341133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da308ee-7c6a-4283-ae5e-68030034d6c2 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:43.383362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816468-d317-49d3-9351-ab7965ba9dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:43.383991 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816468-d317-49d3-9351-ab7965ba9dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:43.384357 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816468-d317-49d3-9351-ab7965ba9dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:43.384893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816468-d317-49d3-9351-ab7965ba9dc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:43.396721 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816468-d317-49d3-9351-ab7965ba9dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:43.398719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816468-d317-49d3-9351-ab7965ba9dc2 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-fa816468-d317-49d3-9351-ab7965ba9dc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:43.418353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:43.421172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:43.422105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:43.422105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:43.422105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:43.422274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b0fba-173f-4c8a-a358-1736022c8935 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:43.422356 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 353/693] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:43.422356 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba2383-8e33-4ba5-80dc-560ccae569f9 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:43.422356 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba2383-8e33-4ba5-80dc-560ccae569f9 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:43.422356 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba2383-8e33-4ba5-80dc-560ccae569f9 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:43.427686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 354/694] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:43.427686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba2383-8e33-4ba5-80dc-560ccae569f9 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:43.439589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:43.474520 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64f682-2a0a-42e2-aa54-fcdd0c64f27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:43.475132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64f682-2a0a-42e2-aa54-fcdd0c64f27c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:43.475404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64f682-2a0a-42e2-aa54-fcdd0c64f27c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:43.481013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64f682-2a0a-42e2-aa54-fcdd0c64f27c None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:43.481244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64f682-2a0a-42e2-aa54-fcdd0c64f27c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:43.481939 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64f682-2a0a-42e2-aa54-fcdd0c64f27c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:43.483576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64f682-2a0a-42e2-aa54-fcdd0c64f27c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:43.503042 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 341/695] 10.222.0.50 () {56 vars in 1133 bytes} [Sat Sep 17 04:21:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:43.504741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52483da-072f-483c-adbf-ec4037f288d1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:43.505444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52483da-072f-483c-adbf-ec4037f288d1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:43.505652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52483da-072f-483c-adbf-ec4037f288d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:43.524577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d52483da-072f-483c-adbf-ec4037f288d1 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:43.525784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d52483da-072f-483c-adbf-ec4037f288d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:43.533125 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:43.551318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba2383-8e33-4ba5-80dc-560ccae569f9 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:43.589862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0e0b4-4048-4c36-af3e-cf471fc48250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:43.590735 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0e0b4-4048-4c36-af3e-cf471fc48250 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:43.591252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0e0b4-4048-4c36-af3e-cf471fc48250 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:43.591659 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0e0b4-4048-4c36-af3e-cf471fc48250 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:43.592545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0e0b4-4048-4c36-af3e-cf471fc48250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:43.592982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0e0b4-4048-4c36-af3e-cf471fc48250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:43.594496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0e0b4-4048-4c36-af3e-cf471fc48250 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:43.596358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 342/696] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:43.597536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52483da-072f-483c-adbf-ec4037f288d1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:43.608228 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 355/697] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:43.614448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0e0b4-4048-4c36-af3e-cf471fc48250 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:43.701414 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:43.704882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52483da-072f-483c-adbf-ec4037f288d1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:43.727594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0e0b4-4048-4c36-af3e-cf471fc48250 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:43.742031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561f075-dafa-4016-9f2e-82169fff1518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:43.742876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561f075-dafa-4016-9f2e-82169fff1518 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:43.743149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561f075-dafa-4016-9f2e-82169fff1518 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:43.743419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561f075-dafa-4016-9f2e-82169fff1518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:43.767009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b9320-795e-4586-8d7f-56482a01c1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:43.767990 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b9320-795e-4586-8d7f-56482a01c1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:43.768490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b9320-795e-4586-8d7f-56482a01c1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:43.769018 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b9320-795e-4586-8d7f-56482a01c1c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:43.777548 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b9320-795e-4586-8d7f-56482a01c1c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:43.779296 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b9320-795e-4586-8d7f-56482a01c1c6 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-221b9320-795e-4586-8d7f-56482a01c1c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:43.792284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:43.793188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:43.794057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:43.794057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:43.794057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:43.794057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:43.794057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:43.794057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:43.794057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:43.794057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:43.796462 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 356/698] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:43.803380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b9320-795e-4586-8d7f-56482a01c1c6 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:43.813618 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:43.835461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561f075-dafa-4016-9f2e-82169fff1518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:43.836928 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561f075-dafa-4016-9f2e-82169fff1518 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:43.912761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b9320-795e-4586-8d7f-56482a01c1c6 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:43.968854 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c2dc9-5df6-45d3-80c9-4f30a273eb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:43.969918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2dc9-5df6-45d3-80c9-4f30a273eb83 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:43.970396 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2dc9-5df6-45d3-80c9-4f30a273eb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:43.971150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2dc9-5df6-45d3-80c9-4f30a273eb83 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:43.972563 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c2dc9-5df6-45d3-80c9-4f30a273eb83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:43.977534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c2dc9-5df6-45d3-80c9-4f30a273eb83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:43.979066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c2dc9-5df6-45d3-80c9-4f30a273eb83 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:44.001926 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 357/699] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:44.006146 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c2dc9-5df6-45d3-80c9-4f30a273eb83 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:44.022036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:44.026592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 343/700] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:44.027411 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561f075-dafa-4016-9f2e-82169fff1518 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:44.082781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:44.121476 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c2dc9-5df6-45d3-80c9-4f30a273eb83 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:44.133393 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561f075-dafa-4016-9f2e-82169fff1518 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:44.165179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae63e4-39f8-41e8-b2a5-6a26997c62eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:44.166055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae63e4-39f8-41e8-b2a5-6a26997c62eb None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:44.166525 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae63e4-39f8-41e8-b2a5-6a26997c62eb None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:44.167018 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae63e4-39f8-41e8-b2a5-6a26997c62eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:44.179861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae63e4-39f8-41e8-b2a5-6a26997c62eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:44.180053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76560dd8-e5c0-4051-9e63-8419e3082098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:44.180567 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76560dd8-e5c0-4051-9e63-8419e3082098 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:44.180843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76560dd8-e5c0-4051-9e63-8419e3082098 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:44.181146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76560dd8-e5c0-4051-9e63-8419e3082098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:44.181868 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76560dd8-e5c0-4051-9e63-8419e3082098 None admin] RBAC: Adding query filter params (role.id=b1cf59e6d9dd49179551b98cee02776c, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=c653cb8c86534dc2b963f39f5e1d3e0d) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:44.182173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76560dd8-e5c0-4051-9e63-8419e3082098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:44.182865 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae63e4-39f8-41e8-b2a5-6a26997c62eb None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:44.183774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76560dd8-e5c0-4051-9e63-8419e3082098 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:44.197025 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 344/701] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:21:44 2022] GET /identity/v3/role_assignments?user.id=c653cb8c86534dc2b963f39f5e1d3e0d&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=b1cf59e6d9dd49179551b98cee02776c => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:44.197025 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76560dd8-e5c0-4051-9e63-8419e3082098 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-66ae63e4-39f8-41e8-b2a5-6a26997c62eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:44.210603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:44.211578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:44.212524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:44.212524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:44.212524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:44.214712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 358/702] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:44.221843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae63e4-39f8-41e8-b2a5-6a26997c62eb None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:44.274093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:44.344789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76560dd8-e5c0-4051-9e63-8419e3082098 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:44.350909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae63e4-39f8-41e8-b2a5-6a26997c62eb None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:44.370319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:44.389885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1461fc3-3372-4c01-9560-cdfcb3503728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:44.390894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461fc3-3372-4c01-9560-cdfcb3503728 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:44.391390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461fc3-3372-4c01-9560-cdfcb3503728 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:44.391873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461fc3-3372-4c01-9560-cdfcb3503728 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:44.392721 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1461fc3-3372-4c01-9560-cdfcb3503728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:44.393267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1461fc3-3372-4c01-9560-cdfcb3503728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:44.395880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1461fc3-3372-4c01-9560-cdfcb3503728 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:44.411117 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 359/703] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:44.417768 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1461fc3-3372-4c01-9560-cdfcb3503728 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:44.435192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720609c-3686-4dd4-a013-9bfcfcd62578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:44.436202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720609c-3686-4dd4-a013-9bfcfcd62578 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:44.436676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720609c-3686-4dd4-a013-9bfcfcd62578 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:44.437207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720609c-3686-4dd4-a013-9bfcfcd62578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:44.462745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720609c-3686-4dd4-a013-9bfcfcd62578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:44.464565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720609c-3686-4dd4-a013-9bfcfcd62578 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-9720609c-3686-4dd4-a013-9bfcfcd62578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:44.495563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:44.496561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:44.497467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:44.497467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:44.497467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:44.507016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 345/704] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:44.513083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720609c-3686-4dd4-a013-9bfcfcd62578 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:44.577429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1461fc3-3372-4c01-9560-cdfcb3503728 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:44.618652 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c487e-2242-40dd-b452-a3b170a76c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:44.619264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c487e-2242-40dd-b452-a3b170a76c82 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:44.619543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c487e-2242-40dd-b452-a3b170a76c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:44.619821 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c487e-2242-40dd-b452-a3b170a76c82 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:44.620467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c487e-2242-40dd-b452-a3b170a76c82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:44.621950 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c487e-2242-40dd-b452-a3b170a76c82 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:44.653600 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720609c-3686-4dd4-a013-9bfcfcd62578 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:44.668064 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:44.689975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b793-6edc-42ae-abf2-1f145bc24cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:44.690728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b793-6edc-42ae-abf2-1f145bc24cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:44.691035 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b793-6edc-42ae-abf2-1f145bc24cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:44.691306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b793-6edc-42ae-abf2-1f145bc24cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:44.692758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88b793-6edc-42ae-abf2-1f145bc24cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:44.693022 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88b793-6edc-42ae-abf2-1f145bc24cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:44.703913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88b793-6edc-42ae-abf2-1f145bc24cb0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:44.704062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 360/705] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:21:44 2022] POST /identity/v3/users => generated 254 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:21:44.704062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e90ca3-6afc-4466-a76d-30bca811266b None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:44.704403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e90ca3-6afc-4466-a76d-30bca811266b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:44.704567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e90ca3-6afc-4466-a76d-30bca811266b None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:44.709026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 361/706] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:44.711871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 346/707] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:44.713682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db02a7f-3bd1-4cf9-aefd-324c2d30c1a0 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:44.714235 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db02a7f-3bd1-4cf9-aefd-324c2d30c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:44.714769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db02a7f-3bd1-4cf9-aefd-324c2d30c1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:44.717080 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b793-6edc-42ae-abf2-1f145bc24cb0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:44.741894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-4db02a7f-3bd1-4cf9-aefd-324c2d30c1a0 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:44.744100 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-4db02a7f-3bd1-4cf9-aefd-324c2d30c1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:44.784358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:44.845300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b793-6edc-42ae-abf2-1f145bc24cb0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:44.846957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 362/708] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:44.889008 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7a3ec-94bf-43ef-b0a5-e10108962348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:44.889670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7a3ec-94bf-43ef-b0a5-e10108962348 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:44.889948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7a3ec-94bf-43ef-b0a5-e10108962348 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:44.890278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7a3ec-94bf-43ef-b0a5-e10108962348 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:44.899811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7a3ec-94bf-43ef-b0a5-e10108962348 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:44.901570 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7a3ec-94bf-43ef-b0a5-e10108962348 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8cd7a3ec-94bf-43ef-b0a5-e10108962348 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:44.914288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:44.915219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:44.916173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:44.916173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:44.916173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:44.916173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:44.916173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:44.916173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:44.916173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:44.916173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:44.916173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 347/709] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:44.922309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db02a7f-3bd1-4cf9-aefd-324c2d30c1a0 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:45.054598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db02a7f-3bd1-4cf9-aefd-324c2d30c1a0 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:45.100068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd25556-af96-415c-bd94-22dee0706563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:45.100607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25556-af96-415c-bd94-22dee0706563 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:45.100883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25556-af96-415c-bd94-22dee0706563 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:45.101181 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25556-af96-415c-bd94-22dee0706563 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:45.101883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd25556-af96-415c-bd94-22dee0706563 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:45.102186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd25556-af96-415c-bd94-22dee0706563 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:45.103627 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd25556-af96-415c-bd94-22dee0706563 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:45.117456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 363/710] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:45.123345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7a3ec-94bf-43ef-b0a5-e10108962348 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:45.163267 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:45.187133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd25556-af96-415c-bd94-22dee0706563 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:45.217174 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:45.244236 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7a3ec-94bf-43ef-b0a5-e10108962348 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:45.282408 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00277cc5-07ca-44e7-b638-ff2dbaf0254d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:45.283017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00277cc5-07ca-44e7-b638-ff2dbaf0254d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:45.283294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00277cc5-07ca-44e7-b638-ff2dbaf0254d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:45.283564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00277cc5-07ca-44e7-b638-ff2dbaf0254d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:45.284291 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00277cc5-07ca-44e7-b638-ff2dbaf0254d None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=eb70408fecfe41e0b2ea9a53c7ae0823) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:45.284597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00277cc5-07ca-44e7-b638-ff2dbaf0254d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:45.286681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00277cc5-07ca-44e7-b638-ff2dbaf0254d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:45.292983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 348/711] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:21:45 2022] GET /identity/v3/role_assignments?user.id=eb70408fecfe41e0b2ea9a53c7ae0823&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:45.303568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd25556-af96-415c-bd94-22dee0706563 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:45.339129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d1f90-c3e9-4a7a-9aeb-34e2f5d98d47 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:45.344950 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d1f90-c3e9-4a7a-9aeb-34e2f5d98d47 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:45.344950 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d1f90-c3e9-4a7a-9aeb-34e2f5d98d47 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:45.344950 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 349/712] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:21:45.345243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af8b3f-0475-4a66-907a-74f30ff18299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:45.345243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af8b3f-0475-4a66-907a-74f30ff18299 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:45.345243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af8b3f-0475-4a66-907a-74f30ff18299 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:45.345243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af8b3f-0475-4a66-907a-74f30ff18299 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:45.345529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af8b3f-0475-4a66-907a-74f30ff18299 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:45.346893 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee13b8-52b1-4e8b-8360-52fa31064f29 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:45.347015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af8b3f-0475-4a66-907a-74f30ff18299 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:45.347186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee13b8-52b1-4e8b-8360-52fa31064f29 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:45.347444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee13b8-52b1-4e8b-8360-52fa31064f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-69af8b3f-0475-4a66-907a-74f30ff18299 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:45.360380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:45.361643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:45.362824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:45.362824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:45.362824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:45.362824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:45.362824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:45.362824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:45.362824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:45.362824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:45.362824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:45.362824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:45.362824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:21:45.362824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:21:45.362824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 04:21:45.362824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:45.365388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 364/713] 10.222.0.50 () {56 vars in 1129 bytes} [Sat Sep 17 04:21:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:45.371619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af8b3f-0475-4a66-907a-74f30ff18299 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:45.375303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8bee13b8-52b1-4e8b-8360-52fa31064f29 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:45.376534 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8bee13b8-52b1-4e8b-8360-52fa31064f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:45.470694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 350/714] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:45.537461 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:45.551388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af8b3f-0475-4a66-907a-74f30ff18299 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:45.587804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4156094-91f9-4d36-8ab0-8006d78f4d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:45.588413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4156094-91f9-4d36-8ab0-8006d78f4d1c None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:45.588689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4156094-91f9-4d36-8ab0-8006d78f4d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:45.589088 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4156094-91f9-4d36-8ab0-8006d78f4d1c None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:45.589724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4156094-91f9-4d36-8ab0-8006d78f4d1c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:45.590025 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4156094-91f9-4d36-8ab0-8006d78f4d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:45.591407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4156094-91f9-4d36-8ab0-8006d78f4d1c None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:45.596351 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 365/715] 10.222.0.50 () {56 vars in 1124 bytes} [Sat Sep 17 04:21:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:45.602229 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee13b8-52b1-4e8b-8360-52fa31064f29 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:45.639900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:45.718212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee13b8-52b1-4e8b-8360-52fa31064f29 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:45.743990 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4156094-91f9-4d36-8ab0-8006d78f4d1c None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:45.764616 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c5db7-eb36-45b4-b4c0-423f078551b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:45.765264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c5db7-eb36-45b4-b4c0-423f078551b7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:45.765855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c5db7-eb36-45b4-b4c0-423f078551b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:45.766337 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c5db7-eb36-45b4-b4c0-423f078551b7 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:45.767424 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c5db7-eb36-45b4-b4c0-423f078551b7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:45.767727 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c5db7-eb36-45b4-b4c0-423f078551b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:45.769233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c5db7-eb36-45b4-b4c0-423f078551b7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:45.776325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 351/716] 10.222.0.50 () {56 vars in 1124 bytes} [Sat Sep 17 04:21:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:45.888330 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4156094-91f9-4d36-8ab0-8006d78f4d1c None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:45.938742 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94831a64-ceb2-406b-a498-c402404af111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:45.939310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831a64-ceb2-406b-a498-c402404af111 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:45.939585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831a64-ceb2-406b-a498-c402404af111 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:45.939850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831a64-ceb2-406b-a498-c402404af111 None admin] PATH_INFO: `/v3/services/network` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:45.940440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94831a64-ceb2-406b-a498-c402404af111 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:45.942449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94831a64-ceb2-406b-a498-c402404af111 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-94831a64-ceb2-406b-a498-c402404af111 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:45.958414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:45.959453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:45.960269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:45.960269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:45.960269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:45.960269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:45.960269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:45.960269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:45.960269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:45.960269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:45.960269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:45.960269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:45.960269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:21:45.960269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:21:45.960269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 04:21:45.960269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:45.960981 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 366/717] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:45 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:45.965844 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c5db7-eb36-45b4-b4c0-423f078551b7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:46.103288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:46.113011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c5db7-eb36-45b4-b4c0-423f078551b7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:46.151328 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593fb7b-482d-48f0-89cd-ea12b6374e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:46.152286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593fb7b-482d-48f0-89cd-ea12b6374e7d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:46.152777 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593fb7b-482d-48f0-89cd-ea12b6374e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:46.153521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593fb7b-482d-48f0-89cd-ea12b6374e7d None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:46.154378 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593fb7b-482d-48f0-89cd-ea12b6374e7d None admin] RBAC: Adding query filter params (name=network) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:46.154874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593fb7b-482d-48f0-89cd-ea12b6374e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:46.156441 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593fb7b-482d-48f0-89cd-ea12b6374e7d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:46.162198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 352/718] 10.222.0.50 () {56 vars in 1112 bytes} [Sat Sep 17 04:21:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:46.167558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94831a64-ceb2-406b-a498-c402404af111 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:46.219703 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:46.333566 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94831a64-ceb2-406b-a498-c402404af111 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:46.376498 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c6d54-d444-4669-b7f4-0ef2707219b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:46.377198 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c6d54-d444-4669-b7f4-0ef2707219b8 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:46.377471 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c6d54-d444-4669-b7f4-0ef2707219b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:46.377738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c6d54-d444-4669-b7f4-0ef2707219b8 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:46.378369 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c6d54-d444-4669-b7f4-0ef2707219b8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:46.378663 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c6d54-d444-4669-b7f4-0ef2707219b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:46.380792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c6d54-d444-4669-b7f4-0ef2707219b8 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:46.392399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 367/719] 10.222.0.50 () {56 vars in 1112 bytes} [Sat Sep 17 04:21:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:47.206908 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709afdd1-8322-42d4-a07b-4f6448066533 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:47.207908 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709afdd1-8322-42d4-a07b-4f6448066533 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:47.208414 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709afdd1-8322-42d4-a07b-4f6448066533 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:47.210269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 353/720] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:47.215613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7e78a-0131-4893-b3f6-4baa7664d965 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:47.216471 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7e78a-0131-4893-b3f6-4baa7664d965 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:47.216951 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7e78a-0131-4893-b3f6-4baa7664d965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:47.246480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-b3c7e78a-0131-4893-b3f6-4baa7664d965 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:47.247998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b3c7e78a-0131-4893-b3f6-4baa7664d965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:47.343310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 368/721] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:47.706711 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709afdd1-8322-42d4-a07b-4f6448066533 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:47.830181 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709afdd1-8322-42d4-a07b-4f6448066533 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:47.877364 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4693b9e-6b4e-45df-91ab-d69e542add1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:47.878399 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4693b9e-6b4e-45df-91ab-d69e542add1d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:47.878911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4693b9e-6b4e-45df-91ab-d69e542add1d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:47.879410 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4693b9e-6b4e-45df-91ab-d69e542add1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:47.900681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4693b9e-6b4e-45df-91ab-d69e542add1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-d4693b9e-6b4e-45df-91ab-d69e542add1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:47.906702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:47.907736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:47.908562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:47.908562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:47.908562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:47.908562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:47.908562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:47.908562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:47.908562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:47.908562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:47.908562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:47.908562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:47.908562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:47.908562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:47.915682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 354/722] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:21:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:47.921631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7e78a-0131-4893-b3f6-4baa7664d965 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:47.942625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:48.019274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08b130-1b04-4a34-aa73-575e5cb1b085 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:48.019871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08b130-1b04-4a34-aa73-575e5cb1b085 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:48.020340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08b130-1b04-4a34-aa73-575e5cb1b085 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:48.022237 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 355/723] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:21:48.025551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0acdd-7537-4fb8-a8bc-c60018090f9d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:48.025834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0acdd-7537-4fb8-a8bc-c60018090f9d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:48.026108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0acdd-7537-4fb8-a8bc-c60018090f9d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:48.027963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 356/724] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:48.029028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafe7ff-968e-4f8f-b537-e451bc7ee879 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:48.029317 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafe7ff-968e-4f8f-b537-e451bc7ee879 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:48.029686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafe7ff-968e-4f8f-b537-e451bc7ee879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:48.045902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7e78a-0131-4893-b3f6-4baa7664d965 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:48.055178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ecafe7ff-968e-4f8f-b537-e451bc7ee879 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:48.056770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ecafe7ff-968e-4f8f-b537-e451bc7ee879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:48.069203 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:48.090029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f0904-7b12-4916-beff-fa883b145c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:48.090029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f0904-7b12-4916-beff-fa883b145c2f None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:48.090029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f0904-7b12-4916-beff-fa883b145c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:48.090029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f0904-7b12-4916-beff-fa883b145c2f None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:48.090445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f0904-7b12-4916-beff-fa883b145c2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:48.093022 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f0904-7b12-4916-beff-fa883b145c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:48.093022 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f0904-7b12-4916-beff-fa883b145c2f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:48.106901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 369/725] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:48.108553 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b26280-cf2d-4072-91dc-80f9baadfeb3 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:48.109184 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b26280-cf2d-4072-91dc-80f9baadfeb3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:48.109520 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b26280-cf2d-4072-91dc-80f9baadfeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:48.128156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-68b26280-cf2d-4072-91dc-80f9baadfeb3 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:48.130219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-68b26280-cf2d-4072-91dc-80f9baadfeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:48.138859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 357/726] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:48.140057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafe7ff-968e-4f8f-b537-e451bc7ee879 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:48.200975 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 370/727] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:48.346418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafe7ff-968e-4f8f-b537-e451bc7ee879 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:48.389680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e526b-ef92-4eb9-991e-637a52c4faac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:48.390313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e526b-ef92-4eb9-991e-637a52c4faac None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:48.390586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e526b-ef92-4eb9-991e-637a52c4faac None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:48.390849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e526b-ef92-4eb9-991e-637a52c4faac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:48.413208 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e526b-ef92-4eb9-991e-637a52c4faac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:48.414678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e526b-ef92-4eb9-991e-637a52c4faac None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:48.426410 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e85e526b-ef92-4eb9-991e-637a52c4faac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:48.434467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:48.435426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:48.436321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:48.436321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:48.436321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:48.436321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 358/728] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:48.442394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b26280-cf2d-4072-91dc-80f9baadfeb3 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:48.445106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:48.521190 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e526b-ef92-4eb9-991e-637a52c4faac None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:48.595583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b26280-cf2d-4072-91dc-80f9baadfeb3 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:48.639159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920dde7b-7db6-4eb2-b937-76ef44da34ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:48.640054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dde7b-7db6-4eb2-b937-76ef44da34ae None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:48.640536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dde7b-7db6-4eb2-b937-76ef44da34ae None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:48.641028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dde7b-7db6-4eb2-b937-76ef44da34ae None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:48.641755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920dde7b-7db6-4eb2-b937-76ef44da34ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:48.642070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920dde7b-7db6-4eb2-b937-76ef44da34ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:48.643182 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e526b-ef92-4eb9-991e-637a52c4faac None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:48.643480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920dde7b-7db6-4eb2-b937-76ef44da34ae None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:48.660130 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 371/729] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:48.660130 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920dde7b-7db6-4eb2-b937-76ef44da34ae None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:48.689697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f533c-3da6-4e5a-89e4-b4da102619d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:48.690495 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f533c-3da6-4e5a-89e4-b4da102619d8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:48.690774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f533c-3da6-4e5a-89e4-b4da102619d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:48.692411 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f533c-3da6-4e5a-89e4-b4da102619d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:48.704646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f533c-3da6-4e5a-89e4-b4da102619d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-c01f533c-3da6-4e5a-89e4-b4da102619d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:48.711553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:48.712501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:48.713358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:48.713358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:48.713358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:48.713358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:48.713358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:48.713358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:48.713358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:48.713358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:48.713358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:48.713358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:48.713358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:48.713358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:48.713358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 359/730] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:21:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:48.714093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e57768-ea7e-4046-ba7d-b19dc2c2f276 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:48.714093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e57768-ea7e-4046-ba7d-b19dc2c2f276 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:48.714867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e57768-ea7e-4046-ba7d-b19dc2c2f276 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:48.715746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 360/731] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:48.720457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e57768-ea7e-4046-ba7d-b19dc2c2f276 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:48.724487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:48.770359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920dde7b-7db6-4eb2-b937-76ef44da34ae None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:48.782983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:48.807795 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e26ab-3612-4b37-905f-06f4c91afc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:48.808425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e26ab-3612-4b37-905f-06f4c91afc55 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:48.808704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e26ab-3612-4b37-905f-06f4c91afc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:48.808976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e26ab-3612-4b37-905f-06f4c91afc55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:48.820083 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e26ab-3612-4b37-905f-06f4c91afc55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-306e26ab-3612-4b37-905f-06f4c91afc55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:48.825359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:48.826314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:48.827139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:48.827139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:48.827139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:48.827139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:48.827139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:48.827139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:48.827139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:48.827139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:48.827139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:48.827139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:48.827139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:48.827139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:48.827139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 372/732] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:48.827832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e26ab-3612-4b37-905f-06f4c91afc55 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:48.832698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e57768-ea7e-4046-ba7d-b19dc2c2f276 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:48.868265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b616504-ca4e-43e1-8fb4-d80f5f332689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:48.868896 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b616504-ca4e-43e1-8fb4-d80f5f332689 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:48.869206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b616504-ca4e-43e1-8fb4-d80f5f332689 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:48.869481 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b616504-ca4e-43e1-8fb4-d80f5f332689 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:48.877352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b616504-ca4e-43e1-8fb4-d80f5f332689 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:48.878872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b616504-ca4e-43e1-8fb4-d80f5f332689 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0b616504-ca4e-43e1-8fb4-d80f5f332689 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:48.891560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:48.892509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:48.893502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:48.893502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:48.893502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:48.893502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:48.893502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:48.893502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:48.893502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:48.893502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:48.893502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 04:21:48.893502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:48.893502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 361/733] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:21:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:48.894100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb6ef5-33dc-4733-aafa-b4b82a90e5c5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:48.894169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb6ef5-33dc-4733-aafa-b4b82a90e5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:48.894632 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb6ef5-33dc-4733-aafa-b4b82a90e5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:48.913024 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e3eb6ef5-33dc-4733-aafa-b4b82a90e5c5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:48.914236 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e3eb6ef5-33dc-4733-aafa-b4b82a90e5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:48.951300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e26ab-3612-4b37-905f-06f4c91afc55 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:48.976425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:48.992479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 362/734] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:48.992479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb6ef5-33dc-4733-aafa-b4b82a90e5c5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:48.995709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c7d5b-24e1-40a9-8421-c89391fb0942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:48.996683 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c7d5b-24e1-40a9-8421-c89391fb0942 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:48.996961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c7d5b-24e1-40a9-8421-c89391fb0942 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:48.997580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c7d5b-24e1-40a9-8421-c89391fb0942 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:48.998542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c7d5b-24e1-40a9-8421-c89391fb0942 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:48.998854 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c7d5b-24e1-40a9-8421-c89391fb0942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:49.000823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c7d5b-24e1-40a9-8421-c89391fb0942 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:49.013174 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 373/735] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:49.014021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c7d5b-24e1-40a9-8421-c89391fb0942 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:49.041516 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:49.094685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb6ef5-33dc-4733-aafa-b4b82a90e5c5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:49.131621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b4cda-177c-437e-8a85-633aa3532627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:49.132220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b4cda-177c-437e-8a85-633aa3532627 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:49.132555 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b4cda-177c-437e-8a85-633aa3532627 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:49.132830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b4cda-177c-437e-8a85-633aa3532627 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:49.133571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b4cda-177c-437e-8a85-633aa3532627 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:49.133972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b4cda-177c-437e-8a85-633aa3532627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:49.135597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b4cda-177c-437e-8a85-633aa3532627 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:49.146948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 363/736] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:49.147772 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b4cda-177c-437e-8a85-633aa3532627 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:49.151222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c7d5b-24e1-40a9-8421-c89391fb0942 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:49.192958 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdd9b6-f2fa-4985-8027-51f34ead9eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:49.193588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdd9b6-f2fa-4985-8027-51f34ead9eae None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:49.194023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdd9b6-f2fa-4985-8027-51f34ead9eae None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:49.194301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdd9b6-f2fa-4985-8027-51f34ead9eae None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:49.195411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bdd9b6-f2fa-4985-8027-51f34ead9eae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:49.195996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bdd9b6-f2fa-4985-8027-51f34ead9eae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:49.197617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bdd9b6-f2fa-4985-8027-51f34ead9eae None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:49.217569 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 374/737] 10.222.0.50 () {56 vars in 1135 bytes} [Sat Sep 17 04:21:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:49.219001 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096c492-67f5-49cf-be27-7ddf4425d53a None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:49.219275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096c492-67f5-49cf-be27-7ddf4425d53a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:49.219542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096c492-67f5-49cf-be27-7ddf4425d53a None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:49.220858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 375/738] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:49.221416 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096c492-67f5-49cf-be27-7ddf4425d53a None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:49.267516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:49.267728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b4cda-177c-437e-8a85-633aa3532627 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:49.278100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:49.302012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a2523-4d42-4be9-882d-55a47c810918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:49.302643 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a2523-4d42-4be9-882d-55a47c810918 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:49.302919 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a2523-4d42-4be9-882d-55a47c810918 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:49.303188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a2523-4d42-4be9-882d-55a47c810918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:49.313478 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a2523-4d42-4be9-882d-55a47c810918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:49.314978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a2523-4d42-4be9-882d-55a47c810918 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:49.325212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096c492-67f5-49cf-be27-7ddf4425d53a None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-567a2523-4d42-4be9-882d-55a47c810918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:49.328861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:49.329854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:49.330745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:49.330745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:49.330745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:49.330745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 364/739] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:49.330745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a2523-4d42-4be9-882d-55a47c810918 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:49.361718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da217e-69dc-43d7-bcb2-3d13e6a67578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:49.362336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da217e-69dc-43d7-bcb2-3d13e6a67578 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:49.362617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da217e-69dc-43d7-bcb2-3d13e6a67578 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:49.362985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da217e-69dc-43d7-bcb2-3d13e6a67578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:49.373377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da217e-69dc-43d7-bcb2-3d13e6a67578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:49.374819 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da217e-69dc-43d7-bcb2-3d13e6a67578 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-91da217e-69dc-43d7-bcb2-3d13e6a67578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:49.389278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:49.390290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:49.391171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:49.391171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:49.391171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:49.394977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 376/740] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:49.396192 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acadbde-2a2b-4a10-8d35-f3b552bcc458 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:49.396464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acadbde-2a2b-4a10-8d35-f3b552bcc458 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:49.396734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acadbde-2a2b-4a10-8d35-f3b552bcc458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:49.414285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-0acadbde-2a2b-4a10-8d35-f3b552bcc458 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:49.415381 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-0acadbde-2a2b-4a10-8d35-f3b552bcc458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:49.437432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a2523-4d42-4be9-882d-55a47c810918 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:49.469518 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75471919-361e-4c6f-9815-c591b9b8ab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:49.470116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75471919-361e-4c6f-9815-c591b9b8ab0e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:49.470388 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75471919-361e-4c6f-9815-c591b9b8ab0e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:49.470656 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75471919-361e-4c6f-9815-c591b9b8ab0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:49.482141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 377/741] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 04:21:49.482983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acadbde-2a2b-4a10-8d35-f3b552bcc458 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:49.500786 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:49.509281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:49.539618 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75471919-361e-4c6f-9815-c591b9b8ab0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:49.541095 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75471919-361e-4c6f-9815-c591b9b8ab0e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:49.585134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acadbde-2a2b-4a10-8d35-f3b552bcc458 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:49.620613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71e4b3-e133-4a04-90e0-beeedcabbc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:49.621244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71e4b3-e133-4a04-90e0-beeedcabbc4b None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:49.621518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71e4b3-e133-4a04-90e0-beeedcabbc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:49.622033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71e4b3-e133-4a04-90e0-beeedcabbc4b None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:49.622420 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71e4b3-e133-4a04-90e0-beeedcabbc4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:49.623779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71e4b3-e133-4a04-90e0-beeedcabbc4b None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:49.641437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 365/742] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 04:21:49.642445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75471919-361e-4c6f-9815-c591b9b8ab0e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:49.703055 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:49.713137 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 378/743] 10.222.0.50 () {60 vars in 1141 bytes} [Sat Sep 17 04:21:49 2022] POST /identity/v3/services => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:21:49.713137 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71e4b3-e133-4a04-90e0-beeedcabbc4b None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:49.761784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75471919-361e-4c6f-9815-c591b9b8ab0e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:49.807166 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405f281-d5c9-4dd0-b813-b412259b7ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:49.807782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405f281-d5c9-4dd0-b813-b412259b7ffb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:49.808063 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405f281-d5c9-4dd0-b813-b412259b7ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:49.808321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405f281-d5c9-4dd0-b813-b412259b7ffb None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:49.808972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405f281-d5c9-4dd0-b813-b412259b7ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:49.809303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405f281-d5c9-4dd0-b813-b412259b7ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:49.810709 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405f281-d5c9-4dd0-b813-b412259b7ffb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:49.824507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 366/744] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:49.825205 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405f281-d5c9-4dd0-b813-b412259b7ffb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:49.833331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:49.851581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71e4b3-e133-4a04-90e0-beeedcabbc4b None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:49.892793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ade41-8fb0-4237-9521-f3ad02d465d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:49.893535 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ade41-8fb0-4237-9521-f3ad02d465d4 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:49.893820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ade41-8fb0-4237-9521-f3ad02d465d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:49.894128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ade41-8fb0-4237-9521-f3ad02d465d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:49.894961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ade41-8fb0-4237-9521-f3ad02d465d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:49.895207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ade41-8fb0-4237-9521-f3ad02d465d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:49.896656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ade41-8fb0-4237-9521-f3ad02d465d4 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:49.911013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 379/745] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:49.911946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ade41-8fb0-4237-9521-f3ad02d465d4 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:49.943521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405f281-d5c9-4dd0-b813-b412259b7ffb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:49.961711 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:49.978876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15685469-0b76-46d1-8703-8f302e71351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:49.979517 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15685469-0b76-46d1-8703-8f302e71351f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:49.979776 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15685469-0b76-46d1-8703-8f302e71351f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:49.980048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15685469-0b76-46d1-8703-8f302e71351f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:49.992349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15685469-0b76-46d1-8703-8f302e71351f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:49.994144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15685469-0b76-46d1-8703-8f302e71351f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-15685469-0b76-46d1-8703-8f302e71351f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:50.010602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:50.011571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:50.012494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:50.012494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:50.012494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:50.012494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 367/746] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:50.012713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15685469-0b76-46d1-8703-8f302e71351f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:50.024130 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ade41-8fb0-4237-9521-f3ad02d465d4 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:50.059154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381bfdc-aed5-4083-94ae-081023476fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:50.059774 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381bfdc-aed5-4083-94ae-081023476fd9 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:50.060053 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381bfdc-aed5-4083-94ae-081023476fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:50.060327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381bfdc-aed5-4083-94ae-081023476fd9 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:50.060981 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381bfdc-aed5-4083-94ae-081023476fd9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:50.062391 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381bfdc-aed5-4083-94ae-081023476fd9 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:50.117962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15685469-0b76-46d1-8703-8f302e71351f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:50.153746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a7af4-af4f-4434-b221-ab5bdf3a5b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:50.154372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a7af4-af4f-4434-b221-ab5bdf3a5b43 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:50.154646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a7af4-af4f-4434-b221-ab5bdf3a5b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:50.154918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a7af4-af4f-4434-b221-ab5bdf3a5b43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:50.162976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a7af4-af4f-4434-b221-ab5bdf3a5b43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:50.164418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a7af4-af4f-4434-b221-ab5bdf3a5b43 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:50.172013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 380/747] 10.222.0.50 () {60 vars in 1141 bytes} [Sat Sep 17 04:21:49 2022] POST /identity/v3/services => generated 240 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:21:50.173168 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381bfdc-aed5-4083-94ae-081023476fd9 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-082a7af4-af4f-4434-b221-ab5bdf3a5b43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:50.176172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:50.177170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:50.183138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:50.183138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:50.183138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:50.183138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:50.183138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:50.183138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:50.183138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:50.183138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:50.183138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:21:50.183138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:50.183138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 368/748] 10.222.0.50 () {56 vars in 1093 bytes} [Sat Sep 17 04:21:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:50.183138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a7af4-af4f-4434-b221-ab5bdf3a5b43 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:50.187644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:50.220664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:50.304318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a7af4-af4f-4434-b221-ab5bdf3a5b43 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:50.340482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381bfdc-aed5-4083-94ae-081023476fd9 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:50.345637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a68a95-ba82-4585-819a-d8d270f1b2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:50.346757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a68a95-ba82-4585-819a-d8d270f1b2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:50.346901 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a68a95-ba82-4585-819a-d8d270f1b2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:50.347490 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a68a95-ba82-4585-819a-d8d270f1b2d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:50.348402 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a68a95-ba82-4585-819a-d8d270f1b2d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:50.348854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a68a95-ba82-4585-819a-d8d270f1b2d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:50.351107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a68a95-ba82-4585-819a-d8d270f1b2d6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:50.373180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 369/749] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:50.374626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a68a95-ba82-4585-819a-d8d270f1b2d6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:50.393148 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5c9cc-2cc6-445a-bbd4-d39c78f71bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:50.393797 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c9cc-2cc6-445a-bbd4-d39c78f71bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:50.394218 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c9cc-2cc6-445a-bbd4-d39c78f71bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:50.394631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c9cc-2cc6-445a-bbd4-d39c78f71bb2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:50.406400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5c9cc-2cc6-445a-bbd4-d39c78f71bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:50.408426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5c9cc-2cc6-445a-bbd4-d39c78f71bb2 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-1cc5c9cc-2cc6-445a-bbd4-d39c78f71bb2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:50.422644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:50.423619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:50.424521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:50.424521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:50.424521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:50.424521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:50.424521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:50.424521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:50.424521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:50.424521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:50.424521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 04:21:50.424521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:50.428573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 381/750] 10.222.0.50 () {56 vars in 1117 bytes} [Sat Sep 17 04:21:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:50.428573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5c9cc-2cc6-445a-bbd4-d39c78f71bb2 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:50.501076 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:50.509737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:50.511611 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a68a95-ba82-4585-819a-d8d270f1b2d6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:50.552618 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5c9cc-2cc6-445a-bbd4-d39c78f71bb2 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:50.556152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d15e4-f532-415d-9aa6-9b8989a16f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:50.557606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d15e4-f532-415d-9aa6-9b8989a16f70 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:50.557883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d15e4-f532-415d-9aa6-9b8989a16f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:50.558185 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d15e4-f532-415d-9aa6-9b8989a16f70 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:50.558920 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d15e4-f532-415d-9aa6-9b8989a16f70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:50.559222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d15e4-f532-415d-9aa6-9b8989a16f70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:50.560640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d15e4-f532-415d-9aa6-9b8989a16f70 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:50.585089 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 370/751] 10.222.0.50 () {56 vars in 1133 bytes} [Sat Sep 17 04:21:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:50.586280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d15e4-f532-415d-9aa6-9b8989a16f70 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:50.597156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d46ec-04a2-46f3-8b44-022a0633a868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:50.598932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d46ec-04a2-46f3-8b44-022a0633a868 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:50.599434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d46ec-04a2-46f3-8b44-022a0633a868 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:50.599901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d46ec-04a2-46f3-8b44-022a0633a868 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:50.607692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d46ec-04a2-46f3-8b44-022a0633a868 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:50.609837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d46ec-04a2-46f3-8b44-022a0633a868 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-4f2d46ec-04a2-46f3-8b44-022a0633a868 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:50.623069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:50.624000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:50.624873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:50.624873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:50.624873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:50.624873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:50.624873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:50.624873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:50.624873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:50.624873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:50.627437 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 382/752] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:50.628609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d46ec-04a2-46f3-8b44-022a0633a868 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:50.701690 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d15e4-f532-415d-9aa6-9b8989a16f70 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:50.740117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61e0a5-24f9-4af9-8c0c-6999f765345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:50.740729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61e0a5-24f9-4af9-8c0c-6999f765345e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:50.741017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61e0a5-24f9-4af9-8c0c-6999f765345e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:50.741296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61e0a5-24f9-4af9-8c0c-6999f765345e None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:50.742036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61e0a5-24f9-4af9-8c0c-6999f765345e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:50.742336 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61e0a5-24f9-4af9-8c0c-6999f765345e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:50.743393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d46ec-04a2-46f3-8b44-022a0633a868 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:50.743787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61e0a5-24f9-4af9-8c0c-6999f765345e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:50.764967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 371/753] 10.222.0.50 () {56 vars in 1149 bytes} [Sat Sep 17 04:21:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:50.765417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:50.770979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61e0a5-24f9-4af9-8c0c-6999f765345e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:50.779770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:50.782642 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f3d40-3e34-4dc1-a602-6dd40caa66f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:50.783588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f3d40-3e34-4dc1-a602-6dd40caa66f4 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:50.784067 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f3d40-3e34-4dc1-a602-6dd40caa66f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:50.784534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f3d40-3e34-4dc1-a602-6dd40caa66f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:50.796682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f3d40-3e34-4dc1-a602-6dd40caa66f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:50.798440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f3d40-3e34-4dc1-a602-6dd40caa66f4 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-b44f3d40-3e34-4dc1-a602-6dd40caa66f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:50.818185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:50.819147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:50.820024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:50.820024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:50.820024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:50.822566 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 383/754] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:50.823487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f3d40-3e34-4dc1-a602-6dd40caa66f4 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:50.885902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61e0a5-24f9-4af9-8c0c-6999f765345e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:50.927787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c214a-fdef-4d92-8547-9016bb4643a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:50.928315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c214a-fdef-4d92-8547-9016bb4643a7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:50.928683 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c214a-fdef-4d92-8547-9016bb4643a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:50.929070 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c214a-fdef-4d92-8547-9016bb4643a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:50.929883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c214a-fdef-4d92-8547-9016bb4643a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:50.930291 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c214a-fdef-4d92-8547-9016bb4643a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:50.931818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c214a-fdef-4d92-8547-9016bb4643a7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:50.952752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 372/755] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:50.952752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c214a-fdef-4d92-8547-9016bb4643a7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:50.967943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f3d40-3e34-4dc1-a602-6dd40caa66f4 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:51.016096 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe2dff-6f9e-4b4b-83da-3860a6bd6b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:51.017492 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe2dff-6f9e-4b4b-83da-3860a6bd6b5f None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:51.018024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe2dff-6f9e-4b4b-83da-3860a6bd6b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:51.018445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe2dff-6f9e-4b4b-83da-3860a6bd6b5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:51.023350 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:51.060525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c214a-fdef-4d92-8547-9016bb4643a7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:51.069759 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:51.096105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09382a-71fd-4382-b69e-8f32c1f006b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:51.097031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09382a-71fd-4382-b69e-8f32c1f006b1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:51.097031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09382a-71fd-4382-b69e-8f32c1f006b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:51.097767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09382a-71fd-4382-b69e-8f32c1f006b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:51.098469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09382a-71fd-4382-b69e-8f32c1f006b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:51.098766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09382a-71fd-4382-b69e-8f32c1f006b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:51.100244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09382a-71fd-4382-b69e-8f32c1f006b1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:51.100475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe2dff-6f9e-4b4b-83da-3860a6bd6b5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:51.102220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe2dff-6f9e-4b4b-83da-3860a6bd6b5f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:51.112282 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 373/756] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:51.113671 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09382a-71fd-4382-b69e-8f32c1f006b1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:51.218896 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 384/757] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:21:51.219539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09382a-71fd-4382-b69e-8f32c1f006b1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:51.220299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe2dff-6f9e-4b4b-83da-3860a6bd6b5f None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:51.246197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:51.255460 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af411cb-7b9b-401f-bcd8-ffad81a37360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:51.255808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af411cb-7b9b-401f-bcd8-ffad81a37360 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:51.256129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af411cb-7b9b-401f-bcd8-ffad81a37360 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:51.256458 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af411cb-7b9b-401f-bcd8-ffad81a37360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:51.257256 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af411cb-7b9b-401f-bcd8-ffad81a37360 None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=c653cb8c86534dc2b963f39f5e1d3e0d) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:51.257512 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af411cb-7b9b-401f-bcd8-ffad81a37360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:51.259189 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af411cb-7b9b-401f-bcd8-ffad81a37360 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:51.273613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 374/758] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:21:51 2022] GET /identity/v3/role_assignments?user.id=c653cb8c86534dc2b963f39f5e1d3e0d&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:51.273613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af411cb-7b9b-401f-bcd8-ffad81a37360 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:51.327183 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:51.375904 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af411cb-7b9b-401f-bcd8-ffad81a37360 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:51.383763 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe2dff-6f9e-4b4b-83da-3860a6bd6b5f None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:51.422844 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da992398-d267-4e26-a815-0179573be9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:51.428127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da992398-d267-4e26-a815-0179573be9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:51.428757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da992398-d267-4e26-a815-0179573be9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:51.429255 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da992398-d267-4e26-a815-0179573be9b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:51.454809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da992398-d267-4e26-a815-0179573be9b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:51.457030 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da992398-d267-4e26-a815-0179573be9b1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:51.470071 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f8f2a-add3-4e96-80aa-a9c6c1701d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:51.471267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8f2a-add3-4e96-80aa-a9c6c1701d1d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-da992398-d267-4e26-a815-0179573be9b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:51.476672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:51.477687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:51.478592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:51.478592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:51.478592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:51.479636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8f2a-add3-4e96-80aa-a9c6c1701d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:51.480117 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8f2a-add3-4e96-80aa-a9c6c1701d1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:51.489586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 375/759] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:51.491130 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f8f2a-add3-4e96-80aa-a9c6c1701d1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:51.492865 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f8f2a-add3-4e96-80aa-a9c6c1701d1d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:51.495201 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da992398-d267-4e26-a815-0179573be9b1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-279f8f2a-add3-4e96-80aa-a9c6c1701d1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:51.518298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:51.519611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:51.520522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:51.520522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:51.520522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:51.520522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:51.520522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:51.520522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:51.520522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:51.520522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:51.530206 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 385/760] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:51.534580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f8f2a-add3-4e96-80aa-a9c6c1701d1d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:51.580687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:51.678850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da992398-d267-4e26-a815-0179573be9b1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:51.744833 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f8f2a-add3-4e96-80aa-a9c6c1701d1d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:51.772672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7f5e9-c2cb-4395-811c-a1f09064a23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:51.773635 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7f5e9-c2cb-4395-811c-a1f09064a23a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:51.773919 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7f5e9-c2cb-4395-811c-a1f09064a23a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:51.774195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7f5e9-c2cb-4395-811c-a1f09064a23a None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:51.774859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7f5e9-c2cb-4395-811c-a1f09064a23a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:51.775168 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7f5e9-c2cb-4395-811c-a1f09064a23a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:51.776567 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7f5e9-c2cb-4395-811c-a1f09064a23a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:51.800950 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:51.804461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 376/761] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:51.808941 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7f5e9-c2cb-4395-811c-a1f09064a23a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:51.817809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2e282-80f4-4437-b31f-ee08a3352a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:51.818433 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2e282-80f4-4437-b31f-ee08a3352a65 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:51.818709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2e282-80f4-4437-b31f-ee08a3352a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:51.818979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2e282-80f4-4437-b31f-ee08a3352a65 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:51.819678 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2e282-80f4-4437-b31f-ee08a3352a65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:51.819979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2e282-80f4-4437-b31f-ee08a3352a65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:51.821449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2e282-80f4-4437-b31f-ee08a3352a65 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:51.837193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 386/762] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:51.843365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2e282-80f4-4437-b31f-ee08a3352a65 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:51.978971 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7f5e9-c2cb-4395-811c-a1f09064a23a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:51.980584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:52.017754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a2efb-7f3c-4465-b13e-738ef50e2f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:52.018761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2efb-7f3c-4465-b13e-738ef50e2f76 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:52.019247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2efb-7f3c-4465-b13e-738ef50e2f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:52.019653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2efb-7f3c-4465-b13e-738ef50e2f76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:52.022001 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2e282-80f4-4437-b31f-ee08a3352a65 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:52.027982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a2efb-7f3c-4465-b13e-738ef50e2f76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:52.029669 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a2efb-7f3c-4465-b13e-738ef50e2f76 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ad5a2efb-7f3c-4465-b13e-738ef50e2f76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:52.041773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:52.042847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:52.043868 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:52.043868 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:52.043868 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:52.043868 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:52.043868 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:52.043868 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:52.043868 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:52.043868 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:52.045746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 377/763] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:52.047039 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767945b1-42c3-4cb5-8fed-b57372203f6b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:52.047461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767945b1-42c3-4cb5-8fed-b57372203f6b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:52.047851 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767945b1-42c3-4cb5-8fed-b57372203f6b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:52.049462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 378/764] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:52.055675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767945b1-42c3-4cb5-8fed-b57372203f6b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:52.075357 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a00d5-92d9-4bba-92b2-cece4da61d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:52.076344 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a00d5-92d9-4bba-92b2-cece4da61d30 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:52.076808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a00d5-92d9-4bba-92b2-cece4da61d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:52.077249 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a00d5-92d9-4bba-92b2-cece4da61d30 None admin] PATH_INFO: `/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/eb70408fecfe41e0b2ea9a53c7ae0823/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:52.079328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a00d5-92d9-4bba-92b2-cece4da61d30 None admin] RBAC: Authorizing `identity:create_grant(project_id=d50a1cd322404bd4b0fa7a8c388dc217, user_id=eb70408fecfe41e0b2ea9a53c7ae0823, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:52.080951 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a00d5-92d9-4bba-92b2-cece4da61d30 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:52.173574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 387/765] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:21:51 2022] PUT /identity/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/eb70408fecfe41e0b2ea9a53c7ae0823/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:21:52.182636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f512b05-61b8-493a-8d3e-91ee3017e4b8 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:52.182830 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f512b05-61b8-493a-8d3e-91ee3017e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:52.183099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f512b05-61b8-493a-8d3e-91ee3017e4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:52.190599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767945b1-42c3-4cb5-8fed-b57372203f6b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:52.227770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-5f512b05-61b8-493a-8d3e-91ee3017e4b8 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:52.230790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5f512b05-61b8-493a-8d3e-91ee3017e4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:52.277531 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dc006-f1c2-49f2-a1d2-87c1a0f1e303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:52.279066 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dc006-f1c2-49f2-a1d2-87c1a0f1e303 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:52.279346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dc006-f1c2-49f2-a1d2-87c1a0f1e303 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:52.279614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dc006-f1c2-49f2-a1d2-87c1a0f1e303 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:52.280318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dc006-f1c2-49f2-a1d2-87c1a0f1e303 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:52.280617 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dc006-f1c2-49f2-a1d2-87c1a0f1e303 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:52.285767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dc006-f1c2-49f2-a1d2-87c1a0f1e303 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:52.319143 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 379/766] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:52.335756 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dc006-f1c2-49f2-a1d2-87c1a0f1e303 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:52.342546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:52.381273 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:52.387653 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 388/767] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:21:52.486754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dc006-f1c2-49f2-a1d2-87c1a0f1e303 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:52.524803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108ff01-0460-4f87-9dd9-4bb52e479e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:52.525764 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108ff01-0460-4f87-9dd9-4bb52e479e91 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:52.526235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108ff01-0460-4f87-9dd9-4bb52e479e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:52.526729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108ff01-0460-4f87-9dd9-4bb52e479e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:52.527648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108ff01-0460-4f87-9dd9-4bb52e479e91 None admin] RBAC: Adding query filter params (role.id=b1cf59e6d9dd49179551b98cee02776c, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=597874ccdd284d9d88f3e743c4759d95) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:52.528168 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108ff01-0460-4f87-9dd9-4bb52e479e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:52.529804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108ff01-0460-4f87-9dd9-4bb52e479e91 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:52.536601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 380/768] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:21:52 2022] GET /identity/v3/role_assignments?user.id=597874ccdd284d9d88f3e743c4759d95&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=b1cf59e6d9dd49179551b98cee02776c => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:52.573976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca775c-445a-4112-85eb-f513cb585a0f None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:52.574463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca775c-445a-4112-85eb-f513cb585a0f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:52.574463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca775c-445a-4112-85eb-f513cb585a0f None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:52.576031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 389/769] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:52.582279 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443849b-e42b-4ed0-9a45-8f1a8649fe14 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:52.583227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443849b-e42b-4ed0-9a45-8f1a8649fe14 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:52.583695 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443849b-e42b-4ed0-9a45-8f1a8649fe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:52.603857 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8443849b-e42b-4ed0-9a45-8f1a8649fe14 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:52.605417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8443849b-e42b-4ed0-9a45-8f1a8649fe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:52.693571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 381/770] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:21:52.711241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca775c-445a-4112-85eb-f513cb585a0f None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:52.869443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca775c-445a-4112-85eb-f513cb585a0f None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:52.912630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492cc6b-ff6f-48d6-86ab-c9058fbbd13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:52.913652 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492cc6b-ff6f-48d6-86ab-c9058fbbd13b None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:52.914127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492cc6b-ff6f-48d6-86ab-c9058fbbd13b None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:52.914592 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492cc6b-ff6f-48d6-86ab-c9058fbbd13b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:52.915493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492cc6b-ff6f-48d6-86ab-c9058fbbd13b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:52.917143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492cc6b-ff6f-48d6-86ab-c9058fbbd13b None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-e492cc6b-ff6f-48d6-86ab-c9058fbbd13b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:52.932224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:52.933252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:52.934078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:52.934078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:52.934078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:52.934078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:52.934078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:52.934078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:52.934078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:52.934078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:52.934078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:52.934078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:52.934078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:21:52.934078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:21:52.934078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 04:21:52.934078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:52.936885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 390/771] 10.222.0.50 () {56 vars in 1129 bytes} [Sat Sep 17 04:21:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:52.944431 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443849b-e42b-4ed0-9a45-8f1a8649fe14 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:52.967970 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:53.059304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443849b-e42b-4ed0-9a45-8f1a8649fe14 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:53.095198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6b777-8160-483d-b148-49d53c51aa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:53.095808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6b777-8160-483d-b148-49d53c51aa69 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:53.096084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6b777-8160-483d-b148-49d53c51aa69 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:53.096354 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6b777-8160-483d-b148-49d53c51aa69 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:53.097533 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6b777-8160-483d-b148-49d53c51aa69 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:53.097821 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6b777-8160-483d-b148-49d53c51aa69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:53.099205 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6b777-8160-483d-b148-49d53c51aa69 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:53.099689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492cc6b-ff6f-48d6-86ab-c9058fbbd13b None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:53.104009 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 382/772] 10.222.0.50 () {56 vars in 1124 bytes} [Sat Sep 17 04:21:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:53.109515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6b777-8160-483d-b148-49d53c51aa69 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:53.162680 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:53.218607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:53.241633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6b777-8160-483d-b148-49d53c51aa69 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:53.288364 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1a73f-c486-48de-bf74-6567929bed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:53.288978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1a73f-c486-48de-bf74-6567929bed79 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:53.289277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1a73f-c486-48de-bf74-6567929bed79 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:53.289541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1a73f-c486-48de-bf74-6567929bed79 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:53.290172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1a73f-c486-48de-bf74-6567929bed79 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:53.290466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1a73f-c486-48de-bf74-6567929bed79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:53.291826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1a73f-c486-48de-bf74-6567929bed79 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:53.296723 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492cc6b-ff6f-48d6-86ab-c9058fbbd13b None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:53.311719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 383/773] 10.222.0.50 () {56 vars in 1124 bytes} [Sat Sep 17 04:21:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:53.317610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1a73f-c486-48de-bf74-6567929bed79 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:53.376440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb439d6-99a1-48b5-b5e6-f7164618ea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:53.377093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb439d6-99a1-48b5-b5e6-f7164618ea1f None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:53.377376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb439d6-99a1-48b5-b5e6-f7164618ea1f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:53.377646 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb439d6-99a1-48b5-b5e6-f7164618ea1f None admin] PATH_INFO: `/v3/services/network` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:53.378250 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb439d6-99a1-48b5-b5e6-f7164618ea1f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:53.379668 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb439d6-99a1-48b5-b5e6-f7164618ea1f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-1eb439d6-99a1-48b5-b5e6-f7164618ea1f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:53.400978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:53.401999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:53.402812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 391/774] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:53 2022] GET /identity/v3/services/network => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:53.410821 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb439d6-99a1-48b5-b5e6-f7164618ea1f None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:53.488606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1a73f-c486-48de-bf74-6567929bed79 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:53.535358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e0285-b62b-4ebf-851c-bf2f12f42f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:53.535966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e0285-b62b-4ebf-851c-bf2f12f42f6b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:53.536233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e0285-b62b-4ebf-851c-bf2f12f42f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:53.536492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e0285-b62b-4ebf-851c-bf2f12f42f6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:53.537226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e0285-b62b-4ebf-851c-bf2f12f42f6b None admin] RBAC: Adding query filter params (interface=public, service_id=97201c4adb5741fdb94029d9a3c7395a, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:53.537526 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e0285-b62b-4ebf-851c-bf2f12f42f6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:53.541264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e0285-b62b-4ebf-851c-bf2f12f42f6b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:53.557087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 384/775] 10.222.0.50 () {56 vars in 1251 bytes} [Sat Sep 17 04:21:53 2022] GET /identity/v3/endpoints?service_id=97201c4adb5741fdb94029d9a3c7395a&interface=public®ion_id=RegionOne => generated 194 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:53.562377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e0285-b62b-4ebf-851c-bf2f12f42f6b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:53.576155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:53.666735 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb439d6-99a1-48b5-b5e6-f7164618ea1f None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:53.689385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:53.708053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e0285-b62b-4ebf-851c-bf2f12f42f6b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:53.721497 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d556a-4ac0-4ab4-9ffa-304cab721ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:53.722162 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d556a-4ac0-4ab4-9ffa-304cab721ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:53.722442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d556a-4ac0-4ab4-9ffa-304cab721ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:53.722714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d556a-4ac0-4ab4-9ffa-304cab721ba3 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:53.723340 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d556a-4ac0-4ab4-9ffa-304cab721ba3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:53.723640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d556a-4ac0-4ab4-9ffa-304cab721ba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:53.725031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d556a-4ac0-4ab4-9ffa-304cab721ba3 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:53.733965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 392/776] 10.222.0.50 () {56 vars in 1112 bytes} [Sat Sep 17 04:21:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:53.741999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d556a-4ac0-4ab4-9ffa-304cab721ba3 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:53.791767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d689575-080c-4a29-bf14-40ad5dfe08bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:53.792418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d689575-080c-4a29-bf14-40ad5dfe08bf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:53.792698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d689575-080c-4a29-bf14-40ad5dfe08bf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:53.792970 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d689575-080c-4a29-bf14-40ad5dfe08bf None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:53.793613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d689575-080c-4a29-bf14-40ad5dfe08bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:53.795002 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d689575-080c-4a29-bf14-40ad5dfe08bf None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:53.807403 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 385/777] 10.222.0.50 () {56 vars in 1087 bytes} [Sat Sep 17 04:21:53 2022] GET /identity/v3/services => generated 772 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:53.919294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d556a-4ac0-4ab4-9ffa-304cab721ba3 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:53.975796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8572b75-4021-43c0-813d-1dc4d8d31056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:53.975796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8572b75-4021-43c0-813d-1dc4d8d31056 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:53.975796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8572b75-4021-43c0-813d-1dc4d8d31056 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:53.976163 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8572b75-4021-43c0-813d-1dc4d8d31056 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:53.976675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8572b75-4021-43c0-813d-1dc4d8d31056 None admin] RBAC: Adding query filter params (type=network) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:53.976980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8572b75-4021-43c0-813d-1dc4d8d31056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:53.978773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8572b75-4021-43c0-813d-1dc4d8d31056 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:53.989788 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 393/778] 10.222.0.50 () {56 vars in 1112 bytes} [Sat Sep 17 04:21:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:21:53.996061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d689575-080c-4a29-bf14-40ad5dfe08bf None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:54.077601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:54.108295 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d689575-080c-4a29-bf14-40ad5dfe08bf None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:54.156749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbc3e3-d7a2-490b-a5fc-26d33ae2731b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:54.159943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc3e3-d7a2-490b-a5fc-26d33ae2731b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:54.159943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc3e3-d7a2-490b-a5fc-26d33ae2731b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:54.159943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc3e3-d7a2-490b-a5fc-26d33ae2731b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:54.159943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbc3e3-d7a2-490b-a5fc-26d33ae2731b None admin] RBAC: Adding query filter params (interface=public, service_id=e200e07bc6c741d3836360b3a74d839c, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:54.159943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbc3e3-d7a2-490b-a5fc-26d33ae2731b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:54.160711 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbc3e3-d7a2-490b-a5fc-26d33ae2731b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:54.171854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 386/779] 10.222.0.50 () {56 vars in 1251 bytes} [Sat Sep 17 04:21:53 2022] GET /identity/v3/endpoints?service_id=e200e07bc6c741d3836360b3a74d839c&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:54.178075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8572b75-4021-43c0-813d-1dc4d8d31056 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:54.252765 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:54.337222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8572b75-4021-43c0-813d-1dc4d8d31056 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:54.384283 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc852429-208b-46e3-85f3-0b1226598da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:54.384904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc852429-208b-46e3-85f3-0b1226598da1 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:54.385215 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc852429-208b-46e3-85f3-0b1226598da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:54.385491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc852429-208b-46e3-85f3-0b1226598da1 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:54.386093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc852429-208b-46e3-85f3-0b1226598da1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:54.387501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc852429-208b-46e3-85f3-0b1226598da1 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:54.393447 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 394/780] 10.222.0.50 () {56 vars in 1087 bytes} [Sat Sep 17 04:21:54 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:54.602752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae93708-0686-4bbc-bed3-af2548eca6d6 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:54.603276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae93708-0686-4bbc-bed3-af2548eca6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:54.603684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae93708-0686-4bbc-bed3-af2548eca6d6 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:54.606152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 387/781] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:54.612633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ad77f-09dd-4054-b39e-98147ad214c1 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:54.613620 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ad77f-09dd-4054-b39e-98147ad214c1 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:54.613983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ad77f-09dd-4054-b39e-98147ad214c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:54.643079 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-382ad77f-09dd-4054-b39e-98147ad214c1 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:54.644382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-382ad77f-09dd-4054-b39e-98147ad214c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:54.740020 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 395/782] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:21:54.942220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fb1ad-e80c-45b0-88ed-8e60fa5913d7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:54.942720 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fb1ad-e80c-45b0-88ed-8e60fa5913d7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:54.942720 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fb1ad-e80c-45b0-88ed-8e60fa5913d7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:54.944464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 388/783] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:54.950673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665202ed-e061-4f4e-a12e-5eaf64386e09 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:54.950992 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665202ed-e061-4f4e-a12e-5eaf64386e09 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:54.951226 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665202ed-e061-4f4e-a12e-5eaf64386e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:54.974803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-665202ed-e061-4f4e-a12e-5eaf64386e09 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:54.976021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-665202ed-e061-4f4e-a12e-5eaf64386e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:55.002937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:55.054671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 396/784] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:21:55.068906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c4b74-a4c5-4c3d-8c0a-23fcc88cd083 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:55.069220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c4b74-a4c5-4c3d-8c0a-23fcc88cd083 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:55.069491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c4b74-a4c5-4c3d-8c0a-23fcc88cd083 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:55.071102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 389/785] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:55.076424 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e36af8-831f-4aee-8c37-6e25dc6427c5 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:55.076712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e36af8-831f-4aee-8c37-6e25dc6427c5 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:55.076985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e36af8-831f-4aee-8c37-6e25dc6427c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:55.108678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c4b74-a4c5-4c3d-8c0a-23fcc88cd083 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:55.114119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-f2e36af8-831f-4aee-8c37-6e25dc6427c5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:55.115317 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f2e36af8-831f-4aee-8c37-6e25dc6427c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:55.236856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 397/786] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:21:55.283120 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c4b74-a4c5-4c3d-8c0a-23fcc88cd083 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:55.318597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cd261-0ea4-4e1a-8d38-b3ffe04fe449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:55.319224 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cd261-0ea4-4e1a-8d38-b3ffe04fe449 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:55.319495 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cd261-0ea4-4e1a-8d38-b3ffe04fe449 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:55.319757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cd261-0ea4-4e1a-8d38-b3ffe04fe449 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:55.322464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:55.331174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cd261-0ea4-4e1a-8d38-b3ffe04fe449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-848cd261-0ea4-4e1a-8d38-b3ffe04fe449 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:55.336111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:55.337037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:55.337907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:55.337907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:55.337907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:55.337907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:55.337907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:55.337907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:55.337907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:55.337907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:55.337907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:55.337907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:55.337907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:55.337907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:55.337907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 390/787] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:21:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:55.344909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e36af8-831f-4aee-8c37-6e25dc6427c5 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:55.390109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cd261-0ea4-4e1a-8d38-b3ffe04fe449 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:55.459270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:55.470236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e36af8-831f-4aee-8c37-6e25dc6427c5 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:55.514991 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29438f9-ce32-4ab2-989c-f45b9e4ed7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:55.516721 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29438f9-ce32-4ab2-989c-f45b9e4ed7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:55.517409 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29438f9-ce32-4ab2-989c-f45b9e4ed7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:55.519597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29438f9-ce32-4ab2-989c-f45b9e4ed7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:55.520918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29438f9-ce32-4ab2-989c-f45b9e4ed7d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:55.522295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29438f9-ce32-4ab2-989c-f45b9e4ed7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:55.526513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29438f9-ce32-4ab2-989c-f45b9e4ed7d2 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:55.541514 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 398/788] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:55.547644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29438f9-ce32-4ab2-989c-f45b9e4ed7d2 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:55.619758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cd261-0ea4-4e1a-8d38-b3ffe04fe449 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:55.655385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c8e29-1fed-4904-8001-f66d4be02818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:55.656018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c8e29-1fed-4904-8001-f66d4be02818 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:55.656293 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c8e29-1fed-4904-8001-f66d4be02818 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:55.656562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c8e29-1fed-4904-8001-f66d4be02818 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:55.667539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c8e29-1fed-4904-8001-f66d4be02818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:55.686186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29438f9-ce32-4ab2-989c-f45b9e4ed7d2 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:55.728534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fd3d2-9022-4c76-a572-a76877214116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:55.729242 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fd3d2-9022-4c76-a572-a76877214116 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:55.729524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fd3d2-9022-4c76-a572-a76877214116 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:55.729800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fd3d2-9022-4c76-a572-a76877214116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:55.742064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fd3d2-9022-4c76-a572-a76877214116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:55.743549 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fd3d2-9022-4c76-a572-a76877214116 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-a70fd3d2-9022-4c76-a572-a76877214116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:55.759908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:55.760918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:55.761873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:55.761873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:55.761873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:55.765247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 399/789] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:55.766320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fd3d2-9022-4c76-a572-a76877214116 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:55.778573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-432c8e29-1fed-4904-8001-f66d4be02818 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:55.797318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:55.799565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:55.802708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:55.802708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:55.802708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:55.802708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:55.802708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:55.802708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:55.802708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:55.802708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:55.802708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:55.802708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:55.802708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:21:55.802708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:55.802708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 391/790] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:21:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:21:55.802708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c8e29-1fed-4904-8001-f66d4be02818 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:55.871798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:55.879800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fd3d2-9022-4c76-a572-a76877214116 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:55.918175 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177002b-3523-44f3-b5f7-289f676600c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:55.919185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177002b-3523-44f3-b5f7-289f676600c4 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:55.919604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177002b-3523-44f3-b5f7-289f676600c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:55.920091 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177002b-3523-44f3-b5f7-289f676600c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:55.923071 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c8e29-1fed-4904-8001-f66d4be02818 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:55.932301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177002b-3523-44f3-b5f7-289f676600c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-1177002b-3523-44f3-b5f7-289f676600c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:21:55.938191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:55.939247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:55.940219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:55.940219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:55.940219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:55.940219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:55.940219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:21:55.940219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:21:55.940219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:21:55.940219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:21:55.940219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:21:55.940219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:21:55.940219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:21:55.940219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:55.947787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 400/791] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:21:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:55.948869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177002b-3523-44f3-b5f7-289f676600c4 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:55.959274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c4739-d48e-4ace-83f7-229aae56b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:55.959948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c4739-d48e-4ace-83f7-229aae56b480 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:55.960226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c4739-d48e-4ace-83f7-229aae56b480 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:55.960493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c4739-d48e-4ace-83f7-229aae56b480 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:55.961450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c4739-d48e-4ace-83f7-229aae56b480 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:55.961595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c4739-d48e-4ace-83f7-229aae56b480 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:55.963099 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c4739-d48e-4ace-83f7-229aae56b480 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:55.980985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 392/792] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:55.981796 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c4739-d48e-4ace-83f7-229aae56b480 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:56.021378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:56.069617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177002b-3523-44f3-b5f7-289f676600c4 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:56.100299 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c4739-d48e-4ace-83f7-229aae56b480 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:56.112362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d7279-ef24-4a2e-b37d-0b1514c8c9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:56.114058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d7279-ef24-4a2e-b37d-0b1514c8c9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:56.114619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d7279-ef24-4a2e-b37d-0b1514c8c9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:56.115201 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d7279-ef24-4a2e-b37d-0b1514c8c9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:56.116745 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d7279-ef24-4a2e-b37d-0b1514c8c9a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:56.117257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d7279-ef24-4a2e-b37d-0b1514c8c9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:56.118974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d7279-ef24-4a2e-b37d-0b1514c8c9a8 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:56.121939 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:56.131559 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 401/793] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:21:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:56.133388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d7279-ef24-4a2e-b37d-0b1514c8c9a8 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:56.144292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68753033-11c0-4641-bd35-7d81cc910949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:56.145080 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68753033-11c0-4641-bd35-7d81cc910949 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:56.145455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68753033-11c0-4641-bd35-7d81cc910949 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:56.145791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68753033-11c0-4641-bd35-7d81cc910949 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:56.149431 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68753033-11c0-4641-bd35-7d81cc910949 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:56.149976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68753033-11c0-4641-bd35-7d81cc910949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:56.151578 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68753033-11c0-4641-bd35-7d81cc910949 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:56.174672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 393/794] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:21:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:56.174672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68753033-11c0-4641-bd35-7d81cc910949 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:56.274590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d7279-ef24-4a2e-b37d-0b1514c8c9a8 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:56.309383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68753033-11c0-4641-bd35-7d81cc910949 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:56.312587 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:56.323249 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f015bec-f8a1-47eb-b0f6-7df63d2f9afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:56.324327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f015bec-f8a1-47eb-b0f6-7df63d2f9afc None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:56.341772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f015bec-f8a1-47eb-b0f6-7df63d2f9afc None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:56.341772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f015bec-f8a1-47eb-b0f6-7df63d2f9afc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:56.341772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f015bec-f8a1-47eb-b0f6-7df63d2f9afc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:56.341772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f015bec-f8a1-47eb-b0f6-7df63d2f9afc None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:56.346293 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693dd4b-79e0-48cc-afe9-e245d1c3513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:56.347586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693dd4b-79e0-48cc-afe9-e245d1c3513b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:56.347906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693dd4b-79e0-48cc-afe9-e245d1c3513b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:56.348391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693dd4b-79e0-48cc-afe9-e245d1c3513b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-4f015bec-f8a1-47eb-b0f6-7df63d2f9afc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:56.354740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:56.355650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:56.356604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:56.356604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:56.356604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:56.356604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:56.356604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:56.356604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:56.356604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:56.356604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:56.356604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 04:21:56.356604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:56.363129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 402/795] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:21:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:56.363129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f015bec-f8a1-47eb-b0f6-7df63d2f9afc None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:56.368811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693dd4b-79e0-48cc-afe9-e245d1c3513b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:56.370326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693dd4b-79e0-48cc-afe9-e245d1c3513b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3693dd4b-79e0-48cc-afe9-e245d1c3513b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:56.386494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:56.387440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:56.388308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:56.388308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:56.388308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:56.388308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 394/796] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:56.389178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693dd4b-79e0-48cc-afe9-e245d1c3513b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:56.423244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:56.497959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f015bec-f8a1-47eb-b0f6-7df63d2f9afc None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:56.528707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693dd4b-79e0-48cc-afe9-e245d1c3513b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:56.538999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a883577-f665-4b6f-8979-f38be0127bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:56.539694 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a883577-f665-4b6f-8979-f38be0127bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:56.539969 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a883577-f665-4b6f-8979-f38be0127bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:56.540238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a883577-f665-4b6f-8979-f38be0127bc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:56.552234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a883577-f665-4b6f-8979-f38be0127bc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:56.553731 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a883577-f665-4b6f-8979-f38be0127bc3 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-0a883577-f665-4b6f-8979-f38be0127bc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:56.569145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:56.570887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:56.571767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:56.571767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:56.571767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:56.571767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 403/797] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:56.571767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a883577-f665-4b6f-8979-f38be0127bc3 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:56.577949 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87814c0b-da83-4978-b9e6-68b8f92e15a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:56.578620 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87814c0b-da83-4978-b9e6-68b8f92e15a8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:56.578963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87814c0b-da83-4978-b9e6-68b8f92e15a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:56.579234 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87814c0b-da83-4978-b9e6-68b8f92e15a8 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:56.579986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87814c0b-da83-4978-b9e6-68b8f92e15a8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:56.580286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87814c0b-da83-4978-b9e6-68b8f92e15a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:56.582331 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87814c0b-da83-4978-b9e6-68b8f92e15a8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:56.601693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 395/798] 10.222.0.50 () {56 vars in 1135 bytes} [Sat Sep 17 04:21:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:56.603248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f7ba9-f025-4665-a0a4-655b83a377a0 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:56.603712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f7ba9-f025-4665-a0a4-655b83a377a0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:56.604158 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f7ba9-f025-4665-a0a4-655b83a377a0 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:56.605804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 396/799] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:56.606747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f7ba9-f025-4665-a0a4-655b83a377a0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:56.624559 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:56.689346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a883577-f665-4b6f-8979-f38be0127bc3 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:56.698533 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:56.711934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f7ba9-f025-4665-a0a4-655b83a377a0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:56.728466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e5dde-640a-40c3-b2da-5ddb9750f08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:56.729102 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e5dde-640a-40c3-b2da-5ddb9750f08e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:56.729376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e5dde-640a-40c3-b2da-5ddb9750f08e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:56.729644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e5dde-640a-40c3-b2da-5ddb9750f08e None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:56.730278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e5dde-640a-40c3-b2da-5ddb9750f08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:56.730577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e5dde-640a-40c3-b2da-5ddb9750f08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:56.731977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e5dde-640a-40c3-b2da-5ddb9750f08e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:56.750044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 404/800] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:56.750044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cf7d2-c1c9-4b9e-99bf-d855e174742a None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:56.750044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cf7d2-c1c9-4b9e-99bf-d855e174742a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:56.750044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cf7d2-c1c9-4b9e-99bf-d855e174742a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:56.754080 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5760db-cc50-4ed1-a67f-c1953e0b02c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:56.754768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5760db-cc50-4ed1-a67f-c1953e0b02c4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:56.755043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5760db-cc50-4ed1-a67f-c1953e0b02c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:56.755309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5760db-cc50-4ed1-a67f-c1953e0b02c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:56.755950 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5760db-cc50-4ed1-a67f-c1953e0b02c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:56.756253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5760db-cc50-4ed1-a67f-c1953e0b02c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:56.757654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5760db-cc50-4ed1-a67f-c1953e0b02c4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:56.767364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-881cf7d2-c1c9-4b9e-99bf-d855e174742a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:56.768538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-881cf7d2-c1c9-4b9e-99bf-d855e174742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:56.774587 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 397/801] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:56.774587 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5760db-cc50-4ed1-a67f-c1953e0b02c4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:56.841377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 405/802] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:21:56.842464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cf7d2-c1c9-4b9e-99bf-d855e174742a None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:56.877395 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:56.890493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5760db-cc50-4ed1-a67f-c1953e0b02c4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:56.933731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefa694-cc32-4fbe-a42a-d2ccb4ee47f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:56.934967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefa694-cc32-4fbe-a42a-d2ccb4ee47f2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:56.935438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefa694-cc32-4fbe-a42a-d2ccb4ee47f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:56.936071 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefa694-cc32-4fbe-a42a-d2ccb4ee47f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:56.950203 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefa694-cc32-4fbe-a42a-d2ccb4ee47f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:56.952263 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefa694-cc32-4fbe-a42a-d2ccb4ee47f2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:56.952730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cf7d2-c1c9-4b9e-99bf-d855e174742a None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:56.962791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1eefa694-cc32-4fbe-a42a-d2ccb4ee47f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:56.971312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:56.978726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:56.979582 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:56.979582 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:56.979582 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:56.979582 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 398/803] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:56.979582 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefa694-cc32-4fbe-a42a-d2ccb4ee47f2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:57.001116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081248aa-b3b2-417e-a178-1fceee3126fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:57.001781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081248aa-b3b2-417e-a178-1fceee3126fd None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:57.002058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081248aa-b3b2-417e-a178-1fceee3126fd None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:57.002335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081248aa-b3b2-417e-a178-1fceee3126fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:57.012649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081248aa-b3b2-417e-a178-1fceee3126fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:57.014240 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081248aa-b3b2-417e-a178-1fceee3126fd None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-081248aa-b3b2-417e-a178-1fceee3126fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:57.028372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:57.029619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:57.030522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:57.030522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:57.030522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:57.030522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:57.030522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:57.030522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:57.030522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:57.030522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:57.030522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:21:57.030522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:57.034315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 406/804] 10.222.0.50 () {56 vars in 1093 bytes} [Sat Sep 17 04:21:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:57.035581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081248aa-b3b2-417e-a178-1fceee3126fd None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:57.112160 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefa694-cc32-4fbe-a42a-d2ccb4ee47f2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:57.137552 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:57.147261 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65032d85-bd3a-45fc-a743-58d99dc51234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:57.148505 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081248aa-b3b2-417e-a178-1fceee3126fd None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:57.148603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65032d85-bd3a-45fc-a743-58d99dc51234 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:57.148603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65032d85-bd3a-45fc-a743-58d99dc51234 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:57.148603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65032d85-bd3a-45fc-a743-58d99dc51234 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:57.156724 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65032d85-bd3a-45fc-a743-58d99dc51234 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:57.158197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65032d85-bd3a-45fc-a743-58d99dc51234 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-65032d85-bd3a-45fc-a743-58d99dc51234 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:21:57.169511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:57.170603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:57.171544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:57.171544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:57.171544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:21:57.171544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:21:57.171544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:21:57.171544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:21:57.171544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:21:57.171544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:21:57.171544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 04:21:57.171544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:57.171544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 399/805] 10.222.0.50 () {56 vars in 1117 bytes} [Sat Sep 17 04:21:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:57.171544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65032d85-bd3a-45fc-a743-58d99dc51234 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:57.186085 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6c3d8-477e-41b1-a768-cf15a5e44fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:57.186684 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6c3d8-477e-41b1-a768-cf15a5e44fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:57.186959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6c3d8-477e-41b1-a768-cf15a5e44fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:57.187223 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6c3d8-477e-41b1-a768-cf15a5e44fb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:57.187857 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6c3d8-477e-41b1-a768-cf15a5e44fb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:57.188159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6c3d8-477e-41b1-a768-cf15a5e44fb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:57.189614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6c3d8-477e-41b1-a768-cf15a5e44fb4 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:57.201907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 407/806] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:57.203063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a537ef6-1edb-4c74-b57f-a867d20cc624 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:57.203337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a537ef6-1edb-4c74-b57f-a867d20cc624 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:57.203603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a537ef6-1edb-4c74-b57f-a867d20cc624 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:57.207090 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 408/807] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:21:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:21:57.207090 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a537ef6-1edb-4c74-b57f-a867d20cc624 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:57.232287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:57.275249 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65032d85-bd3a-45fc-a743-58d99dc51234 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:57.305191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a537ef6-1edb-4c74-b57f-a867d20cc624 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:57.308443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a50969-a131-4ed3-a30b-6686c7b8983b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:57.309065 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a50969-a131-4ed3-a30b-6686c7b8983b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:57.309339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a50969-a131-4ed3-a30b-6686c7b8983b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:57.309605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a50969-a131-4ed3-a30b-6686c7b8983b None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:57.310317 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a50969-a131-4ed3-a30b-6686c7b8983b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:57.310616 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a50969-a131-4ed3-a30b-6686c7b8983b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:57.312025 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a50969-a131-4ed3-a30b-6686c7b8983b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:57.330215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 400/808] 10.222.0.50 () {56 vars in 1133 bytes} [Sat Sep 17 04:21:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:57.331062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a50969-a131-4ed3-a30b-6686c7b8983b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:57.343906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208312-3e00-4c9e-b58d-9e885c0ba785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:57.344529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208312-3e00-4c9e-b58d-9e885c0ba785 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:57.344808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208312-3e00-4c9e-b58d-9e885c0ba785 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:57.345102 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208312-3e00-4c9e-b58d-9e885c0ba785 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:57.345680 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e208312-3e00-4c9e-b58d-9e885c0ba785 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:57.347073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e208312-3e00-4c9e-b58d-9e885c0ba785 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-1e208312-3e00-4c9e-b58d-9e885c0ba785 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:57.355649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:57.361894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:57.363540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 409/809] 10.222.0.50 () {56 vars in 1129 bytes} [Sat Sep 17 04:21:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:57.364333 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208312-3e00-4c9e-b58d-9e885c0ba785 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:57.374029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:57.428350 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a50969-a131-4ed3-a30b-6686c7b8983b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:57.445519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:57.457797 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208312-3e00-4c9e-b58d-9e885c0ba785 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:57.462076 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021080af-414f-4171-8cfb-b43b1ffc77ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:57.462668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021080af-414f-4171-8cfb-b43b1ffc77ce None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:57.462940 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021080af-414f-4171-8cfb-b43b1ffc77ce None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:57.463198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021080af-414f-4171-8cfb-b43b1ffc77ce None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:57.463910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021080af-414f-4171-8cfb-b43b1ffc77ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:57.464207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021080af-414f-4171-8cfb-b43b1ffc77ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:57.465669 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021080af-414f-4171-8cfb-b43b1ffc77ce None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:57.484497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 401/810] 10.222.0.50 () {56 vars in 1149 bytes} [Sat Sep 17 04:21:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:57.485811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6665c-f68a-4da5-9033-25fb6774eb0d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:57.486090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6665c-f68a-4da5-9033-25fb6774eb0d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:57.486354 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6665c-f68a-4da5-9033-25fb6774eb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:57.506435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8cc6665c-f68a-4da5-9033-25fb6774eb0d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:21:57.507649 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8cc6665c-f68a-4da5-9033-25fb6774eb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:21:57.576647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 402/811] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:21:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:21:57.577536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6665c-f68a-4da5-9033-25fb6774eb0d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:57.616771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47822f8f-8ef1-4d5d-ba01-1a2748fdef19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:57.617347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47822f8f-8ef1-4d5d-ba01-1a2748fdef19 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:57.617622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47822f8f-8ef1-4d5d-ba01-1a2748fdef19 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:57.617932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47822f8f-8ef1-4d5d-ba01-1a2748fdef19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:57.624809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47822f8f-8ef1-4d5d-ba01-1a2748fdef19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:57.626285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47822f8f-8ef1-4d5d-ba01-1a2748fdef19 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-47822f8f-8ef1-4d5d-ba01-1a2748fdef19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:57.637769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:57.638649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:57.639526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:57.639526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:57.639526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:57.639526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:57.639526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:57.639526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:57.639526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:57.639526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:57.639526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 410/812] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:57.640003 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47822f8f-8ef1-4d5d-ba01-1a2748fdef19 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:57.688473 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6665c-f68a-4da5-9033-25fb6774eb0d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:57.696735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:57.720604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:57.722883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8e4e3-b5f2-47a7-9a82-884d98637f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:57.723488 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8e4e3-b5f2-47a7-9a82-884d98637f2d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:57.723759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8e4e3-b5f2-47a7-9a82-884d98637f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:57.724024 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8e4e3-b5f2-47a7-9a82-884d98637f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:57.750274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47822f8f-8ef1-4d5d-ba01-1a2748fdef19 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:57.788953 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10f1c2-4450-4457-9345-1ecdb4474fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:57.789590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10f1c2-4450-4457-9345-1ecdb4474fbc None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:57.789870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10f1c2-4450-4457-9345-1ecdb4474fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:57.790138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10f1c2-4450-4457-9345-1ecdb4474fbc None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:57.790757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10f1c2-4450-4457-9345-1ecdb4474fbc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:57.791059 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10f1c2-4450-4457-9345-1ecdb4474fbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:57.792472 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10f1c2-4450-4457-9345-1ecdb4474fbc None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:57.797390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 411/813] 10.222.0.50 () {56 vars in 1124 bytes} [Sat Sep 17 04:21:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:57.797835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8e4e3-b5f2-47a7-9a82-884d98637f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:57.798161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10f1c2-4450-4457-9345-1ecdb4474fbc None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:57.799860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8e4e3-b5f2-47a7-9a82-884d98637f2d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:57.903672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 403/814] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:21:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:21:57.904259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8e4e3-b5f2-47a7-9a82-884d98637f2d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:57.911009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10f1c2-4450-4457-9345-1ecdb4474fbc None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:57.911773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:57.945322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f7735-ee8b-402f-8485-70fd7c4e87a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:57.945948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f7735-ee8b-402f-8485-70fd7c4e87a0 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:57.946219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f7735-ee8b-402f-8485-70fd7c4e87a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:57.946484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f7735-ee8b-402f-8485-70fd7c4e87a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:57.952878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:57.956767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f7735-ee8b-402f-8485-70fd7c4e87a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:57.958250 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f7735-ee8b-402f-8485-70fd7c4e87a0 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-0e0f7735-ee8b-402f-8485-70fd7c4e87a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:57.972578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:57.973603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:57.974479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:57.974479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:57.974479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:57.974479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 412/815] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:57.975116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f7735-ee8b-402f-8485-70fd7c4e87a0 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:58.003610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8e4e3-b5f2-47a7-9a82-884d98637f2d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:58.038610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa1ade-d608-4995-839e-5ab9a928e6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:58.039213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa1ade-d608-4995-839e-5ab9a928e6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:58.039485 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa1ade-d608-4995-839e-5ab9a928e6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:58.039747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa1ade-d608-4995-839e-5ab9a928e6e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:58.040423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa1ade-d608-4995-839e-5ab9a928e6e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:58.040722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa1ade-d608-4995-839e-5ab9a928e6e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:58.042171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa1ade-d608-4995-839e-5ab9a928e6e1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:58.054161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 404/816] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:58.054958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa1ade-d608-4995-839e-5ab9a928e6e1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:58.072459 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f7735-ee8b-402f-8485-70fd7c4e87a0 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:58.104700 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c317d-c45c-4b25-8802-c5c816973d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:58.105338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c317d-c45c-4b25-8802-c5c816973d5e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:58.105614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c317d-c45c-4b25-8802-c5c816973d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:58.105881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c317d-c45c-4b25-8802-c5c816973d5e None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:58.106502 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c317d-c45c-4b25-8802-c5c816973d5e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:58.106809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c317d-c45c-4b25-8802-c5c816973d5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:58.108155 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c317d-c45c-4b25-8802-c5c816973d5e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:58.113528 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 413/817] 10.222.0.50 () {56 vars in 1124 bytes} [Sat Sep 17 04:21:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:58.117119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c317d-c45c-4b25-8802-c5c816973d5e None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:58.121290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:58.156131 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa1ade-d608-4995-839e-5ab9a928e6e1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:58.169284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:58.189586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9647b6-8a26-4fcb-ac85-309d06eb3ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:58.190204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9647b6-8a26-4fcb-ac85-309d06eb3ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:58.191090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9647b6-8a26-4fcb-ac85-309d06eb3ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:58.191349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9647b6-8a26-4fcb-ac85-309d06eb3ef1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:58.191925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9647b6-8a26-4fcb-ac85-309d06eb3ef1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:58.193327 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9647b6-8a26-4fcb-ac85-309d06eb3ef1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-6b9647b6-8a26-4fcb-ac85-309d06eb3ef1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:58.204270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:58.205449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:21:58.206477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 405/818] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:58 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:58.207516 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9647b6-8a26-4fcb-ac85-309d06eb3ef1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:58.219418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c317d-c45c-4b25-8802-c5c816973d5e None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:58.252939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eab1b6-5ef9-4c5b-9524-d75baaf78b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:58.254341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab1b6-5ef9-4c5b-9524-d75baaf78b6f None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:58.254622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab1b6-5ef9-4c5b-9524-d75baaf78b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:58.254895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab1b6-5ef9-4c5b-9524-d75baaf78b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:58.265332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eab1b6-5ef9-4c5b-9524-d75baaf78b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:58.266770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eab1b6-5ef9-4c5b-9524-d75baaf78b6f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-83eab1b6-5ef9-4c5b-9524-d75baaf78b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:21:58.281484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:58.282633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:21:58.283718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:21:58.283718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:21:58.283718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:58.286322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 414/819] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:58.286322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eab1b6-5ef9-4c5b-9524-d75baaf78b6f None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:58.303636 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9647b6-8a26-4fcb-ac85-309d06eb3ef1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:58.330716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:58.336101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5651e-00c5-4ee2-87fd-3e90fd89fa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:58.336699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5651e-00c5-4ee2-87fd-3e90fd89fa46 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:58.336978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5651e-00c5-4ee2-87fd-3e90fd89fa46 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:58.337269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5651e-00c5-4ee2-87fd-3e90fd89fa46 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:58.337900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5651e-00c5-4ee2-87fd-3e90fd89fa46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:58.338197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5651e-00c5-4ee2-87fd-3e90fd89fa46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:58.339555 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5651e-00c5-4ee2-87fd-3e90fd89fa46 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:58.350947 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 406/820] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:58.351725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5651e-00c5-4ee2-87fd-3e90fd89fa46 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:58.383320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eab1b6-5ef9-4c5b-9524-d75baaf78b6f None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:58.390299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:58.416195 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92c424-5af9-4bba-928c-bd8125badeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:58.416770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92c424-5af9-4bba-928c-bd8125badeda None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:58.417063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92c424-5af9-4bba-928c-bd8125badeda None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:58.417330 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92c424-5af9-4bba-928c-bd8125badeda None admin] PATH_INFO: `/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/c653cb8c86534dc2b963f39f5e1d3e0d/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:58.419200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92c424-5af9-4bba-928c-bd8125badeda None admin] RBAC: Authorizing `identity:create_grant(project_id=d50a1cd322404bd4b0fa7a8c388dc217, user_id=c653cb8c86534dc2b963f39f5e1d3e0d, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:58.420609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92c424-5af9-4bba-928c-bd8125badeda None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:58.449930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5651e-00c5-4ee2-87fd-3e90fd89fa46 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:58.482287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507d409-ee50-4f40-bc8c-daaaf04bb971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:58.482878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507d409-ee50-4f40-bc8c-daaaf04bb971 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:58.483152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507d409-ee50-4f40-bc8c-daaaf04bb971 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:58.483417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507d409-ee50-4f40-bc8c-daaaf04bb971 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:58.484058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507d409-ee50-4f40-bc8c-daaaf04bb971 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:58.485429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507d409-ee50-4f40-bc8c-daaaf04bb971 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:58.515218 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 415/821] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:21:58 2022] PUT /identity/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/c653cb8c86534dc2b963f39f5e1d3e0d/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:21:58.516112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92c424-5af9-4bba-928c-bd8125badeda None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:58.585224 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 407/822] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:21:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:21:58.585224 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507d409-ee50-4f40-bc8c-daaaf04bb971 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:58.665231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:58.676342 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92c424-5af9-4bba-928c-bd8125badeda None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:58.735853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec712172-4597-49ce-8ea7-e87efdd8a87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:58.736475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec712172-4597-49ce-8ea7-e87efdd8a87f None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:58.736750 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec712172-4597-49ce-8ea7-e87efdd8a87f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:58.737045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec712172-4597-49ce-8ea7-e87efdd8a87f None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:58.737766 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec712172-4597-49ce-8ea7-e87efdd8a87f None admin] RBAC: Adding query filter params (name=network) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:58.738067 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec712172-4597-49ce-8ea7-e87efdd8a87f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:58.739565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec712172-4597-49ce-8ea7-e87efdd8a87f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:58.743676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507d409-ee50-4f40-bc8c-daaaf04bb971 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:58.745334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 416/823] 10.222.0.50 () {56 vars in 1112 bytes} [Sat Sep 17 04:21:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:58.746233 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec712172-4597-49ce-8ea7-e87efdd8a87f None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:58.777118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:58.785654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9ffe3-dcbc-41ec-92b4-6635aa861e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:58.786180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9ffe3-dcbc-41ec-92b4-6635aa861e13 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:58.786451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9ffe3-dcbc-41ec-92b4-6635aa861e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:58.786789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9ffe3-dcbc-41ec-92b4-6635aa861e13 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:58.787445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9ffe3-dcbc-41ec-92b4-6635aa861e13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:58.787804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9ffe3-dcbc-41ec-92b4-6635aa861e13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:58.789303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9ffe3-dcbc-41ec-92b4-6635aa861e13 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:58.803248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 408/824] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:58.803952 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9ffe3-dcbc-41ec-92b4-6635aa861e13 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:58.866301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec712172-4597-49ce-8ea7-e87efdd8a87f None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:58.908301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560b710-fc3b-4f9b-a379-58580a846d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:58.908901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560b710-fc3b-4f9b-a379-58580a846d97 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:58.909423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560b710-fc3b-4f9b-a379-58580a846d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:58.909985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560b710-fc3b-4f9b-a379-58580a846d97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:58.917566 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560b710-fc3b-4f9b-a379-58580a846d97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:58.919069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560b710-fc3b-4f9b-a379-58580a846d97 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:58.927995 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9ffe3-dcbc-41ec-92b4-6635aa861e13 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-f560b710-fc3b-4f9b-a379-58580a846d97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:58.931264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:58.932127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:58.933017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:58.933017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:58.933017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:58.933017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:58.933017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:58.933017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:58.933017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:58.933017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:58.933017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 417/825] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:58.933941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560b710-fc3b-4f9b-a379-58580a846d97 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:58.947224 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:58.968477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71428020-61ae-4ce6-9381-5c379a71b2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:58.969462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71428020-61ae-4ce6-9381-5c379a71b2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:58.969936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71428020-61ae-4ce6-9381-5c379a71b2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:58.970397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71428020-61ae-4ce6-9381-5c379a71b2b8 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:58.971451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71428020-61ae-4ce6-9381-5c379a71b2b8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:58.972303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71428020-61ae-4ce6-9381-5c379a71b2b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:58.973994 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71428020-61ae-4ce6-9381-5c379a71b2b8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:58.979562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 409/826] 10.222.0.50 () {56 vars in 1112 bytes} [Sat Sep 17 04:21:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:58.981047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71428020-61ae-4ce6-9381-5c379a71b2b8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:59.026570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:59.044662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560b710-fc3b-4f9b-a379-58580a846d97 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:59.082859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2363a03-5722-4233-8c97-3ac915a8fe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:59.083821 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2363a03-5722-4233-8c97-3ac915a8fe73 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:59.084279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2363a03-5722-4233-8c97-3ac915a8fe73 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:59.084806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2363a03-5722-4233-8c97-3ac915a8fe73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:59.092655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2363a03-5722-4233-8c97-3ac915a8fe73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:59.094369 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2363a03-5722-4233-8c97-3ac915a8fe73 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:59.103116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71428020-61ae-4ce6-9381-5c379a71b2b8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-c2363a03-5722-4233-8c97-3ac915a8fe73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:21:59.108165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:21:59.109082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:21:59.109998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:21:59.109998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:21:59.109998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:21:59.109998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:21:59.109998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:21:59.109998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:21:59.109998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:21:59.109998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:21:59.112206 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 418/827] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:21:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:21:59.113961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2363a03-5722-4233-8c97-3ac915a8fe73 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:59.162386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12aadd-f304-4a07-9314-c70f185058ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:59.163851 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12aadd-f304-4a07-9314-c70f185058ee None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:59.164129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12aadd-f304-4a07-9314-c70f185058ee None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:59.164400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12aadd-f304-4a07-9314-c70f185058ee None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:59.165141 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12aadd-f304-4a07-9314-c70f185058ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:59.165625 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12aadd-f304-4a07-9314-c70f185058ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:59.167057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12aadd-f304-4a07-9314-c70f185058ee None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:59.179798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 410/828] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:59.180669 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12aadd-f304-4a07-9314-c70f185058ee None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:59.218408 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:59.253320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2363a03-5722-4233-8c97-3ac915a8fe73 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:59.302356 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac0ccc-4858-467e-9165-5d978f8a2806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:59.302596 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12aadd-f304-4a07-9314-c70f185058ee None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:59.303417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac0ccc-4858-467e-9165-5d978f8a2806 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:59.303901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac0ccc-4858-467e-9165-5d978f8a2806 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:59.304549 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac0ccc-4858-467e-9165-5d978f8a2806 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:59.306301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac0ccc-4858-467e-9165-5d978f8a2806 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:59.307862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac0ccc-4858-467e-9165-5d978f8a2806 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:59.338746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2ec4d-516e-4384-aea2-659544896a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:59.339486 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2ec4d-516e-4384-aea2-659544896a8b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:59.339844 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2ec4d-516e-4384-aea2-659544896a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:59.340181 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2ec4d-516e-4384-aea2-659544896a8b None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:59.341269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2ec4d-516e-4384-aea2-659544896a8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:59.341662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2ec4d-516e-4384-aea2-659544896a8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:59.346300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2ec4d-516e-4384-aea2-659544896a8b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:59.360884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 411/829] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:21:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:59.360884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2ec4d-516e-4384-aea2-659544896a8b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:59.438498 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 419/830] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:21:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:21:59.438498 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac0ccc-4858-467e-9165-5d978f8a2806 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:21:59.446245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:59.497381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:21:59.525320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2ec4d-516e-4384-aea2-659544896a8b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:59.610679 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeafc18-4970-41b5-b1eb-388640f879ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:59.611361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeafc18-4970-41b5-b1eb-388640f879ad None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:59.611637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeafc18-4970-41b5-b1eb-388640f879ad None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:59.611904 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeafc18-4970-41b5-b1eb-388640f879ad None admin] PATH_INFO: `/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/597874ccdd284d9d88f3e743c4759d95/roles/b1cf59e6d9dd49179551b98cee02776c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:59.649569 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeafc18-4970-41b5-b1eb-388640f879ad None admin] RBAC: Authorizing `identity:create_grant(project_id=d50a1cd322404bd4b0fa7a8c388dc217, user_id=597874ccdd284d9d88f3e743c4759d95, role_id=b1cf59e6d9dd49179551b98cee02776c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:59.651031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeafc18-4970-41b5-b1eb-388640f879ad None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:59.656852 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac0ccc-4858-467e-9165-5d978f8a2806 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:21:59.693345 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa3361-1f2b-4b4e-890b-15650ba7ea8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:21:59.693961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa3361-1f2b-4b4e-890b-15650ba7ea8f None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:21:59.694233 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa3361-1f2b-4b4e-890b-15650ba7ea8f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:21:59.694509 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa3361-1f2b-4b4e-890b-15650ba7ea8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:21:59.695300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa3361-1f2b-4b4e-890b-15650ba7ea8f None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=eb70408fecfe41e0b2ea9a53c7ae0823) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:21:59.695644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa3361-1f2b-4b4e-890b-15650ba7ea8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:21:59.697236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa3361-1f2b-4b4e-890b-15650ba7ea8f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:21:59.704033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 420/831] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:21:59 2022] GET /identity/v3/role_assignments?user.id=eb70408fecfe41e0b2ea9a53c7ae0823&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:21:59.741876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 412/832] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:21:59 2022] PUT /identity/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/597874ccdd284d9d88f3e743c4759d95/roles/b1cf59e6d9dd49179551b98cee02776c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:22:00.740580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659106-d0f7-4818-b323-62f4a60dd184 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:00.741162 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659106-d0f7-4818-b323-62f4a60dd184 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:00.741162 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659106-d0f7-4818-b323-62f4a60dd184 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:00.742725 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 421/833] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:00.748086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675578d6-72db-436f-bb87-6e75db2f31f7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:00.748475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675578d6-72db-436f-bb87-6e75db2f31f7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:00.748655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675578d6-72db-436f-bb87-6e75db2f31f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:00.767552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-675578d6-72db-436f-bb87-6e75db2f31f7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:00.769409 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-675578d6-72db-436f-bb87-6e75db2f31f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:00.838613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 413/834] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:00.964584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62759a-1af8-406d-97f7-cbd7763c747f None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:00.964937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62759a-1af8-406d-97f7-cbd7763c747f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:00.965170 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62759a-1af8-406d-97f7-cbd7763c747f None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:00.966929 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 422/835] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:00.972775 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a79df-07eb-4ce9-8460-3b2b34b6c75d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:00.973088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a79df-07eb-4ce9-8460-3b2b34b6c75d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:00.973362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a79df-07eb-4ce9-8460-3b2b34b6c75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:00.992652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ed9a79df-07eb-4ce9-8460-3b2b34b6c75d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:00.993787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ed9a79df-07eb-4ce9-8460-3b2b34b6c75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:01.056134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:01.063857 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 414/836] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:01.107353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62759a-1af8-406d-97f7-cbd7763c747f None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:01.177627 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:01.213662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62759a-1af8-406d-97f7-cbd7763c747f None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:01.252127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14b545-06e9-4465-88ef-7b7628ed81c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:01.252729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14b545-06e9-4465-88ef-7b7628ed81c2 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:01.253988 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14b545-06e9-4465-88ef-7b7628ed81c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:01.254267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14b545-06e9-4465-88ef-7b7628ed81c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:01.264749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14b545-06e9-4465-88ef-7b7628ed81c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-0f14b545-06e9-4465-88ef-7b7628ed81c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:22:01.270714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:01.271614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:01.272417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:01.272417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:01.272417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:01.272417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:01.272417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:22:01.272417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:22:01.272417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:22:01.272417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:22:01.272417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:22:01.272417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:22:01.272417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:22:01.272417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:01.272417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 423/837] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:22:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:01.279502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a79df-07eb-4ce9-8460-3b2b34b6c75d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:01.355962 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14b545-06e9-4465-88ef-7b7628ed81c2 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:01.380558 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a79df-07eb-4ce9-8460-3b2b34b6c75d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:01.426816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d27bb7-aa9b-459d-94e2-a756dc789956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:01.427962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d27bb7-aa9b-459d-94e2-a756dc789956 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:01.428464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d27bb7-aa9b-459d-94e2-a756dc789956 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:01.429232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d27bb7-aa9b-459d-94e2-a756dc789956 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:01.430353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d27bb7-aa9b-459d-94e2-a756dc789956 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:01.430851 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d27bb7-aa9b-459d-94e2-a756dc789956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:01.433119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d27bb7-aa9b-459d-94e2-a756dc789956 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:01.449316 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 415/838] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:22:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:01.449977 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d27bb7-aa9b-459d-94e2-a756dc789956 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:01.484535 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14b545-06e9-4465-88ef-7b7628ed81c2 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:01.516102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:01.523431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:01.538190 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5413cb6-5e2b-48aa-b2ef-4715a649d89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:01.539096 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413cb6-5e2b-48aa-b2ef-4715a649d89e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:01.539522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413cb6-5e2b-48aa-b2ef-4715a649d89e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:01.539976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413cb6-5e2b-48aa-b2ef-4715a649d89e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:01.541234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5413cb6-5e2b-48aa-b2ef-4715a649d89e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:01.543381 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5413cb6-5e2b-48aa-b2ef-4715a649d89e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-f5413cb6-5e2b-48aa-b2ef-4715a649d89e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:01.557383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:01.558590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:01.559712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:01.559712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:01.559712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:01.559712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:01.559712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:01.559712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:01.559712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:01.559712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:01.559712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:01.559712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:01.559712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:01.559712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:01.559712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 04:22:01.559712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:01.565032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 424/839] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:22:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:01.568011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5413cb6-5e2b-48aa-b2ef-4715a649d89e None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:01.577314 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d27bb7-aa9b-459d-94e2-a756dc789956 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:01.623192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccddae3-f056-477a-ab1d-ae76ef9a7d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:01.624398 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccddae3-f056-477a-ab1d-ae76ef9a7d2c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:01.624882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccddae3-f056-477a-ab1d-ae76ef9a7d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:01.625369 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccddae3-f056-477a-ab1d-ae76ef9a7d2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:01.641691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccddae3-f056-477a-ab1d-ae76ef9a7d2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:01.644708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccddae3-f056-477a-ab1d-ae76ef9a7d2c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7ccddae3-f056-477a-ab1d-ae76ef9a7d2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:01.663930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:01.664934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:01.665942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:01.665942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:01.665942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:01.671126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 416/840] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:01.672743 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccddae3-f056-477a-ab1d-ae76ef9a7d2c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:01.694303 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5413cb6-5e2b-48aa-b2ef-4715a649d89e None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:01.736493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89479478-3fc7-4a6a-b1d8-7ba5d3c61f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:01.737939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89479478-3fc7-4a6a-b1d8-7ba5d3c61f81 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:01.738619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89479478-3fc7-4a6a-b1d8-7ba5d3c61f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:01.738895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89479478-3fc7-4a6a-b1d8-7ba5d3c61f81 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:01.739827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89479478-3fc7-4a6a-b1d8-7ba5d3c61f81 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:01.739958 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89479478-3fc7-4a6a-b1d8-7ba5d3c61f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:01.741327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89479478-3fc7-4a6a-b1d8-7ba5d3c61f81 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:01.751268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 425/841] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:22:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:01.752371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89479478-3fc7-4a6a-b1d8-7ba5d3c61f81 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:01.805854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccddae3-f056-477a-ab1d-ae76ef9a7d2c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:01.820071 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:01.825715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:01.851206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57049c5-3690-4f72-83a8-1b7249b9f793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:01.852345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57049c5-3690-4f72-83a8-1b7249b9f793 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:01.852771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57049c5-3690-4f72-83a8-1b7249b9f793 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:01.853208 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57049c5-3690-4f72-83a8-1b7249b9f793 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:01.854188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57049c5-3690-4f72-83a8-1b7249b9f793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:01.855161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57049c5-3690-4f72-83a8-1b7249b9f793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:01.856968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57049c5-3690-4f72-83a8-1b7249b9f793 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:01.879445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89479478-3fc7-4a6a-b1d8-7ba5d3c61f81 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:01.879848 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 417/842] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:01.881848 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57049c5-3690-4f72-83a8-1b7249b9f793 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:01.925972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd43923-aaa7-438a-b695-2984b0868281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:01.926845 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd43923-aaa7-438a-b695-2984b0868281 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:01.927175 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd43923-aaa7-438a-b695-2984b0868281 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:01.927551 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd43923-aaa7-438a-b695-2984b0868281 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:01.928318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd43923-aaa7-438a-b695-2984b0868281 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:01.928905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd43923-aaa7-438a-b695-2984b0868281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:01.930601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd43923-aaa7-438a-b695-2984b0868281 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:01.937032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 426/843] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:22:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:02.018960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57049c5-3690-4f72-83a8-1b7249b9f793 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:02.022784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be050350-2819-4807-abde-327c1455cc15 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:02.023059 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be050350-2819-4807-abde-327c1455cc15 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:02.023332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be050350-2819-4807-abde-327c1455cc15 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:02.026173 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 427/844] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:22:02.030611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e12850-5ca3-4630-9eea-af2cf289771f None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:02.030880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e12850-5ca3-4630-9eea-af2cf289771f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:02.031149 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e12850-5ca3-4630-9eea-af2cf289771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:02.050866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-14e12850-5ca3-4630-9eea-af2cf289771f None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:02.052070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-14e12850-5ca3-4630-9eea-af2cf289771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:02.060952 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626ee7e-cd10-4604-b691-b76614754b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:02.061548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626ee7e-cd10-4604-b691-b76614754b9b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:02.061824 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626ee7e-cd10-4604-b691-b76614754b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:02.062087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626ee7e-cd10-4604-b691-b76614754b9b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:02.071497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626ee7e-cd10-4604-b691-b76614754b9b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:02.072967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626ee7e-cd10-4604-b691-b76614754b9b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1626ee7e-cd10-4604-b691-b76614754b9b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:22:02.085716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:02.086878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:02.087986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:02.087986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:02.087986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:22:02.087986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:22:02.087986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:22:02.087986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:22:02.087986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:22:02.087986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:22:02.087986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 04:22:02.087986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:02.087986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 418/845] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:22:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:02.088566 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8310683-8ef9-487a-8d90-a2a78b72e4cd None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:02.088670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8310683-8ef9-487a-8d90-a2a78b72e4cd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:02.088943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8310683-8ef9-487a-8d90-a2a78b72e4cd None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:02.093037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 419/846] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:02.093037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8310683-8ef9-487a-8d90-a2a78b72e4cd None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:02.132087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:02.141611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 428/847] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:22:02.142929 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9365264-e9bd-4755-bfd3-afef3ce18fc4 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:02.145313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9365264-e9bd-4755-bfd3-afef3ce18fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:02.145313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9365264-e9bd-4755-bfd3-afef3ce18fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:02.172032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-b9365264-e9bd-4755-bfd3-afef3ce18fc4 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:02.172389 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b9365264-e9bd-4755-bfd3-afef3ce18fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:02.212676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8310683-8ef9-487a-8d90-a2a78b72e4cd None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:02.270398 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6030e-1f64-4009-810c-207f717d55a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:02.271010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6030e-1f64-4009-810c-207f717d55a1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:02.271286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6030e-1f64-4009-810c-207f717d55a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:02.271551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6030e-1f64-4009-810c-207f717d55a1 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:02.277013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6030e-1f64-4009-810c-207f717d55a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:02.277013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6030e-1f64-4009-810c-207f717d55a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:02.277013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6030e-1f64-4009-810c-207f717d55a1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:02.287295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:02.297566 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 420/848] 10.222.0.50 () {56 vars in 1135 bytes} [Sat Sep 17 04:22:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:02.303938 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6030e-1f64-4009-810c-207f717d55a1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:02.329310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 429/849] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:02.403112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:02.423489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6030e-1f64-4009-810c-207f717d55a1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:02.423677 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9365264-e9bd-4755-bfd3-afef3ce18fc4 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:02.465380 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9609d2-a518-45f1-9cbf-c025a785f448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:02.466238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9609d2-a518-45f1-9cbf-c025a785f448 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:02.466522 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9609d2-a518-45f1-9cbf-c025a785f448 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:02.468698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9609d2-a518-45f1-9cbf-c025a785f448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:02.545788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9609d2-a518-45f1-9cbf-c025a785f448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:02.547239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9609d2-a518-45f1-9cbf-c025a785f448 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:02.601336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9365264-e9bd-4755-bfd3-afef3ce18fc4 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:02.648250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:02.668875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 421/850] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:22:02 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:22:02.670244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9609d2-a518-45f1-9cbf-c025a785f448 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:02.681220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46454a94-faca-4064-8b4f-77bad834eb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:02.683279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454a94-faca-4064-8b4f-77bad834eb85 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:02.683533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454a94-faca-4064-8b4f-77bad834eb85 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:02.683869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454a94-faca-4064-8b4f-77bad834eb85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:02.700814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46454a94-faca-4064-8b4f-77bad834eb85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-46454a94-faca-4064-8b4f-77bad834eb85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:22:02.706154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:02.707141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:02.707948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:02.707948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:02.707948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:02.707948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:02.707948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:22:02.707948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:22:02.707948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:22:02.707948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:22:02.707948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:22:02.707948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:22:02.707948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:22:02.707948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:02.707948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 430/851] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:22:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:02.709104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46454a94-faca-4064-8b4f-77bad834eb85 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:02.764213 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:02.805605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9609d2-a518-45f1-9cbf-c025a785f448 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:02.830823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46454a94-faca-4064-8b4f-77bad834eb85 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:02.840281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466f08f-9576-4fb0-9a26-143ed4f5ad76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:02.840913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466f08f-9576-4fb0-9a26-143ed4f5ad76 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:02.841222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466f08f-9576-4fb0-9a26-143ed4f5ad76 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:02.841492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466f08f-9576-4fb0-9a26-143ed4f5ad76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:02.851432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466f08f-9576-4fb0-9a26-143ed4f5ad76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:02.852818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466f08f-9576-4fb0-9a26-143ed4f5ad76 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1466f08f-9576-4fb0-9a26-143ed4f5ad76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:02.867602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:02.868549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:02.869540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:02.869540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:02.869540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:02.869540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 422/852] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:02.869540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466f08f-9576-4fb0-9a26-143ed4f5ad76 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:02.874292 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d4673-e588-467b-a889-9acc2d040b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:02.875162 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d4673-e588-467b-a889-9acc2d040b1d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:02.875581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d4673-e588-467b-a889-9acc2d040b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:02.876243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d4673-e588-467b-a889-9acc2d040b1d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:02.878545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d4673-e588-467b-a889-9acc2d040b1d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:02.880178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d4673-e588-467b-a889-9acc2d040b1d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-527d4673-e588-467b-a889-9acc2d040b1d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:02.892860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:02.894807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:02.895717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:02.895717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:02.895717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:02.895717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:02.895717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:02.895717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:02.895717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:02.895717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:02.895717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:02.895717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:02.895717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:02.895717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:02.895717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 04:22:02.895717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:02.901642 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 431/853] 10.222.0.50 () {56 vars in 1132 bytes} [Sat Sep 17 04:22:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:02.901642 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d4673-e588-467b-a889-9acc2d040b1d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:02.919787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:02.987007 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466f08f-9576-4fb0-9a26-143ed4f5ad76 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:03.001796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d4673-e588-467b-a889-9acc2d040b1d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:03.004198 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:03.024174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9e105-fe3e-4ec1-9f07-374b0dc10f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:03.024778 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9e105-fe3e-4ec1-9f07-374b0dc10f19 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:03.025087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9e105-fe3e-4ec1-9f07-374b0dc10f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:03.025349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9e105-fe3e-4ec1-9f07-374b0dc10f19 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:03.026003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9e105-fe3e-4ec1-9f07-374b0dc10f19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:03.026487 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9e105-fe3e-4ec1-9f07-374b0dc10f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:03.027863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9e105-fe3e-4ec1-9f07-374b0dc10f19 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:03.036225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 423/854] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:22:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:03.037051 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9e105-fe3e-4ec1-9f07-374b0dc10f19 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:03.042679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d239ca6-8d3e-44fb-9bd2-ed353281a20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:03.043280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239ca6-8d3e-44fb-9bd2-ed353281a20d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:03.043555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239ca6-8d3e-44fb-9bd2-ed353281a20d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:03.043820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239ca6-8d3e-44fb-9bd2-ed353281a20d None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:03.044456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d239ca6-8d3e-44fb-9bd2-ed353281a20d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:03.044754 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d239ca6-8d3e-44fb-9bd2-ed353281a20d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:03.046141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d239ca6-8d3e-44fb-9bd2-ed353281a20d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:03.058176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 432/855] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:03.058977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d239ca6-8d3e-44fb-9bd2-ed353281a20d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:03.152727 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9e105-fe3e-4ec1-9f07-374b0dc10f19 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:03.154272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:03.165350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d239ca6-8d3e-44fb-9bd2-ed353281a20d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:03.187964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e089c7-a701-42ce-8088-9f56e36b8bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:03.188559 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e089c7-a701-42ce-8088-9f56e36b8bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:03.188834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e089c7-a701-42ce-8088-9f56e36b8bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:03.189131 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e089c7-a701-42ce-8088-9f56e36b8bd5 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:03.189748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e089c7-a701-42ce-8088-9f56e36b8bd5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:03.190149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e089c7-a701-42ce-8088-9f56e36b8bd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:03.192017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e089c7-a701-42ce-8088-9f56e36b8bd5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:03.202120 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 424/856] 10.222.0.50 () {56 vars in 1126 bytes} [Sat Sep 17 04:22:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:03.202308 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c7449-7458-48cf-8832-3dc476c7cc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:03.202908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c7449-7458-48cf-8832-3dc476c7cc33 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:03.203008 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e089c7-a701-42ce-8088-9f56e36b8bd5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:03.203187 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c7449-7458-48cf-8832-3dc476c7cc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:03.203482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c7449-7458-48cf-8832-3dc476c7cc33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:03.214195 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c7449-7458-48cf-8832-3dc476c7cc33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:03.215640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c7449-7458-48cf-8832-3dc476c7cc33 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-157c7449-7458-48cf-8832-3dc476c7cc33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:03.230068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:03.231032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:03.231901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:03.231901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:03.231901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:03.231901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 433/857] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:03.231901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c7449-7458-48cf-8832-3dc476c7cc33 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:03.248393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:03.317560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e089c7-a701-42ce-8088-9f56e36b8bd5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:03.335037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c7449-7458-48cf-8832-3dc476c7cc33 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:03.354617 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0fa3c-1d71-479f-bf8d-7eaa9f04ed56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:03.355282 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0fa3c-1d71-479f-bf8d-7eaa9f04ed56 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:03.355560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0fa3c-1d71-479f-bf8d-7eaa9f04ed56 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:03.355816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0fa3c-1d71-479f-bf8d-7eaa9f04ed56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:03.362994 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0fa3c-1d71-479f-bf8d-7eaa9f04ed56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:03.368501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0fa3c-1d71-479f-bf8d-7eaa9f04ed56 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:03.370316 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dc759-3079-4b1e-bf99-8fbe4526456a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:03.370929 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dc759-3079-4b1e-bf99-8fbe4526456a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:03.371211 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dc759-3079-4b1e-bf99-8fbe4526456a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:03.371482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dc759-3079-4b1e-bf99-8fbe4526456a None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:03.372106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dc759-3079-4b1e-bf99-8fbe4526456a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:03.372409 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dc759-3079-4b1e-bf99-8fbe4526456a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:03.373804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dc759-3079-4b1e-bf99-8fbe4526456a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-10c0fa3c-1d71-479f-bf8d-7eaa9f04ed56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:22:03.376200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:03.377102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:03.378511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:22:03.378511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:22:03.378511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:22:03.378511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:22:03.378511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:22:03.378511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:22:03.378511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:03.378511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:03.378511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 425/858] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:22:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:03.379000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0fa3c-1d71-479f-bf8d-7eaa9f04ed56 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:03.385200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 434/859] 10.222.0.50 () {56 vars in 1126 bytes} [Sat Sep 17 04:22:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:03.389487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dc759-3079-4b1e-bf99-8fbe4526456a None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:03.411252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:03.484822 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:03.493109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0fa3c-1d71-479f-bf8d-7eaa9f04ed56 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:03.511120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dc759-3079-4b1e-bf99-8fbe4526456a None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:03.530874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81538cca-48cd-4ca7-8b15-4c6510c96fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:03.531605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81538cca-48cd-4ca7-8b15-4c6510c96fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:03.531966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81538cca-48cd-4ca7-8b15-4c6510c96fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:03.532280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81538cca-48cd-4ca7-8b15-4c6510c96fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:03.533057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81538cca-48cd-4ca7-8b15-4c6510c96fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:03.533805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81538cca-48cd-4ca7-8b15-4c6510c96fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:03.534968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81538cca-48cd-4ca7-8b15-4c6510c96fe3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:03.548530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 426/860] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:03.557008 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81538cca-48cd-4ca7-8b15-4c6510c96fe3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:03.557856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842b66e-1a89-4c58-84fb-bcd99554d7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:03.559489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842b66e-1a89-4c58-84fb-bcd99554d7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:03.559880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842b66e-1a89-4c58-84fb-bcd99554d7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:03.560247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842b66e-1a89-4c58-84fb-bcd99554d7c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:03.562011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842b66e-1a89-4c58-84fb-bcd99554d7c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:03.562011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842b66e-1a89-4c58-84fb-bcd99554d7c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:03.563004 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842b66e-1a89-4c58-84fb-bcd99554d7c4 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:03.581668 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 435/861] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:22:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:03.586106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842b66e-1a89-4c58-84fb-bcd99554d7c4 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:03.671826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:03.693510 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81538cca-48cd-4ca7-8b15-4c6510c96fe3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:03.716652 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842b66e-1a89-4c58-84fb-bcd99554d7c4 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:03.730699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a95211-b831-4f33-a3b9-532548a55821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:03.732762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a95211-b831-4f33-a3b9-532548a55821 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:03.733596 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a95211-b831-4f33-a3b9-532548a55821 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:03.734278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a95211-b831-4f33-a3b9-532548a55821 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:03.745419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a95211-b831-4f33-a3b9-532548a55821 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:03.748131 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a95211-b831-4f33-a3b9-532548a55821 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:03.757026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554efaa-a4a1-446f-9355-3b82c54c43ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:03.757588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554efaa-a4a1-446f-9355-3b82c54c43ab None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:03.757896 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554efaa-a4a1-446f-9355-3b82c54c43ab None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:03.758423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554efaa-a4a1-446f-9355-3b82c54c43ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:03.759208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554efaa-a4a1-446f-9355-3b82c54c43ab None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=c653cb8c86534dc2b963f39f5e1d3e0d) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:03.759514 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554efaa-a4a1-446f-9355-3b82c54c43ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:03.760927 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554efaa-a4a1-446f-9355-3b82c54c43ab None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-85a95211-b831-4f33-a3b9-532548a55821 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:22:03.765718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:03.766682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:03.767638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:03.767638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:03.767638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:22:03.767638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:22:03.767638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:22:03.767638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:22:03.767638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:22:03.767638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:22:03.767638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 04:22:03.767638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:03.768884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 436/862] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:22:03 2022] GET /identity/v3/role_assignments?user.id=c653cb8c86534dc2b963f39f5e1d3e0d&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:03.775198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 427/863] 10.222.0.50 () {56 vars in 1117 bytes} [Sat Sep 17 04:22:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:03.776140 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554efaa-a4a1-446f-9355-3b82c54c43ab None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:03.779333 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:03.900279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554efaa-a4a1-446f-9355-3b82c54c43ab None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:03.942443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af754674-ce72-495c-a88f-6f5a22a3b016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:03.943420 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af754674-ce72-495c-a88f-6f5a22a3b016 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:03.943906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af754674-ce72-495c-a88f-6f5a22a3b016 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:03.944379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af754674-ce72-495c-a88f-6f5a22a3b016 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:03.945372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af754674-ce72-495c-a88f-6f5a22a3b016 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:03.945884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af754674-ce72-495c-a88f-6f5a22a3b016 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:03.947519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af754674-ce72-495c-a88f-6f5a22a3b016 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:03.966945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 437/864] 10.222.0.50 () {56 vars in 1149 bytes} [Sat Sep 17 04:22:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:03.973451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a95211-b831-4f33-a3b9-532548a55821 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:04.097136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a95211-b831-4f33-a3b9-532548a55821 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:04.135501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd5b2f-c344-4a3d-addd-82ac876299a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:04.136108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5b2f-c344-4a3d-addd-82ac876299a0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:04.136381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5b2f-c344-4a3d-addd-82ac876299a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:04.136646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5b2f-c344-4a3d-addd-82ac876299a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:04.153268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:04.187836 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaff42a-b0cb-403d-b4d1-627be7620c4f None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:04.188147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaff42a-b0cb-403d-b4d1-627be7620c4f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:04.188383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaff42a-b0cb-403d-b4d1-627be7620c4f None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:04.190032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 438/865] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:04.195851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71535d-1760-4949-bc3d-cebe666275c5 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:04.196071 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71535d-1760-4949-bc3d-cebe666275c5 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:04.196546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71535d-1760-4949-bc3d-cebe666275c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:04.210066 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd5b2f-c344-4a3d-addd-82ac876299a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:04.211513 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd5b2f-c344-4a3d-addd-82ac876299a0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:04.216870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-9f71535d-1760-4949-bc3d-cebe666275c5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:04.218167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9f71535d-1760-4949-bc3d-cebe666275c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:04.290766 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:04.306340 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 439/866] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:22:04.330367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 428/867] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:22:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:22:04.336138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71535d-1760-4949-bc3d-cebe666275c5 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:04.443140 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71535d-1760-4949-bc3d-cebe666275c5 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:04.479811 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae50924-8fb7-4a7c-98a1-bb73a0e0470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:04.480359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae50924-8fb7-4a7c-98a1-bb73a0e0470a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:04.480631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae50924-8fb7-4a7c-98a1-bb73a0e0470a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:04.480897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae50924-8fb7-4a7c-98a1-bb73a0e0470a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:04.491864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae50924-8fb7-4a7c-98a1-bb73a0e0470a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:04.493331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae50924-8fb7-4a7c-98a1-bb73a0e0470a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-bae50924-8fb7-4a7c-98a1-bb73a0e0470a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:04.509166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:04.511290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:04.513366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:04.513366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:04.513366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:04.513366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 440/868] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:04.520208 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd5b2f-c344-4a3d-addd-82ac876299a0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:04.569591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:04.607300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae50924-8fb7-4a7c-98a1-bb73a0e0470a None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:04.632441 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd5b2f-c344-4a3d-addd-82ac876299a0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:04.657729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:04.679088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738b8e9-5c3d-44c4-a6d9-d62abfb4a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:04.680300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738b8e9-5c3d-44c4-a6d9-d62abfb4a532 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:04.680939 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738b8e9-5c3d-44c4-a6d9-d62abfb4a532 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:04.681461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738b8e9-5c3d-44c4-a6d9-d62abfb4a532 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:04.682873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738b8e9-5c3d-44c4-a6d9-d62abfb4a532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:04.683393 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738b8e9-5c3d-44c4-a6d9-d62abfb4a532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:04.685142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738b8e9-5c3d-44c4-a6d9-d62abfb4a532 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:04.702703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 429/869] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:04.708856 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738b8e9-5c3d-44c4-a6d9-d62abfb4a532 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:04.733605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae50924-8fb7-4a7c-98a1-bb73a0e0470a None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:04.784724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d9b28-7630-407e-818d-52d433af5a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:04.785520 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d9b28-7630-407e-818d-52d433af5a03 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:04.789012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d9b28-7630-407e-818d-52d433af5a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:04.789012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d9b28-7630-407e-818d-52d433af5a03 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:04.789012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d9b28-7630-407e-818d-52d433af5a03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:04.789012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d9b28-7630-407e-818d-52d433af5a03 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:04.824440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738b8e9-5c3d-44c4-a6d9-d62abfb4a532 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:04.833400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:04.862421 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b48ac-43c5-4d2a-83b3-01aba8ad00d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:04.863045 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b48ac-43c5-4d2a-83b3-01aba8ad00d8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:04.863328 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b48ac-43c5-4d2a-83b3-01aba8ad00d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:04.863601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b48ac-43c5-4d2a-83b3-01aba8ad00d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:04.867134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 441/870] 10.222.0.50 () {60 vars in 1141 bytes} [Sat Sep 17 04:22:04 2022] POST /identity/v3/services => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:22:04.877026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b48ac-43c5-4d2a-83b3-01aba8ad00d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:04.877026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b48ac-43c5-4d2a-83b3-01aba8ad00d8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-784b48ac-43c5-4d2a-83b3-01aba8ad00d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:22:04.890335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:04.891425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:04.892389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:22:04.892389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:22:04.892389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:22:04.892389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:22:04.892389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:22:04.892389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:22:04.892389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:04.892389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:04.896572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 430/871] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:22:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:04.902669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d9b28-7630-407e-818d-52d433af5a03 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:05.020450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:05.025626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d9b28-7630-407e-818d-52d433af5a03 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:05.067708 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a8b48-0c22-4b7a-85ab-50b87c7d08d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:05.068362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a8b48-0c22-4b7a-85ab-50b87c7d08d7 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:05.068649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a8b48-0c22-4b7a-85ab-50b87c7d08d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:05.068899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a8b48-0c22-4b7a-85ab-50b87c7d08d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:05.069632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a8b48-0c22-4b7a-85ab-50b87c7d08d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:05.069932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a8b48-0c22-4b7a-85ab-50b87c7d08d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:05.071353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a8b48-0c22-4b7a-85ab-50b87c7d08d7 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:05.091427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 442/872] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:22:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:05.098108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b48ac-43c5-4d2a-83b3-01aba8ad00d8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:05.207766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b48ac-43c5-4d2a-83b3-01aba8ad00d8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:05.243116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974840e-569d-4afb-b301-317fdab82780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:05.243721 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974840e-569d-4afb-b301-317fdab82780 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:05.243992 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974840e-569d-4afb-b301-317fdab82780 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:05.244260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974840e-569d-4afb-b301-317fdab82780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:05.245144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974840e-569d-4afb-b301-317fdab82780 None admin] RBAC: Adding query filter params (role.id=b1cf59e6d9dd49179551b98cee02776c, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=597874ccdd284d9d88f3e743c4759d95) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:05.245453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974840e-569d-4afb-b301-317fdab82780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:05.247003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974840e-569d-4afb-b301-317fdab82780 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:05.253590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 431/873] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:22:05 2022] GET /identity/v3/role_assignments?user.id=597874ccdd284d9d88f3e743c4759d95&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=b1cf59e6d9dd49179551b98cee02776c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:05.766059 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee798188-83ce-4264-989f-1309fdca29eb None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:05.766413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee798188-83ce-4264-989f-1309fdca29eb None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:05.766648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee798188-83ce-4264-989f-1309fdca29eb None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:05.769175 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 443/874] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:05.774587 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e6c10-160b-4f51-93b6-23a140726c10 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:05.774874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e6c10-160b-4f51-93b6-23a140726c10 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:05.775142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e6c10-160b-4f51-93b6-23a140726c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:05.794269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0b4e6c10-160b-4f51-93b6-23a140726c10 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:05.795448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0b4e6c10-160b-4f51-93b6-23a140726c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:05.825921 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:05.877685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 432/875] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:05 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:06.064048 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663a96e-dbcb-4ce3-9828-e03e164ee837 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:06.064575 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663a96e-dbcb-4ce3-9828-e03e164ee837 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:06.064575 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663a96e-dbcb-4ce3-9828-e03e164ee837 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:06.066421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 444/876] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:06.071676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a76b3b-cdaa-43fb-afcc-eb7499d46e6c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:06.071958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a76b3b-cdaa-43fb-afcc-eb7499d46e6c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:06.072221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a76b3b-cdaa-43fb-afcc-eb7499d46e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:06.090639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c7a76b3b-cdaa-43fb-afcc-eb7499d46e6c None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:06.091807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c7a76b3b-cdaa-43fb-afcc-eb7499d46e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:06.172270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 433/877] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:06.176871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663a96e-dbcb-4ce3-9828-e03e164ee837 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:06.285203 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663a96e-dbcb-4ce3-9828-e03e164ee837 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:06.320401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32639073-d7e1-4142-9fd5-12cecd744a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:06.320935 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32639073-d7e1-4142-9fd5-12cecd744a1f None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:06.321240 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32639073-d7e1-4142-9fd5-12cecd744a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:06.321512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32639073-d7e1-4142-9fd5-12cecd744a1f None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:06.322162 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32639073-d7e1-4142-9fd5-12cecd744a1f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:06.323514 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32639073-d7e1-4142-9fd5-12cecd744a1f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:06.416871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 445/878] 10.222.0.50 () {60 vars in 1141 bytes} [Sat Sep 17 04:22:06 2022] POST /identity/v3/services => generated 269 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:22:06.459977 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a76b3b-cdaa-43fb-afcc-eb7499d46e6c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:06.560325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:06.574632 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a76b3b-cdaa-43fb-afcc-eb7499d46e6c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:06.620907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ca7f1-7319-4d21-9a8a-c8a5c7bd7dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:06.621832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ca7f1-7319-4d21-9a8a-c8a5c7bd7dbc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:06.622259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ca7f1-7319-4d21-9a8a-c8a5c7bd7dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:06.622524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ca7f1-7319-4d21-9a8a-c8a5c7bd7dbc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:06.623101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ca7f1-7319-4d21-9a8a-c8a5c7bd7dbc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:06.624470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ca7f1-7319-4d21-9a8a-c8a5c7bd7dbc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ad5ca7f1-7319-4d21-9a8a-c8a5c7bd7dbc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:06.635362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:06.636418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:06.637312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 434/879] 10.222.0.50 () {56 vars in 1126 bytes} [Sat Sep 17 04:22:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:06.645329 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32639073-d7e1-4142-9fd5-12cecd744a1f None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:06.667411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:06.754179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32639073-d7e1-4142-9fd5-12cecd744a1f None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:06.789247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1399fd-4dfe-4c69-8cb0-0d1d296005bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:06.789857 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1399fd-4dfe-4c69-8cb0-0d1d296005bb None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:06.790132 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1399fd-4dfe-4c69-8cb0-0d1d296005bb None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:06.790399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1399fd-4dfe-4c69-8cb0-0d1d296005bb None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:06.791024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1399fd-4dfe-4c69-8cb0-0d1d296005bb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:06.791319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1399fd-4dfe-4c69-8cb0-0d1d296005bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:06.792679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1399fd-4dfe-4c69-8cb0-0d1d296005bb None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:06.797936 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 446/880] 10.222.0.50 () {56 vars in 1122 bytes} [Sat Sep 17 04:22:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:06.803907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ca7f1-7319-4d21-9a8a-c8a5c7bd7dbc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:06.906079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ca7f1-7319-4d21-9a8a-c8a5c7bd7dbc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:06.946533 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2648dc-3638-4ece-a1ff-ded3a8fccd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:06.947149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2648dc-3638-4ece-a1ff-ded3a8fccd02 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:06.947481 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2648dc-3638-4ece-a1ff-ded3a8fccd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:06.947759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2648dc-3638-4ece-a1ff-ded3a8fccd02 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:06.948392 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2648dc-3638-4ece-a1ff-ded3a8fccd02 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:06.948694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2648dc-3638-4ece-a1ff-ded3a8fccd02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:06.950097 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2648dc-3638-4ece-a1ff-ded3a8fccd02 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:06.955024 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 435/881] 10.222.0.50 () {56 vars in 1122 bytes} [Sat Sep 17 04:22:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:07.181091 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d7cf0-7499-43fc-9da6-1b3756daec41 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:07.181599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d7cf0-7499-43fc-9da6-1b3756daec41 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:07.181599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d7cf0-7499-43fc-9da6-1b3756daec41 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:07.183394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 447/882] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:07.191588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848fa54-77a7-4245-8570-5add26b6afee None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:07.192098 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848fa54-77a7-4245-8570-5add26b6afee None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:07.192244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848fa54-77a7-4245-8570-5add26b6afee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:07.211576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b848fa54-77a7-4245-8570-5add26b6afee None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:07.212780 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b848fa54-77a7-4245-8570-5add26b6afee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:07.223997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:07.289119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 436/883] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:07.571575 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d7cf0-7499-43fc-9da6-1b3756daec41 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:07.634291 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268bdad-4069-45bf-8eaa-f73f0457e0dc None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:07.634612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268bdad-4069-45bf-8eaa-f73f0457e0dc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:07.634837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268bdad-4069-45bf-8eaa-f73f0457e0dc None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:07.636408 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 437/884] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:07.641356 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd7042-9a79-48bd-96a7-55a0452160fd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:07.641632 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd7042-9a79-48bd-96a7-55a0452160fd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:07.641890 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd7042-9a79-48bd-96a7-55a0452160fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:07.660219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:07.660554 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f0cd7042-9a79-48bd-96a7-55a0452160fd None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:07.661785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f0cd7042-9a79-48bd-96a7-55a0452160fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:07.681538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d7cf0-7499-43fc-9da6-1b3756daec41 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:07.723245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294004d7-4fc2-4d9f-8164-244ffa421831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:07.723880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294004d7-4fc2-4d9f-8164-244ffa421831 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:07.724160 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294004d7-4fc2-4d9f-8164-244ffa421831 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:07.724434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294004d7-4fc2-4d9f-8164-244ffa421831 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:07.725038 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294004d7-4fc2-4d9f-8164-244ffa421831 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:07.726436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294004d7-4fc2-4d9f-8164-244ffa421831 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-294004d7-4fc2-4d9f-8164-244ffa421831 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:07.735634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:07.736884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:07.738016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 448/885] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:22:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:07.742681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294004d7-4fc2-4d9f-8164-244ffa421831 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:07.749850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 438/886] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:22:07.850354 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294004d7-4fc2-4d9f-8164-244ffa421831 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:07.887553 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7a610-4783-4d66-9740-7a109bc1a691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:07.888504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7a610-4783-4d66-9740-7a109bc1a691 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:07.888925 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7a610-4783-4d66-9740-7a109bc1a691 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:07.889385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7a610-4783-4d66-9740-7a109bc1a691 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:07.890173 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7a610-4783-4d66-9740-7a109bc1a691 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:07.890633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7a610-4783-4d66-9740-7a109bc1a691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:07.892178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7a610-4783-4d66-9740-7a109bc1a691 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:07.898699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 449/887] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:22:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:07.904465 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd7042-9a79-48bd-96a7-55a0452160fd None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:07.983222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:08.009089 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd7042-9a79-48bd-96a7-55a0452160fd None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:08.027628 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7a610-4783-4d66-9740-7a109bc1a691 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:08.042451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:08.049636 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338ff46-a82d-4f22-af16-ae1c7ec904f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:08.050887 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338ff46-a82d-4f22-af16-ae1c7ec904f3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:08.051320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338ff46-a82d-4f22-af16-ae1c7ec904f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:08.051737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338ff46-a82d-4f22-af16-ae1c7ec904f3 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:08.052505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338ff46-a82d-4f22-af16-ae1c7ec904f3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:08.053342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338ff46-a82d-4f22-af16-ae1c7ec904f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:08.055336 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338ff46-a82d-4f22-af16-ae1c7ec904f3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:08.067807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 439/888] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:22:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:08.069417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338ff46-a82d-4f22-af16-ae1c7ec904f3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:08.150196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7a610-4783-4d66-9740-7a109bc1a691 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:08.200781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e14fb-b463-414c-accd-c23a5ecd256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:08.202228 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e14fb-b463-414c-accd-c23a5ecd256c None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:08.202769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e14fb-b463-414c-accd-c23a5ecd256c None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:08.203344 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e14fb-b463-414c-accd-c23a5ecd256c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:08.207133 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338ff46-a82d-4f22-af16-ae1c7ec904f3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:08.216086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e14fb-b463-414c-accd-c23a5ecd256c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-ed5e14fb-b463-414c-accd-c23a5ecd256c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:22:08.223171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:08.224106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:08.224940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:08.224940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:08.224940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:08.224940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:08.224940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:22:08.224940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:22:08.224940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:22:08.224940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:22:08.224940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:22:08.224940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:22:08.224940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 04:22:08.224940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:08.227592 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 450/889] 10.222.0.50 () {56 vars in 1120 bytes} [Sat Sep 17 04:22:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:08.233096 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e14fb-b463-414c-accd-c23a5ecd256c None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:08.247859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500a755-2566-4380-a91d-b597e9fe9ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:08.248492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500a755-2566-4380-a91d-b597e9fe9ceb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:08.248779 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500a755-2566-4380-a91d-b597e9fe9ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:08.249093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500a755-2566-4380-a91d-b597e9fe9ceb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:08.249803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500a755-2566-4380-a91d-b597e9fe9ceb None admin] RBAC: Adding query filter params (interface=public, service_id=ad59e423fad04559ba25b5220ad27e41, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:08.250108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500a755-2566-4380-a91d-b597e9fe9ceb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:08.251482 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500a755-2566-4380-a91d-b597e9fe9ceb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:08.262835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 440/890] 10.222.0.50 () {56 vars in 1251 bytes} [Sat Sep 17 04:22:08 2022] GET /identity/v3/endpoints?service_id=ad59e423fad04559ba25b5220ad27e41&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:08.263882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500a755-2566-4380-a91d-b597e9fe9ceb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:08.266541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:08.317617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:08.351540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e14fb-b463-414c-accd-c23a5ecd256c None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:08.371919 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500a755-2566-4380-a91d-b597e9fe9ceb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:08.391770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48e406-99cb-48ac-aa62-49f1b61cc620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:08.392912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48e406-99cb-48ac-aa62-49f1b61cc620 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:08.393392 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48e406-99cb-48ac-aa62-49f1b61cc620 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:08.393808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48e406-99cb-48ac-aa62-49f1b61cc620 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:08.394606 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48e406-99cb-48ac-aa62-49f1b61cc620 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:08.395051 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48e406-99cb-48ac-aa62-49f1b61cc620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:08.396843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48e406-99cb-48ac-aa62-49f1b61cc620 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:08.406456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 451/891] 10.222.0.50 () {56 vars in 1115 bytes} [Sat Sep 17 04:22:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:08.410914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3e401-8e47-4aaa-9d48-fe83ee33bb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:08.412024 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3e401-8e47-4aaa-9d48-fe83ee33bb35 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:08.412362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48e406-99cb-48ac-aa62-49f1b61cc620 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:08.412612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3e401-8e47-4aaa-9d48-fe83ee33bb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:08.413145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3e401-8e47-4aaa-9d48-fe83ee33bb35 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:08.413894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3e401-8e47-4aaa-9d48-fe83ee33bb35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:08.415768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3e401-8e47-4aaa-9d48-fe83ee33bb35 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:08.429032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 441/892] 10.222.0.50 () {56 vars in 1087 bytes} [Sat Sep 17 04:22:08 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:22:08.526720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48e406-99cb-48ac-aa62-49f1b61cc620 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:08.559501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:08.565861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5fff0-bc87-4919-87cd-6544488b422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:08.566507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5fff0-bc87-4919-87cd-6544488b422c None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:08.566782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5fff0-bc87-4919-87cd-6544488b422c None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:08.567049 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5fff0-bc87-4919-87cd-6544488b422c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:08.578837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5fff0-bc87-4919-87cd-6544488b422c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:08.580514 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5fff0-bc87-4919-87cd-6544488b422c None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-e5e5fff0-bc87-4919-87cd-6544488b422c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:08.597365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:08.598401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:08.599293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:08.599293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:08.599293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:08.599293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 452/893] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:08.604665 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3e401-8e47-4aaa-9d48-fe83ee33bb35 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:08.679593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:08.720598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3e401-8e47-4aaa-9d48-fe83ee33bb35 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:08.756252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5415e-0aca-4508-8326-f444f8b65a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:08.756864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5415e-0aca-4508-8326-f444f8b65a66 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:08.757173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5415e-0aca-4508-8326-f444f8b65a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:08.757443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5415e-0aca-4508-8326-f444f8b65a66 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:08.758350 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5415e-0aca-4508-8326-f444f8b65a66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:08.758651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5415e-0aca-4508-8326-f444f8b65a66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:08.760016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5415e-0aca-4508-8326-f444f8b65a66 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:08.773627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 442/894] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:08.779277 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5fff0-bc87-4919-87cd-6544488b422c None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:08.801473 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeba376-1d27-428f-8f58-5f40191d9e01 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:08.801778 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeba376-1d27-428f-8f58-5f40191d9e01 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:08.802018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeba376-1d27-428f-8f58-5f40191d9e01 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:08.803493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 443/895] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:08.808839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4658b-d25d-4958-8564-338b8df8aaab None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:08.809151 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4658b-d25d-4958-8564-338b8df8aaab None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:08.809423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4658b-d25d-4958-8564-338b8df8aaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:08.828035 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-cbe4658b-d25d-4958-8564-338b8df8aaab None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:08.829511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cbe4658b-d25d-4958-8564-338b8df8aaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:08.894552 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5fff0-bc87-4919-87cd-6544488b422c None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:08.907551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 444/896] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:22:08.935761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea708e2-3e08-4047-a099-90b6ab1de51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:08.936715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea708e2-3e08-4047-a099-90b6ab1de51c None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:08.937218 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea708e2-3e08-4047-a099-90b6ab1de51c None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:08.937725 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea708e2-3e08-4047-a099-90b6ab1de51c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:08.945940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea708e2-3e08-4047-a099-90b6ab1de51c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:08.947662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea708e2-3e08-4047-a099-90b6ab1de51c None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-eea708e2-3e08-4047-a099-90b6ab1de51c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:22:08.959313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:08.960246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:08.961196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:08.961196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:08.961196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:22:08.961196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:22:08.961196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:22:08.961196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:22:08.961196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:22:08.961196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:22:08.961196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 04:22:08.961196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:08.962466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 453/897] 10.222.0.50 () {56 vars in 1117 bytes} [Sat Sep 17 04:22:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:08.969794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4658b-d25d-4958-8564-338b8df8aaab None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:09.033204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:09.087371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4658b-d25d-4958-8564-338b8df8aaab None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:09.129152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190002e-cdff-4eb0-be37-48dafc791b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:09.129758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190002e-cdff-4eb0-be37-48dafc791b14 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:09.130034 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190002e-cdff-4eb0-be37-48dafc791b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:09.130299 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190002e-cdff-4eb0-be37-48dafc791b14 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:09.131024 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190002e-cdff-4eb0-be37-48dafc791b14 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:09.131327 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190002e-cdff-4eb0-be37-48dafc791b14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:09.133027 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190002e-cdff-4eb0-be37-48dafc791b14 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:09.156424 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 445/898] 10.222.0.50 () {56 vars in 1149 bytes} [Sat Sep 17 04:22:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:09.160457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea708e2-3e08-4047-a099-90b6ab1de51c None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:09.185352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66483949-47e5-45ff-bb00-92f304dbaaa9 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:09.185673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66483949-47e5-45ff-bb00-92f304dbaaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:09.185997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66483949-47e5-45ff-bb00-92f304dbaaa9 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:09.187480 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 446/899] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:22:09.190812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66483949-47e5-45ff-bb00-92f304dbaaa9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:09.214050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:09.271871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea708e2-3e08-4047-a099-90b6ab1de51c None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:09.300250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66483949-47e5-45ff-bb00-92f304dbaaa9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:09.306416 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c04a-fe7f-4913-9387-68cca946374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:09.307027 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c04a-fe7f-4913-9387-68cca946374d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:09.307305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c04a-fe7f-4913-9387-68cca946374d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:09.307574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c04a-fe7f-4913-9387-68cca946374d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:09.315113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:09.336593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350a097-da69-4371-a53d-0a6053b1499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:09.337249 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a097-da69-4371-a53d-0a6053b1499b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:09.337530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a097-da69-4371-a53d-0a6053b1499b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:09.337797 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a097-da69-4371-a53d-0a6053b1499b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:09.338381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350a097-da69-4371-a53d-0a6053b1499b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:09.339751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350a097-da69-4371-a53d-0a6053b1499b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-f350a097-da69-4371-a53d-0a6053b1499b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:09.349746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:09.350707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:09.351598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 447/900] 10.222.0.50 () {56 vars in 1132 bytes} [Sat Sep 17 04:22:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:09.352748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4778b-5b8f-4d01-91a2-99c7e660c04a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:09.352748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4778b-5b8f-4d01-91a2-99c7e660c04a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:09.352748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4778b-5b8f-4d01-91a2-99c7e660c04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:09.370817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-62e4778b-5b8f-4d01-91a2-99c7e660c04a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:09.371965 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-62e4778b-5b8f-4d01-91a2-99c7e660c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:09.388091 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3c04a-fe7f-4913-9387-68cca946374d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:09.390019 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3c04a-fe7f-4913-9387-68cca946374d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:09.438624 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:09.439573 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 448/901] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:09.441849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4778b-5b8f-4d01-91a2-99c7e660c04a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:09.525043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 454/902] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:22:09 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:22:09.530115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c04a-fe7f-4913-9387-68cca946374d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:09.561026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4778b-5b8f-4d01-91a2-99c7e660c04a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:09.571756 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:09.599907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da77b58-16b7-44ff-88af-68661d3213ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:09.600785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da77b58-16b7-44ff-88af-68661d3213ec None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:09.601346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da77b58-16b7-44ff-88af-68661d3213ec None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:09.602171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da77b58-16b7-44ff-88af-68661d3213ec None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:09.602930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da77b58-16b7-44ff-88af-68661d3213ec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:09.603298 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da77b58-16b7-44ff-88af-68661d3213ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:09.605265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da77b58-16b7-44ff-88af-68661d3213ec None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:09.616184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 449/903] 10.222.0.50 () {56 vars in 1126 bytes} [Sat Sep 17 04:22:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:09.617384 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da77b58-16b7-44ff-88af-68661d3213ec None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:09.656319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c04a-fe7f-4913-9387-68cca946374d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:09.693920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd39815-4cad-4016-bac1-dd09183d3e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:09.694903 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd39815-4cad-4016-bac1-dd09183d3e7c None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:09.695374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd39815-4cad-4016-bac1-dd09183d3e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:09.695854 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd39815-4cad-4016-bac1-dd09183d3e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:09.706681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd39815-4cad-4016-bac1-dd09183d3e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:09.708115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd39815-4cad-4016-bac1-dd09183d3e7c None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:09.710639 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-dfd39815-4cad-4016-bac1-dd09183d3e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:09.723405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:09.724358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:09.725359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:09.725359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:09.725359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:09.725359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 455/904] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:09.725359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd39815-4cad-4016-bac1-dd09183d3e7c None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:09.745046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da77b58-16b7-44ff-88af-68661d3213ec None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:09.781390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538efaea-c041-4743-bb8e-b8ad978cc449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:09.781993 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538efaea-c041-4743-bb8e-b8ad978cc449 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:09.782265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538efaea-c041-4743-bb8e-b8ad978cc449 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:09.782531 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538efaea-c041-4743-bb8e-b8ad978cc449 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:09.783818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538efaea-c041-4743-bb8e-b8ad978cc449 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:09.784412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538efaea-c041-4743-bb8e-b8ad978cc449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:09.785360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538efaea-c041-4743-bb8e-b8ad978cc449 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:09.795275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 450/905] 10.222.0.50 () {56 vars in 1126 bytes} [Sat Sep 17 04:22:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:09.795275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538efaea-c041-4743-bb8e-b8ad978cc449 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:09.831289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:09.841965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd39815-4cad-4016-bac1-dd09183d3e7c None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:09.877859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c1c47-9b26-4034-8681-484a5990f019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:09.878456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c1c47-9b26-4034-8681-484a5990f019 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:09.878731 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c1c47-9b26-4034-8681-484a5990f019 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:09.879012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c1c47-9b26-4034-8681-484a5990f019 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:09.879658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c1c47-9b26-4034-8681-484a5990f019 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:09.881047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c1c47-9b26-4034-8681-484a5990f019 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:09.905758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538efaea-c041-4743-bb8e-b8ad978cc449 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:09.937631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 456/906] 10.222.0.50 () {60 vars in 1141 bytes} [Sat Sep 17 04:22:09 2022] POST /identity/v3/services => generated 241 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:22:09.946722 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c1c47-9b26-4034-8681-484a5990f019 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:09.948335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9ea98-16a4-4012-a0a0-198e5b7ec6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:09.948943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9ea98-16a4-4012-a0a0-198e5b7ec6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:09.954981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9ea98-16a4-4012-a0a0-198e5b7ec6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:09.954981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9ea98-16a4-4012-a0a0-198e5b7ec6e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:09.954981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9ea98-16a4-4012-a0a0-198e5b7ec6e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:09.954981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9ea98-16a4-4012-a0a0-198e5b7ec6e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:09.954981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9ea98-16a4-4012-a0a0-198e5b7ec6e4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:09.967962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 451/907] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:09.974132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9ea98-16a4-4012-a0a0-198e5b7ec6e4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:10.038415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:10.093008 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c1c47-9b26-4034-8681-484a5990f019 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:10.102032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:10.114059 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9ea98-16a4-4012-a0a0-198e5b7ec6e4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:10.137849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e1ca2-fd12-4d84-b44e-8b991785cbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:10.138773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e1ca2-fd12-4d84-b44e-8b991785cbcd None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:10.139050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e1ca2-fd12-4d84-b44e-8b991785cbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:10.139321 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e1ca2-fd12-4d84-b44e-8b991785cbcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:10.140032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e1ca2-fd12-4d84-b44e-8b991785cbcd None admin] RBAC: Adding query filter params (interface=public, service_id=4560090347aa4d58a8aadc9284657b33, region_id=RegionOne) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:10.140336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e1ca2-fd12-4d84-b44e-8b991785cbcd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:10.142285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e1ca2-fd12-4d84-b44e-8b991785cbcd None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:10.160284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 457/908] 10.222.0.50 () {56 vars in 1251 bytes} [Sat Sep 17 04:22:09 2022] GET /identity/v3/endpoints?service_id=4560090347aa4d58a8aadc9284657b33&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:10.164308 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e1ca2-fd12-4d84-b44e-8b991785cbcd None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:10.171103 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439a98a-67c4-4d9e-9c3b-5ed6aa199aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:10.171989 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439a98a-67c4-4d9e-9c3b-5ed6aa199aaa None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:10.172429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439a98a-67c4-4d9e-9c3b-5ed6aa199aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:10.172845 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439a98a-67c4-4d9e-9c3b-5ed6aa199aaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:10.191264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439a98a-67c4-4d9e-9c3b-5ed6aa199aaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:10.193496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439a98a-67c4-4d9e-9c3b-5ed6aa199aaa None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-b439a98a-67c4-4d9e-9c3b-5ed6aa199aaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:22:10.209412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:10.210505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:10.211599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:22:10.211599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:22:10.211599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:22:10.211599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:22:10.211599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:22:10.211599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:22:10.211599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:10.211599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:10.215050 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 452/909] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:22:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:10.222212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439a98a-67c4-4d9e-9c3b-5ed6aa199aaa None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:10.294154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e1ca2-fd12-4d84-b44e-8b991785cbcd None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:10.323740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:10.344097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49045586-5719-4513-b20a-324f85b746da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:10.345978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49045586-5719-4513-b20a-324f85b746da None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:10.346270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49045586-5719-4513-b20a-324f85b746da None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:10.346607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49045586-5719-4513-b20a-324f85b746da None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:10.347721 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49045586-5719-4513-b20a-324f85b746da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:10.349475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49045586-5719-4513-b20a-324f85b746da None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:10.350754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439a98a-67c4-4d9e-9c3b-5ed6aa199aaa None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:10.361087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 458/910] 10.222.0.50 () {56 vars in 1087 bytes} [Sat Sep 17 04:22:10 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:22:10.399562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4015fa-00d4-46e7-b1e9-d03da1ab7b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:10.400602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4015fa-00d4-46e7-b1e9-d03da1ab7b20 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:10.401116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4015fa-00d4-46e7-b1e9-d03da1ab7b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:10.401592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4015fa-00d4-46e7-b1e9-d03da1ab7b20 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:10.402611 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4015fa-00d4-46e7-b1e9-d03da1ab7b20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:10.403124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4015fa-00d4-46e7-b1e9-d03da1ab7b20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:10.404860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4015fa-00d4-46e7-b1e9-d03da1ab7b20 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:10.420012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 453/911] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:22:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:10.427292 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49045586-5719-4513-b20a-324f85b746da None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:10.544140 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49045586-5719-4513-b20a-324f85b746da None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:10.581985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317de19-8acb-4555-aea5-e81f605f3b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:10.582967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317de19-8acb-4555-aea5-e81f605f3b28 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:10.583446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317de19-8acb-4555-aea5-e81f605f3b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:10.583933 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317de19-8acb-4555-aea5-e81f605f3b28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:10.584871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317de19-8acb-4555-aea5-e81f605f3b28 None admin] RBAC: Adding query filter params (role.id=26cc723263984bd0bf00ea579afa96cb, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=597874ccdd284d9d88f3e743c4759d95) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:10.585403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317de19-8acb-4555-aea5-e81f605f3b28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:10.587040 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317de19-8acb-4555-aea5-e81f605f3b28 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:10.593545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 459/912] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:22:10 2022] GET /identity/v3/role_assignments?user.id=597874ccdd284d9d88f3e743c4759d95&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=26cc723263984bd0bf00ea579afa96cb => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:10.786113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40407e-894d-433e-8e21-86c6fbb55c05 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:10.786763 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40407e-894d-433e-8e21-86c6fbb55c05 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:10.787233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40407e-894d-433e-8e21-86c6fbb55c05 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:10.788866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 454/913] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:10.794249 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc2d6c-775e-4a4c-8799-8fb78d6ec41e None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:10.794790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc2d6c-775e-4a4c-8799-8fb78d6ec41e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:10.795280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc2d6c-775e-4a4c-8799-8fb78d6ec41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:10.815202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-27bc2d6c-775e-4a4c-8799-8fb78d6ec41e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:10.816726 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-27bc2d6c-775e-4a4c-8799-8fb78d6ec41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:10.860260 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:10.887283 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 460/914] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:11.170042 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40407e-894d-433e-8e21-86c6fbb55c05 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:11.186552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:11.284296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40407e-894d-433e-8e21-86c6fbb55c05 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:11.325882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26860f44-6179-4ddb-974c-80d2cf42d04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:11.330202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26860f44-6179-4ddb-974c-80d2cf42d04e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:11.330202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26860f44-6179-4ddb-974c-80d2cf42d04e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:11.330202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26860f44-6179-4ddb-974c-80d2cf42d04e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:11.330202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26860f44-6179-4ddb-974c-80d2cf42d04e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:11.330202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26860f44-6179-4ddb-974c-80d2cf42d04e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-26860f44-6179-4ddb-974c-80d2cf42d04e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:11.339086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:11.340155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:11.341504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 455/915] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:22:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:11.347168 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc2d6c-775e-4a4c-8799-8fb78d6ec41e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:11.450481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc2d6c-775e-4a4c-8799-8fb78d6ec41e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:11.485205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec346cd6-66cf-438c-8aa4-fd43d0e13b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:11.485808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec346cd6-66cf-438c-8aa4-fd43d0e13b86 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:11.486087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec346cd6-66cf-438c-8aa4-fd43d0e13b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:11.486385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec346cd6-66cf-438c-8aa4-fd43d0e13b86 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:11.487088 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec346cd6-66cf-438c-8aa4-fd43d0e13b86 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:11.487389 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec346cd6-66cf-438c-8aa4-fd43d0e13b86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:11.488755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec346cd6-66cf-438c-8aa4-fd43d0e13b86 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:11.493797 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 461/916] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:22:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:11.499195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26860f44-6179-4ddb-974c-80d2cf42d04e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:11.580819 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:11.605900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26860f44-6179-4ddb-974c-80d2cf42d04e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:11.648570 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33199db3-bcc6-4a41-86cb-127da403f865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:11.649208 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33199db3-bcc6-4a41-86cb-127da403f865 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:11.649485 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33199db3-bcc6-4a41-86cb-127da403f865 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:11.649754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33199db3-bcc6-4a41-86cb-127da403f865 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:11.650384 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33199db3-bcc6-4a41-86cb-127da403f865 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:11.650684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33199db3-bcc6-4a41-86cb-127da403f865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:11.652046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33199db3-bcc6-4a41-86cb-127da403f865 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:11.657238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 456/917] 10.222.0.50 () {56 vars in 1114 bytes} [Sat Sep 17 04:22:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:11.663266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec346cd6-66cf-438c-8aa4-fd43d0e13b86 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:11.708360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:11.765836 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec346cd6-66cf-438c-8aa4-fd43d0e13b86 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:11.803529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39203ab8-e24b-4a6a-9908-d6140eaf969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:11.804140 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39203ab8-e24b-4a6a-9908-d6140eaf969d None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:11.804467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39203ab8-e24b-4a6a-9908-d6140eaf969d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:11.804743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39203ab8-e24b-4a6a-9908-d6140eaf969d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:11.805454 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39203ab8-e24b-4a6a-9908-d6140eaf969d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:11.806825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39203ab8-e24b-4a6a-9908-d6140eaf969d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:11.899905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 462/918] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:22:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:22:12.249149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e899773-e11e-4b4c-a309-8e9490b743cc None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:12.249829 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e899773-e11e-4b4c-a309-8e9490b743cc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:12.250313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e899773-e11e-4b4c-a309-8e9490b743cc None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:12.252177 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 457/919] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:12.258294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23bd10-23a9-45d6-b9e9-31f18a8be1c9 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:12.258578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23bd10-23a9-45d6-b9e9-31f18a8be1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:12.258852 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23bd10-23a9-45d6-b9e9-31f18a8be1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:12.278624 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-1d23bd10-23a9-45d6-b9e9-31f18a8be1c9 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:12.279820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1d23bd10-23a9-45d6-b9e9-31f18a8be1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:12.356766 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 463/920] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:12.632806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e899773-e11e-4b4c-a309-8e9490b743cc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:12.720024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a8879-9385-43fb-a4af-07a2a9c2a3f2 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:12.720367 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a8879-9385-43fb-a4af-07a2a9c2a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:12.721129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a8879-9385-43fb-a4af-07a2a9c2a3f2 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:12.722635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 464/921] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:22:12.727501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871fe3-5ab5-4755-87a2-2f82ac30af61 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:12.727788 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871fe3-5ab5-4755-87a2-2f82ac30af61 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:12.728065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871fe3-5ab5-4755-87a2-2f82ac30af61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:12.745730 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e899773-e11e-4b4c-a309-8e9490b743cc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:12.747194 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c9871fe3-5ab5-4755-87a2-2f82ac30af61 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:12.748418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c9871fe3-5ab5-4755-87a2-2f82ac30af61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:12.768671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:12.788036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fccb7-272a-4abb-848f-6d18bc4e9430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:12.789073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fccb7-272a-4abb-848f-6d18bc4e9430 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:12.789561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fccb7-272a-4abb-848f-6d18bc4e9430 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:12.790036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fccb7-272a-4abb-848f-6d18bc4e9430 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:12.790859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fccb7-272a-4abb-848f-6d18bc4e9430 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:12.792521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fccb7-272a-4abb-848f-6d18bc4e9430 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-983fccb7-272a-4abb-848f-6d18bc4e9430 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:12.806435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:12.807479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:12.808664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 458/922] 10.222.0.50 () {56 vars in 1126 bytes} [Sat Sep 17 04:22:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:12.815738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fccb7-272a-4abb-848f-6d18bc4e9430 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:12.829333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:12.838399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 465/923] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:22:12.889322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dfd00-0c2f-44b9-a995-9296ccc6fe62 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:12.889943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dfd00-0c2f-44b9-a995-9296ccc6fe62 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:12.890654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dfd00-0c2f-44b9-a995-9296ccc6fe62 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:12.894885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 466/924] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:12.899379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5c264-c67c-4f63-b41c-3672a79a393e None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:12.899927 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5c264-c67c-4f63-b41c-3672a79a393e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:12.900422 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5c264-c67c-4f63-b41c-3672a79a393e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:12.919131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-d2e5c264-c67c-4f63-b41c-3672a79a393e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:12.920637 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d2e5c264-c67c-4f63-b41c-3672a79a393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:12.934014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fccb7-272a-4abb-848f-6d18bc4e9430 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:12.983604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177ad8b-e8c9-401d-99bb-3adfdbd1f8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:12.984215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177ad8b-e8c9-401d-99bb-3adfdbd1f8cd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:12.984489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177ad8b-e8c9-401d-99bb-3adfdbd1f8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:12.984757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177ad8b-e8c9-401d-99bb-3adfdbd1f8cd None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:12.985634 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177ad8b-e8c9-401d-99bb-3adfdbd1f8cd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:12.985967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177ad8b-e8c9-401d-99bb-3adfdbd1f8cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:12.988044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177ad8b-e8c9-401d-99bb-3adfdbd1f8cd None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:12.997149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 459/925] 10.222.0.50 () {56 vars in 1122 bytes} [Sat Sep 17 04:22:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:12.997292 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 467/926] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:22:12.998772 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177ad8b-e8c9-401d-99bb-3adfdbd1f8cd None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:13.074100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:13.108547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177ad8b-e8c9-401d-99bb-3adfdbd1f8cd None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:13.111144 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5c264-c67c-4f63-b41c-3672a79a393e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:13.153392 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ad94c-be41-4415-8f75-131c09a60199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:13.154528 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ad94c-be41-4415-8f75-131c09a60199 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:13.155836 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ad94c-be41-4415-8f75-131c09a60199 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:13.156317 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ad94c-be41-4415-8f75-131c09a60199 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:13.157194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ad94c-be41-4415-8f75-131c09a60199 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:13.157704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ad94c-be41-4415-8f75-131c09a60199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:13.159885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ad94c-be41-4415-8f75-131c09a60199 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:13.165699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 460/927] 10.222.0.50 () {56 vars in 1122 bytes} [Sat Sep 17 04:22:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:13.172301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ad94c-be41-4415-8f75-131c09a60199 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:13.222384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:13.245078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5c264-c67c-4f63-b41c-3672a79a393e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:13.289244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb42904-933f-4b4a-b2b1-d0699c7e6690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:13.289880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb42904-933f-4b4a-b2b1-d0699c7e6690 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:13.290159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb42904-933f-4b4a-b2b1-d0699c7e6690 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:13.290429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb42904-933f-4b4a-b2b1-d0699c7e6690 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:13.291022 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb42904-933f-4b4a-b2b1-d0699c7e6690 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:13.291575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ad94c-be41-4415-8f75-131c09a60199 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:13.292419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb42904-933f-4b4a-b2b1-d0699c7e6690 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-1fb42904-933f-4b4a-b2b1-d0699c7e6690 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:13.301879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:13.302840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:13.303757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 468/928] 10.222.0.50 () {56 vars in 1132 bytes} [Sat Sep 17 04:22:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:13.304536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb42904-933f-4b4a-b2b1-d0699c7e6690 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:13.328559 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:13.335247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0517b0-d3f6-46fb-9ed1-095e925a8c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:13.336008 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0517b0-d3f6-46fb-9ed1-095e925a8c90 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:13.336286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0517b0-d3f6-46fb-9ed1-095e925a8c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:13.336669 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0517b0-d3f6-46fb-9ed1-095e925a8c90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:13.337398 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0517b0-d3f6-46fb-9ed1-095e925a8c90 None admin] RBAC: Adding query filter params (interface=public, service_id=e20f70ea6c8f48f68e7f26a2336fe067, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:13.337707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0517b0-d3f6-46fb-9ed1-095e925a8c90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:13.339078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0517b0-d3f6-46fb-9ed1-095e925a8c90 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:13.349069 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 461/929] 10.222.0.50 () {56 vars in 1251 bytes} [Sat Sep 17 04:22:13 2022] GET /identity/v3/endpoints?service_id=e20f70ea6c8f48f68e7f26a2336fe067&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:13.349069 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0517b0-d3f6-46fb-9ed1-095e925a8c90 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:13.414230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb42904-933f-4b4a-b2b1-d0699c7e6690 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:13.451279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633120e2-19f6-458d-85eb-f05e22cf3cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:13.451898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633120e2-19f6-458d-85eb-f05e22cf3cfe None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:13.452173 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633120e2-19f6-458d-85eb-f05e22cf3cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:13.452445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633120e2-19f6-458d-85eb-f05e22cf3cfe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:13.459327 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0517b0-d3f6-46fb-9ed1-095e925a8c90 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:13.462282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633120e2-19f6-458d-85eb-f05e22cf3cfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-633120e2-19f6-458d-85eb-f05e22cf3cfe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:22:13.467605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:13.468508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:13.469382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:13.469382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:13.469382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:13.469382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:13.469382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:22:13.469382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:22:13.469382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:22:13.469382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:22:13.469382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:22:13.469382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:22:13.469382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 04:22:13.469382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:13.469382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 469/930] 10.222.0.50 () {56 vars in 1120 bytes} [Sat Sep 17 04:22:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:13.470060 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633120e2-19f6-458d-85eb-f05e22cf3cfe None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:13.482093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:13.501629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baf61e-9550-4708-a0db-31d0aa2b460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:13.502496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf61e-9550-4708-a0db-31d0aa2b460e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:13.502919 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf61e-9550-4708-a0db-31d0aa2b460e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:13.503343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf61e-9550-4708-a0db-31d0aa2b460e None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:13.504106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baf61e-9550-4708-a0db-31d0aa2b460e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:13.504561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baf61e-9550-4708-a0db-31d0aa2b460e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:13.506179 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baf61e-9550-4708-a0db-31d0aa2b460e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:13.512636 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 462/931] 10.222.0.50 () {56 vars in 1126 bytes} [Sat Sep 17 04:22:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:13.513612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baf61e-9550-4708-a0db-31d0aa2b460e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:13.577543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:13.583285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633120e2-19f6-458d-85eb-f05e22cf3cfe None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:13.617811 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127b9cd-7373-48d5-8719-5926e05142de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:13.618419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127b9cd-7373-48d5-8719-5926e05142de None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:13.618695 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127b9cd-7373-48d5-8719-5926e05142de None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:13.618962 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127b9cd-7373-48d5-8719-5926e05142de None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:13.619448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baf61e-9550-4708-a0db-31d0aa2b460e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:13.619560 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127b9cd-7373-48d5-8719-5926e05142de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:13.620922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127b9cd-7373-48d5-8719-5926e05142de None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:13.635230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 470/932] 10.222.0.50 () {56 vars in 1087 bytes} [Sat Sep 17 04:22:13 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:22:13.635230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127b9cd-7373-48d5-8719-5926e05142de None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:13.656896 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abde0d-b779-463c-991d-c7e912c8831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:13.657549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abde0d-b779-463c-991d-c7e912c8831b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:13.657827 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abde0d-b779-463c-991d-c7e912c8831b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:13.658708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abde0d-b779-463c-991d-c7e912c8831b None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:13.659566 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abde0d-b779-463c-991d-c7e912c8831b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:13.659874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abde0d-b779-463c-991d-c7e912c8831b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:13.661410 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abde0d-b779-463c-991d-c7e912c8831b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:13.676626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 463/933] 10.222.0.50 () {56 vars in 1115 bytes} [Sat Sep 17 04:22:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:13.677955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abde0d-b779-463c-991d-c7e912c8831b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:13.742514 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:13.790639 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127b9cd-7373-48d5-8719-5926e05142de None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:13.804007 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abde0d-b779-463c-991d-c7e912c8831b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:13.831662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:13.839470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bee111-be93-46b7-a520-0ad258c84a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:13.840355 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bee111-be93-46b7-a520-0ad258c84a6f None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:13.841025 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bee111-be93-46b7-a520-0ad258c84a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:13.841025 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bee111-be93-46b7-a520-0ad258c84a6f None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:13.841555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bee111-be93-46b7-a520-0ad258c84a6f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:13.841852 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bee111-be93-46b7-a520-0ad258c84a6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:13.843229 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bee111-be93-46b7-a520-0ad258c84a6f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:13.849986 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 471/934] 10.222.0.50 () {56 vars in 1126 bytes} [Sat Sep 17 04:22:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:13.850678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3255d5-c34e-40a3-aa93-d54622352e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:13.854235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3255d5-c34e-40a3-aa93-d54622352e48 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:13.854235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3255d5-c34e-40a3-aa93-d54622352e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:13.854235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3255d5-c34e-40a3-aa93-d54622352e48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:13.856113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bee111-be93-46b7-a520-0ad258c84a6f None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:13.865850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3255d5-c34e-40a3-aa93-d54622352e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:13.867450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3255d5-c34e-40a3-aa93-d54622352e48 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-de3255d5-c34e-40a3-aa93-d54622352e48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:13.886767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:13.888018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:13.888900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:13.888900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:13.888900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:13.888900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 464/935] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:13.895045 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3255d5-c34e-40a3-aa93-d54622352e48 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:13.996155 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bee111-be93-46b7-a520-0ad258c84a6f None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:14.013750 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3255d5-c34e-40a3-aa93-d54622352e48 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:14.039435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acfc1a-4d7a-4a91-ac2a-a4f36ed7a455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:14.040489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acfc1a-4d7a-4a91-ac2a-a4f36ed7a455 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:14.040981 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acfc1a-4d7a-4a91-ac2a-a4f36ed7a455 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:14.041474 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acfc1a-4d7a-4a91-ac2a-a4f36ed7a455 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:14.042346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acfc1a-4d7a-4a91-ac2a-a4f36ed7a455 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:14.043900 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acfc1a-4d7a-4a91-ac2a-a4f36ed7a455 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:14.050739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:14.059127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd9ebf-257e-41a9-8194-aa7c20923bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:14.059732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9ebf-257e-41a9-8194-aa7c20923bbe None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:14.060008 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9ebf-257e-41a9-8194-aa7c20923bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:14.060273 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9ebf-257e-41a9-8194-aa7c20923bbe None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:14.060917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd9ebf-257e-41a9-8194-aa7c20923bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:14.061266 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd9ebf-257e-41a9-8194-aa7c20923bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:14.062654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd9ebf-257e-41a9-8194-aa7c20923bbe None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:14.075591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 465/936] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:14.081094 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd9ebf-257e-41a9-8194-aa7c20923bbe None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:14.120897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:14.145899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 472/937] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:22:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:22:14.206787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd9ebf-257e-41a9-8194-aa7c20923bbe None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:14.228757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170f74-801e-49c6-b6f5-2bf65201b298 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:14.229064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170f74-801e-49c6-b6f5-2bf65201b298 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:14.229337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170f74-801e-49c6-b6f5-2bf65201b298 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:14.230986 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 473/938] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:22:14.237331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abed4aa-283e-48d5-b473-dedf32266977 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:14.237613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abed4aa-283e-48d5-b473-dedf32266977 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:14.237877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abed4aa-283e-48d5-b473-dedf32266977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:14.254374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca5035-d90f-4d4b-a983-17a3dcbc30d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:14.254948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca5035-d90f-4d4b-a983-17a3dcbc30d4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:14.255219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca5035-d90f-4d4b-a983-17a3dcbc30d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:14.255477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca5035-d90f-4d4b-a983-17a3dcbc30d4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:14.259610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-6abed4aa-283e-48d5-b473-dedf32266977 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:14.260923 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6abed4aa-283e-48d5-b473-dedf32266977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:14.263828 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca5035-d90f-4d4b-a983-17a3dcbc30d4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:14.265357 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca5035-d90f-4d4b-a983-17a3dcbc30d4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-36ca5035-d90f-4d4b-a983-17a3dcbc30d4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:22:14.280494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:14.281589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:14.283976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:14.283976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:14.283976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:22:14.283976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:22:14.283976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:22:14.283976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:22:14.283976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:22:14.283976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:22:14.283976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 04:22:14.283976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:14.283976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 466/939] 10.222.0.50 () {56 vars in 1117 bytes} [Sat Sep 17 04:22:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:14.290103 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca5035-d90f-4d4b-a983-17a3dcbc30d4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:14.346373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 474/940] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:14.391989 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:14.401953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca5035-d90f-4d4b-a983-17a3dcbc30d4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:14.438182 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d018983-36a4-48a2-ad0c-b92a18bea135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:14.438849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d018983-36a4-48a2-ad0c-b92a18bea135 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:14.439153 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d018983-36a4-48a2-ad0c-b92a18bea135 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:14.439419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d018983-36a4-48a2-ad0c-b92a18bea135 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:14.440157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d018983-36a4-48a2-ad0c-b92a18bea135 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:14.440452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d018983-36a4-48a2-ad0c-b92a18bea135 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:14.441948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d018983-36a4-48a2-ad0c-b92a18bea135 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:14.466235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 467/941] 10.222.0.50 () {56 vars in 1149 bytes} [Sat Sep 17 04:22:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:14.467741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abed4aa-283e-48d5-b473-dedf32266977 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:14.574864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abed4aa-283e-48d5-b473-dedf32266977 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:14.599113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:14.612186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b3a1b-07c7-43c2-9b49-61debb8d00bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:14.612845 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b3a1b-07c7-43c2-9b49-61debb8d00bd None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:14.613158 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b3a1b-07c7-43c2-9b49-61debb8d00bd None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:14.622927 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b3a1b-07c7-43c2-9b49-61debb8d00bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:14.624815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b3a1b-07c7-43c2-9b49-61debb8d00bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:14.626365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b3a1b-07c7-43c2-9b49-61debb8d00bd None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:14.630390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d018983-36a4-48a2-ad0c-b92a18bea135 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-ad8b3a1b-07c7-43c2-9b49-61debb8d00bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:14.645136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:14.646070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:14.646934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:14.646934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:14.646934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:14.646934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 475/942] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:14.653161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b3a1b-07c7-43c2-9b49-61debb8d00bd None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:14.748797 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d018983-36a4-48a2-ad0c-b92a18bea135 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:14.780578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b3a1b-07c7-43c2-9b49-61debb8d00bd None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:14.792178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d06599-fee8-4982-b16c-65686bc423e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:14.793436 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d06599-fee8-4982-b16c-65686bc423e7 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:14.793933 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d06599-fee8-4982-b16c-65686bc423e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:14.794640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d06599-fee8-4982-b16c-65686bc423e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:14.795936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d06599-fee8-4982-b16c-65686bc423e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:14.798093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d06599-fee8-4982-b16c-65686bc423e7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:14.802740 dv-cinder-857993-2-smb devstack@keystone.service[81615]: WARNING keystone.server.flask.common [None req-92d06599-fee8-4982-b16c-65686bc423e7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 17 04:22:14.817027 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f890978-04ac-4710-9624-297eaae4f0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:14.817642 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f890978-04ac-4710-9624-297eaae4f0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:14.817918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f890978-04ac-4710-9624-297eaae4f0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:14.818188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f890978-04ac-4710-9624-297eaae4f0c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:14.818827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f890978-04ac-4710-9624-297eaae4f0c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:14.819116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f890978-04ac-4710-9624-297eaae4f0c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:14.820548 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f890978-04ac-4710-9624-297eaae4f0c4 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:14.838432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 476/943] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:14.838432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f890978-04ac-4710-9624-297eaae4f0c4 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:14.857671 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.sql.core [None req-92d06599-fee8-4982-b16c-65686bc423e7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 04:22:14.857671 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 17 04:22:14.857671 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [parameters: {'id': 'e913e6daa69a453d83b3bcc6c600be7d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 17 04:22:14.857671 dv-cinder-857993-2-smb devstack@keystone.service[81615]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81615) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 17 04:22:14.875230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:14.881953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-92d06599-fee8-4982-b16c-65686bc423e7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e913e6daa69a453d83b3bcc6c600be7d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e913e6daa69a453d83b3bcc6c600be7d. Sep 17 04:22:14.881953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:14.881953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 04:22:14.881953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 04:22:14.881953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 04:22:14.881953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 04:22:14.881953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 04:22:14.881953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 04:22:14.881953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 04:22:14.881953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application conn.query(q) Sep 17 04:22:14.881953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 04:22:14.881953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 04:22:14.881953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result.read() Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 17 04:22:14.883040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application next(self.gen) Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application yield resource Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application next(self.gen) Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.session.rollback() Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.force_reraise() Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise self.value Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application session.commit() Sep 17 04:22:14.883961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._prepare_impl() Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.session.flush() Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._flush(objects) Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application compat.raise_( Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application flush_context.execute() Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 04:22:14.884850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rec.execute(self) Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 17 04:22:14.893816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application conn.query(q) Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result.read() Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 04:22:14.894607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [parameters: {'id': 'e913e6daa69a453d83b3bcc6c600be7d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:14.895470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:14.896254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:14.898571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:14.898571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 17 04:22:14.898571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 17 04:22:14.898571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:14.898571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:14.898571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 17 04:22:14.898571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 17 04:22:14.898571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e913e6daa69a453d83b3bcc6c600be7d. Sep 17 04:22:14.898571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:14.898571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 468/944] 10.222.0.50 () {60 vars in 1140 bytes} [Sat Sep 17 04:22:14 2022] POST /identity/v3/projects => generated 262 bytes in 258 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:14.901101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d06599-fee8-4982-b16c-65686bc423e7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:14.905516 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:14.958183 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f890978-04ac-4710-9624-297eaae4f0c4 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:14.997829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa8743-77ad-4560-a836-478df1612478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:14.998481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa8743-77ad-4560-a836-478df1612478 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:14.998763 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa8743-77ad-4560-a836-478df1612478 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:14.999038 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa8743-77ad-4560-a836-478df1612478 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:15.009857 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa8743-77ad-4560-a836-478df1612478 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:15.011859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa8743-77ad-4560-a836-478df1612478 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:15.014839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d06599-fee8-4982-b16c-65686bc423e7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-b2fa8743-77ad-4560-a836-478df1612478 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:22:15.027371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:15.028299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:15.029216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:22:15.029216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:22:15.029216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:22:15.029216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:22:15.029216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:22:15.029216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:22:15.029216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:15.029216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:15.033234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 477/945] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:22:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:15.036535 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa8743-77ad-4560-a836-478df1612478 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:15.075315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8755c7-1ec4-4860-a91b-81a910b05142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:15.077100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8755c7-1ec4-4860-a91b-81a910b05142 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:15.077612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8755c7-1ec4-4860-a91b-81a910b05142 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:15.078089 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8755c7-1ec4-4860-a91b-81a910b05142 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:15.088630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8755c7-1ec4-4860-a91b-81a910b05142 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:15.091040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8755c7-1ec4-4860-a91b-81a910b05142 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-cf8755c7-1ec4-4860-a91b-81a910b05142 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:22:15.106861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:15.107762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:15.108687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:22:15.108687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:22:15.108687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:22:15.108687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:22:15.108687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:22:15.108687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:22:15.108687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:15.108687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:15.113028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 469/946] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:22:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:15.116640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8755c7-1ec4-4860-a91b-81a910b05142 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:15.150127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:15.158835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa8743-77ad-4560-a836-478df1612478 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:15.196235 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaac31-fb39-4a8b-986b-0b5d78efc625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:15.197116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaac31-fb39-4a8b-986b-0b5d78efc625 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:15.197498 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaac31-fb39-4a8b-986b-0b5d78efc625 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:15.198110 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaac31-fb39-4a8b-986b-0b5d78efc625 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:15.198815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaac31-fb39-4a8b-986b-0b5d78efc625 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:15.199225 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaac31-fb39-4a8b-986b-0b5d78efc625 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:15.200912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaac31-fb39-4a8b-986b-0b5d78efc625 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:15.205648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:15.220488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 478/947] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:22:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:15.226384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaac31-fb39-4a8b-986b-0b5d78efc625 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:15.254506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8755c7-1ec4-4860-a91b-81a910b05142 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:15.292253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488e699-4736-4d72-a130-fd197fdbbf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:15.292863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488e699-4736-4d72-a130-fd197fdbbf8f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:15.293222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488e699-4736-4d72-a130-fd197fdbbf8f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:15.293507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488e699-4736-4d72-a130-fd197fdbbf8f None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:15.294184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488e699-4736-4d72-a130-fd197fdbbf8f None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:15.294615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488e699-4736-4d72-a130-fd197fdbbf8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:15.296140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488e699-4736-4d72-a130-fd197fdbbf8f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:15.325022 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 470/948] 10.222.0.50 () {56 vars in 1112 bytes} [Sat Sep 17 04:22:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:15.345114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaac31-fb39-4a8b-986b-0b5d78efc625 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:15.386026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ff0ac-5818-40b0-a31c-1c4608ad8929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:15.386706 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ff0ac-5818-40b0-a31c-1c4608ad8929 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:15.386987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ff0ac-5818-40b0-a31c-1c4608ad8929 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:15.387322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ff0ac-5818-40b0-a31c-1c4608ad8929 None admin] PATH_INFO: `/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/597874ccdd284d9d88f3e743c4759d95/roles/26cc723263984bd0bf00ea579afa96cb` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:15.389767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ff0ac-5818-40b0-a31c-1c4608ad8929 None admin] RBAC: Authorizing `identity:create_grant(project_id=d50a1cd322404bd4b0fa7a8c388dc217, user_id=597874ccdd284d9d88f3e743c4759d95, role_id=26cc723263984bd0bf00ea579afa96cb)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:15.391260 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ff0ac-5818-40b0-a31c-1c4608ad8929 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:15.464831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 479/949] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:22:15 2022] PUT /identity/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/597874ccdd284d9d88f3e743c4759d95/roles/26cc723263984bd0bf00ea579afa96cb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:22:15.939376 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8e890-d61c-45cf-98be-0e9b02972097 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:15.939905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8e890-d61c-45cf-98be-0e9b02972097 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:15.939905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8e890-d61c-45cf-98be-0e9b02972097 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:15.941409 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 471/950] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:15.946898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8daed-a639-47be-b17a-c827434599ec None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:15.947696 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8daed-a639-47be-b17a-c827434599ec None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:15.948166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8daed-a639-47be-b17a-c827434599ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:15.967663 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-80e8daed-a639-47be-b17a-c827434599ec None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:15.969239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-80e8daed-a639-47be-b17a-c827434599ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:15.980361 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:16.041250 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 480/951] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:16.323525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8e890-d61c-45cf-98be-0e9b02972097 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:16.438895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8e890-d61c-45cf-98be-0e9b02972097 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:16.454050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cbd80-c839-4749-99b2-3e4e62f1131f None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:16.454347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cbd80-c839-4749-99b2-3e4e62f1131f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:16.454640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cbd80-c839-4749-99b2-3e4e62f1131f None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:16.456805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 481/952] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:16.461692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59046eec-707a-4555-905b-69a7d2ad9608 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:16.461968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59046eec-707a-4555-905b-69a7d2ad9608 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:16.462241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59046eec-707a-4555-905b-69a7d2ad9608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:16.472037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:16.480832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-59046eec-707a-4555-905b-69a7d2ad9608 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:16.481577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea2ed8-e3b8-42a3-8c89-2c75e8d2be46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:16.482141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-59046eec-707a-4555-905b-69a7d2ad9608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:16.482674 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea2ed8-e3b8-42a3-8c89-2c75e8d2be46 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:16.483148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea2ed8-e3b8-42a3-8c89-2c75e8d2be46 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:16.483642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea2ed8-e3b8-42a3-8c89-2c75e8d2be46 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:16.484608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea2ed8-e3b8-42a3-8c89-2c75e8d2be46 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:16.487556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea2ed8-e3b8-42a3-8c89-2c75e8d2be46 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e1ea2ed8-e3b8-42a3-8c89-2c75e8d2be46 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:16.499116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:16.500318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:16.501232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:16.501232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:16.501232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:16.501232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:16.501232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:16.501232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:16.501232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:16.501232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:16.501232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:16.501232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:16.501232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:16.501232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:16.501232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:16.501232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:16.508524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 472/953] 10.222.0.50 () {56 vars in 1126 bytes} [Sat Sep 17 04:22:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:16.509443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea2ed8-e3b8-42a3-8c89-2c75e8d2be46 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:16.570247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 482/954] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:16.636471 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea2ed8-e3b8-42a3-8c89-2c75e8d2be46 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:16.671908 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1ffdb-1b39-4e75-b58a-784da1696092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:16.672897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1ffdb-1b39-4e75-b58a-784da1696092 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:16.673881 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1ffdb-1b39-4e75-b58a-784da1696092 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:16.674334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1ffdb-1b39-4e75-b58a-784da1696092 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:16.675130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1ffdb-1b39-4e75-b58a-784da1696092 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:16.675591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1ffdb-1b39-4e75-b58a-784da1696092 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:16.677137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1ffdb-1b39-4e75-b58a-784da1696092 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:16.682524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 473/955] 10.222.0.50 () {56 vars in 1122 bytes} [Sat Sep 17 04:22:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:16.688432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59046eec-707a-4555-905b-69a7d2ad9608 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:16.771073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:16.796115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59046eec-707a-4555-905b-69a7d2ad9608 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:16.832443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99938a-ac0f-4cf0-8533-3d36fed018c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:16.833071 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99938a-ac0f-4cf0-8533-3d36fed018c2 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:16.833348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99938a-ac0f-4cf0-8533-3d36fed018c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:16.833614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99938a-ac0f-4cf0-8533-3d36fed018c2 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:16.834235 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99938a-ac0f-4cf0-8533-3d36fed018c2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:16.834532 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99938a-ac0f-4cf0-8533-3d36fed018c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:16.835893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99938a-ac0f-4cf0-8533-3d36fed018c2 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:16.841174 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 483/956] 10.222.0.50 () {56 vars in 1122 bytes} [Sat Sep 17 04:22:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:16.846859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1ffdb-1b39-4e75-b58a-784da1696092 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:16.863851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99938a-ac0f-4cf0-8533-3d36fed018c2 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:16.910519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:16.966527 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99938a-ac0f-4cf0-8533-3d36fed018c2 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:16.970924 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1ffdb-1b39-4e75-b58a-784da1696092 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:17.004781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f8d1c-5405-4895-aa76-4f9cc4b9c699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:17.006188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f8d1c-5405-4895-aa76-4f9cc4b9c699 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:17.006907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f8d1c-5405-4895-aa76-4f9cc4b9c699 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:17.007622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f8d1c-5405-4895-aa76-4f9cc4b9c699 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:17.008636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f8d1c-5405-4895-aa76-4f9cc4b9c699 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:17.010939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f8d1c-5405-4895-aa76-4f9cc4b9c699 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:17.014016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4673a-9a30-4209-ab42-c1b862336635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:17.014690 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4673a-9a30-4209-ab42-c1b862336635 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:17.015080 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4673a-9a30-4209-ab42-c1b862336635 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:17.015419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4673a-9a30-4209-ab42-c1b862336635 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:17.016152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4673a-9a30-4209-ab42-c1b862336635 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:17.018192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4673a-9a30-4209-ab42-c1b862336635 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-159f8d1c-5405-4895-aa76-4f9cc4b9c699 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:17.022231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:17.023207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:17.024055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:17.024055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:17.024055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:17.024055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:17.024055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:17.024055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:17.024055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:17.024055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:17.024055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:17.024055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:17.024055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:17.024055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:17.024055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 04:22:17.024055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:17.027103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 484/957] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:22:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:17.033464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f8d1c-5405-4895-aa76-4f9cc4b9c699 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:17.037607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:17.118031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 474/958] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:22:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:22:17.153849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f8d1c-5405-4895-aa76-4f9cc4b9c699 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:17.213619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53276c-73f4-47b7-8a72-318efaf5aff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:17.214431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53276c-73f4-47b7-8a72-318efaf5aff7 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:17.214785 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53276c-73f4-47b7-8a72-318efaf5aff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:17.215158 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53276c-73f4-47b7-8a72-318efaf5aff7 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:17.215865 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53276c-73f4-47b7-8a72-318efaf5aff7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:17.216238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53276c-73f4-47b7-8a72-318efaf5aff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:17.217866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53276c-73f4-47b7-8a72-318efaf5aff7 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:17.224329 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 485/959] 10.222.0.50 () {56 vars in 1112 bytes} [Sat Sep 17 04:22:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:17.230123 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4673a-9a30-4209-ab42-c1b862336635 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:17.342797 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4673a-9a30-4209-ab42-c1b862336635 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:17.353236 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:17.379785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967bb89-d9b7-413e-afc7-c8c0166ee7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:17.380395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967bb89-d9b7-413e-afc7-c8c0166ee7ec None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:17.380680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967bb89-d9b7-413e-afc7-c8c0166ee7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:17.380956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967bb89-d9b7-413e-afc7-c8c0166ee7ec None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:17.381633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967bb89-d9b7-413e-afc7-c8c0166ee7ec None admin] RBAC: Adding query filter params (type=compute) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:17.381940 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967bb89-d9b7-413e-afc7-c8c0166ee7ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:17.383579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967bb89-d9b7-413e-afc7-c8c0166ee7ec None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:17.391258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 475/960] 10.222.0.50 () {56 vars in 1112 bytes} [Sat Sep 17 04:22:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:17.651919 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e570fb7-6963-4ec0-b658-a6ba33db07d9 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:17.652275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e570fb7-6963-4ec0-b658-a6ba33db07d9 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:17.652581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e570fb7-6963-4ec0-b658-a6ba33db07d9 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:17.654365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 486/961] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:17.660521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf6997-d2bb-4993-9333-73be5dec8ae5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:17.660834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf6997-d2bb-4993-9333-73be5dec8ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:17.661102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf6997-d2bb-4993-9333-73be5dec8ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:17.681175 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bfbf6997-d2bb-4993-9333-73be5dec8ae5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:17.683055 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bfbf6997-d2bb-4993-9333-73be5dec8ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:17.756680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 476/962] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:17.769014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeabb34-1351-4df4-82e9-ecffa45eb946 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:17.769014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeabb34-1351-4df4-82e9-ecffa45eb946 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:17.769014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeabb34-1351-4df4-82e9-ecffa45eb946 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:17.769014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 487/963] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:17.771065 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ef357-4e11-4743-8fbf-03d133bd4553 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:17.771348 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ef357-4e11-4743-8fbf-03d133bd4553 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:17.771617 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ef357-4e11-4743-8fbf-03d133bd4553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:17.790829 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2a9ef357-4e11-4743-8fbf-03d133bd4553 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:17.792007 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2a9ef357-4e11-4743-8fbf-03d133bd4553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:17.863186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 477/964] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:22:18.032707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeabb34-1351-4df4-82e9-ecffa45eb946 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:18.100705 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:18.144037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ef357-4e11-4743-8fbf-03d133bd4553 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:18.146275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeabb34-1351-4df4-82e9-ecffa45eb946 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:18.179346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:18.191484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d00ebf-98a1-4cbf-b44d-8fad7aece590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:18.192111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d00ebf-98a1-4cbf-b44d-8fad7aece590 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:18.192391 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d00ebf-98a1-4cbf-b44d-8fad7aece590 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:18.192726 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d00ebf-98a1-4cbf-b44d-8fad7aece590 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:18.193417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d00ebf-98a1-4cbf-b44d-8fad7aece590 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:18.195282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d00ebf-98a1-4cbf-b44d-8fad7aece590 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:18.198772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: WARNING keystone.server.flask.common [None req-40d00ebf-98a1-4cbf-b44d-8fad7aece590 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 17 04:22:18.245644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.sql.core [None req-40d00ebf-98a1-4cbf-b44d-8fad7aece590 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 04:22:18.245644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 17 04:22:18.245644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [parameters: {'user_id': '091839bbf88e4334aac2763198cb415a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 17 04:22:18.245644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81614) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-40d00ebf-98a1-4cbf-b44d-8fad7aece590 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application conn.query(q) Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application result.read() Sep 17 04:22:18.255176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 04:22:18.256039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application next(self.gen) Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application yield resource Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application next(self.gen) Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self.session.rollback() Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self.force_reraise() Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise self.value Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application session.commit() Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 17 04:22:18.256954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._prepare_impl() Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self.session.flush() Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._flush(objects) Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application compat.raise_( Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application flush_context.execute() Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rec.execute(self) Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 04:22:18.258145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 04:22:18.259056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application conn.query(q) Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application result.read() Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 04:22:18.259944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [parameters: {'user_id': '091839bbf88e4334aac2763198cb415a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:18.260843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 17 04:22:18.261671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 17 04:22:18.262594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 17 04:22:18.262594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 17 04:22:18.262594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 17 04:22:18.262594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 17 04:22:18.262594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 17 04:22:18.262594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:18.263037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ef357-4e11-4743-8fbf-03d133bd4553 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:18.266112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 488/965] 10.222.0.50 () {60 vars in 1131 bytes} [Sat Sep 17 04:22:18 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:18.276243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d00ebf-98a1-4cbf-b44d-8fad7aece590 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:18.306979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f34e9-4a3a-4ac4-a446-31ae80efea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:18.307710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f34e9-4a3a-4ac4-a446-31ae80efea71 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:18.307995 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f34e9-4a3a-4ac4-a446-31ae80efea71 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:18.308338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f34e9-4a3a-4ac4-a446-31ae80efea71 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:18.324774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f34e9-4a3a-4ac4-a446-31ae80efea71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-a82f34e9-4a3a-4ac4-a446-31ae80efea71 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:22:18.331815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:18.332795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:18.333835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:18.333835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:18.333835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:18.333835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:18.333835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:22:18.333835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:22:18.333835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:22:18.333835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:22:18.333835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:22:18.333835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:22:18.333835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 04:22:18.333835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:18.333835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 478/966] 10.222.0.50 () {56 vars in 1120 bytes} [Sat Sep 17 04:22:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:18.338802 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f34e9-4a3a-4ac4-a446-31ae80efea71 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:18.418465 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d00ebf-98a1-4cbf-b44d-8fad7aece590 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:18.452480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:18.462574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:18.468055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183128f-fc09-4d76-be10-96a451da8214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:18.469095 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183128f-fc09-4d76-be10-96a451da8214 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:18.469810 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183128f-fc09-4d76-be10-96a451da8214 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:18.471170 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183128f-fc09-4d76-be10-96a451da8214 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:18.473219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f34e9-4a3a-4ac4-a446-31ae80efea71 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:18.480741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183128f-fc09-4d76-be10-96a451da8214 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:18.483421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183128f-fc09-4d76-be10-96a451da8214 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-8183128f-fc09-4d76-be10-96a451da8214 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:22:18.498309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:18.499446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:18.500572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:18.500572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:18.500572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:22:18.500572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:22:18.500572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:22:18.500572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:22:18.500572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:22:18.500572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:22:18.500572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 04:22:18.500572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:18.508097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 489/967] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:22:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:18.511460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183128f-fc09-4d76-be10-96a451da8214 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:18.519820 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b67fb-1fd2-45e2-9c9a-2199f5d6ec55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:18.520574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b67fb-1fd2-45e2-9c9a-2199f5d6ec55 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:18.520925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b67fb-1fd2-45e2-9c9a-2199f5d6ec55 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:18.521308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b67fb-1fd2-45e2-9c9a-2199f5d6ec55 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:18.522113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b67fb-1fd2-45e2-9c9a-2199f5d6ec55 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:18.522487 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b67fb-1fd2-45e2-9c9a-2199f5d6ec55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:18.524008 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b67fb-1fd2-45e2-9c9a-2199f5d6ec55 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:18.534171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 479/968] 10.222.0.50 () {56 vars in 1115 bytes} [Sat Sep 17 04:22:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:18.539377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b67fb-1fd2-45e2-9c9a-2199f5d6ec55 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:18.645624 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183128f-fc09-4d76-be10-96a451da8214 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:18.690753 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cddab-ebae-4ddb-8477-2374443b2917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:18.691256 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b67fb-1fd2-45e2-9c9a-2199f5d6ec55 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:18.691856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cddab-ebae-4ddb-8477-2374443b2917 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:18.692304 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cddab-ebae-4ddb-8477-2374443b2917 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:18.693062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cddab-ebae-4ddb-8477-2374443b2917 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:18.694838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cddab-ebae-4ddb-8477-2374443b2917 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:18.695322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cddab-ebae-4ddb-8477-2374443b2917 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:18.696922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cddab-ebae-4ddb-8477-2374443b2917 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:18.732886 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd4638-1f36-4d38-95bd-3c1605b44336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:18.733930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd4638-1f36-4d38-95bd-3c1605b44336 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:18.734396 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd4638-1f36-4d38-95bd-3c1605b44336 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:18.734834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd4638-1f36-4d38-95bd-3c1605b44336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:18.742530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 490/969] 10.222.0.50 () {56 vars in 1101 bytes} [Sat Sep 17 04:22:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:18.748820 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd4638-1f36-4d38-95bd-3c1605b44336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:18.750366 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd4638-1f36-4d38-95bd-3c1605b44336 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8efd4638-1f36-4d38-95bd-3c1605b44336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:18.770046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:18.771079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:18.772613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:18.772613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:18.772613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:18.772613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 480/970] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:18.777088 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cddab-ebae-4ddb-8477-2374443b2917 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:18.830572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:18.900044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cddab-ebae-4ddb-8477-2374443b2917 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:18.940441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a6627-b878-4443-a19b-264fa6addb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:18.941083 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a6627-b878-4443-a19b-264fa6addb2f None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:18.941422 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a6627-b878-4443-a19b-264fa6addb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:18.941703 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a6627-b878-4443-a19b-264fa6addb2f None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:18.942351 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a6627-b878-4443-a19b-264fa6addb2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:18.942656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a6627-b878-4443-a19b-264fa6addb2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:18.944033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a6627-b878-4443-a19b-264fa6addb2f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:18.957851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 491/971] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:18.963013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd4638-1f36-4d38-95bd-3c1605b44336 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:18.973537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:19.070524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd4638-1f36-4d38-95bd-3c1605b44336 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:19.106108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4495995-f4ef-4653-b2b1-55ba7f997c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:19.106740 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4495995-f4ef-4653-b2b1-55ba7f997c67 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:19.107014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4495995-f4ef-4653-b2b1-55ba7f997c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:19.107281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4495995-f4ef-4653-b2b1-55ba7f997c67 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:19.114996 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4495995-f4ef-4653-b2b1-55ba7f997c67 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:19.116440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4495995-f4ef-4653-b2b1-55ba7f997c67 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-b4495995-f4ef-4653-b2b1-55ba7f997c67 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:22:19.127745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:19.128678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:19.129641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:19.129641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:19.129641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:22:19.129641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:22:19.129641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:22:19.129641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:22:19.129641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:22:19.129641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:22:19.129641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 04:22:19.129641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:19.129641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 481/972] 10.222.0.50 () {56 vars in 1117 bytes} [Sat Sep 17 04:22:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:19.138055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a6627-b878-4443-a19b-264fa6addb2f None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:19.243200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a6627-b878-4443-a19b-264fa6addb2f None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:19.244716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:19.278708 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e5596-aea4-4a3b-b045-3388d583b815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:19.279315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e5596-aea4-4a3b-b045-3388d583b815 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:19.279590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e5596-aea4-4a3b-b045-3388d583b815 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:19.279855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e5596-aea4-4a3b-b045-3388d583b815 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:19.280573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e5596-aea4-4a3b-b045-3388d583b815 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:19.280875 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e5596-aea4-4a3b-b045-3388d583b815 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:19.282331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e5596-aea4-4a3b-b045-3388d583b815 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:19.300842 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 492/973] 10.222.0.50 () {56 vars in 1149 bytes} [Sat Sep 17 04:22:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:19.306273 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4495995-f4ef-4653-b2b1-55ba7f997c67 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:19.377463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:19.413126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4495995-f4ef-4653-b2b1-55ba7f997c67 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:19.446749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab78e6-ed2b-4723-9749-fdeb13ddee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:19.447353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab78e6-ed2b-4723-9749-fdeb13ddee68 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:19.447459 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fb445-e4a9-42e7-a229-a73b2a1e9807 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:19.447643 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab78e6-ed2b-4723-9749-fdeb13ddee68 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:19.447750 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fb445-e4a9-42e7-a229-a73b2a1e9807 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:19.447923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab78e6-ed2b-4723-9749-fdeb13ddee68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:19.448018 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fb445-e4a9-42e7-a229-a73b2a1e9807 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:19.449556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 493/974] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:22:19.454239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eb95c-4033-4833-b99e-5cad6e8e9d0e None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:19.455169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eb95c-4033-4833-b99e-5cad6e8e9d0e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:19.455440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eb95c-4033-4833-b99e-5cad6e8e9d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:19.475416 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ad7eb95c-4033-4833-b99e-5cad6e8e9d0e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:19.476955 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ad7eb95c-4033-4833-b99e-5cad6e8e9d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:19.520452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab78e6-ed2b-4723-9749-fdeb13ddee68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:19.521932 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab78e6-ed2b-4723-9749-fdeb13ddee68 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:19.546129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 494/975] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:19.591314 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:19.628085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 482/976] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:22:19 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:22:19.633249 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eb95c-4033-4833-b99e-5cad6e8e9d0e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:19.665248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b86300-1499-4286-b1ac-cce33b0ffbf1 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:19.665620 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b86300-1499-4286-b1ac-cce33b0ffbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:19.665998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b86300-1499-4286-b1ac-cce33b0ffbf1 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:19.667356 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 483/977] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:22:19.672196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982da74-3cd6-4b38-8ef5-fd919790f3aa None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:19.672547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982da74-3cd6-4b38-8ef5-fd919790f3aa None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:19.672828 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982da74-3cd6-4b38-8ef5-fd919790f3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:19.691917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9982da74-3cd6-4b38-8ef5-fd919790f3aa None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:19.693134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9982da74-3cd6-4b38-8ef5-fd919790f3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:19.730169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:19.740522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eb95c-4033-4833-b99e-5cad6e8e9d0e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:19.763651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 484/978] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:19.776697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488b6ec-cdaf-4786-8808-2d7503f35136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:19.777367 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488b6ec-cdaf-4786-8808-2d7503f35136 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:19.777650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488b6ec-cdaf-4786-8808-2d7503f35136 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:19.777922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488b6ec-cdaf-4786-8808-2d7503f35136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:19.789141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488b6ec-cdaf-4786-8808-2d7503f35136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:19.790604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488b6ec-cdaf-4786-8808-2d7503f35136 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-a488b6ec-cdaf-4786-8808-2d7503f35136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:19.805883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:19.806855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:19.808075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:19.808075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:19.808075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:19.808075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 495/979] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:19.812574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982da74-3cd6-4b38-8ef5-fd919790f3aa None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:19.818914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488b6ec-cdaf-4786-8808-2d7503f35136 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:19.914034 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:19.919791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982da74-3cd6-4b38-8ef5-fd919790f3aa None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:19.930496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488b6ec-cdaf-4786-8808-2d7503f35136 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:19.958705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de472fd-f017-41a9-a951-368f60cac36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:19.959308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de472fd-f017-41a9-a951-368f60cac36e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:19.959584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de472fd-f017-41a9-a951-368f60cac36e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:19.959850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de472fd-f017-41a9-a951-368f60cac36e None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:19.960490 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de472fd-f017-41a9-a951-368f60cac36e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:19.960791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de472fd-f017-41a9-a951-368f60cac36e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:19.962196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de472fd-f017-41a9-a951-368f60cac36e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:19.969798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c151f-14cd-4e87-bfcc-617cc101c900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:19.971251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c151f-14cd-4e87-bfcc-617cc101c900 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:19.971989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c151f-14cd-4e87-bfcc-617cc101c900 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:19.972446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c151f-14cd-4e87-bfcc-617cc101c900 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:19.973235 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c151f-14cd-4e87-bfcc-617cc101c900 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:19.973629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 485/980] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:19.974999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c151f-14cd-4e87-bfcc-617cc101c900 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:19.979029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de472fd-f017-41a9-a951-368f60cac36e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-111c151f-14cd-4e87-bfcc-617cc101c900 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:19.986568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:19.987651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:19.988570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:19.988570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:19.988570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:19.988570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:19.988570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:19.988570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:19.988570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:19.988570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:19.988570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:19.988570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:19.988570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:19.988570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:19.988570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:19.988570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:19.990362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 496/981] 10.222.0.50 () {56 vars in 1126 bytes} [Sat Sep 17 04:22:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:19.995832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c151f-14cd-4e87-bfcc-617cc101c900 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:20.007210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:20.082640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de472fd-f017-41a9-a951-368f60cac36e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:20.100924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c151f-14cd-4e87-bfcc-617cc101c900 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:20.116011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea4b86-244b-4270-9423-e2e7c8e45b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:20.116637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea4b86-244b-4270-9423-e2e7c8e45b6c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:20.116918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea4b86-244b-4270-9423-e2e7c8e45b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:20.117219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea4b86-244b-4270-9423-e2e7c8e45b6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:20.123728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea4b86-244b-4270-9423-e2e7c8e45b6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:20.125192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea4b86-244b-4270-9423-e2e7c8e45b6c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:20.134519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a960c-a618-42ea-aa11-024544f1d2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:20.135109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a960c-a618-42ea-aa11-024544f1d2fb None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:20.135385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a960c-a618-42ea-aa11-024544f1d2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:20.135652 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a960c-a618-42ea-aa11-024544f1d2fb None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:20.136264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a960c-a618-42ea-aa11-024544f1d2fb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:20.136567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a960c-a618-42ea-aa11-024544f1d2fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-a0ea4b86-244b-4270-9423-e2e7c8e45b6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:22:20.136655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:20.137653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:20.138670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:22:20.138670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:22:20.138670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:22:20.138670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:22:20.138670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:22:20.138670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:22:20.138670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:20.138670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:20.139094 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a960c-a618-42ea-aa11-024544f1d2fb None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:20.139498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 486/982] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:22:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:20.139498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea4b86-244b-4270-9423-e2e7c8e45b6c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:20.146546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 497/983] 10.222.0.50 () {56 vars in 1122 bytes} [Sat Sep 17 04:22:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:20.147413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a960c-a618-42ea-aa11-024544f1d2fb None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:20.164142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:20.217073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:20.245940 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea4b86-244b-4270-9423-e2e7c8e45b6c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:20.248139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a960c-a618-42ea-aa11-024544f1d2fb None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:20.278782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bf3d4-f001-44da-9775-a80def6024d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:20.279386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bf3d4-f001-44da-9775-a80def6024d5 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:20.279663 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bf3d4-f001-44da-9775-a80def6024d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:20.279932 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bf3d4-f001-44da-9775-a80def6024d5 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:20.280572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bf3d4-f001-44da-9775-a80def6024d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:20.280740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe0408-a04d-4dc0-b921-d0c2182a6be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:20.281366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe0408-a04d-4dc0-b921-d0c2182a6be7 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:20.281639 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe0408-a04d-4dc0-b921-d0c2182a6be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:20.281907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe0408-a04d-4dc0-b921-d0c2182a6be7 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:20.282014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bf3d4-f001-44da-9775-a80def6024d5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:20.283165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe0408-a04d-4dc0-b921-d0c2182a6be7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:20.283460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe0408-a04d-4dc0-b921-d0c2182a6be7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:20.284855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe0408-a04d-4dc0-b921-d0c2182a6be7 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:20.296536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 498/984] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:22:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:20.297347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe0408-a04d-4dc0-b921-d0c2182a6be7 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:20.354392 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 487/985] 10.222.0.50 () {60 vars in 1141 bytes} [Sat Sep 17 04:22:20 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:22:20.355224 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bf3d4-f001-44da-9775-a80def6024d5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:20.405511 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe0408-a04d-4dc0-b921-d0c2182a6be7 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:20.440551 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:20.456049 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:20.457309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28c1b9-934d-486c-8cd2-d4c2df87fd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:20.457940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28c1b9-934d-486c-8cd2-d4c2df87fd8a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:20.458220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28c1b9-934d-486c-8cd2-d4c2df87fd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:20.458501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28c1b9-934d-486c-8cd2-d4c2df87fd8a None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:20.459141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28c1b9-934d-486c-8cd2-d4c2df87fd8a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:20.459446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28c1b9-934d-486c-8cd2-d4c2df87fd8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:20.460883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28c1b9-934d-486c-8cd2-d4c2df87fd8a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:20.466341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 499/986] 10.222.0.50 () {56 vars in 1122 bytes} [Sat Sep 17 04:22:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:20.473148 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28c1b9-934d-486c-8cd2-d4c2df87fd8a None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:20.488675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bf3d4-f001-44da-9775-a80def6024d5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:20.528011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f8b27-1a02-41cb-84d4-a3a387f23f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:20.528627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8b27-1a02-41cb-84d4-a3a387f23f9f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:20.528911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8b27-1a02-41cb-84d4-a3a387f23f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:20.529211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8b27-1a02-41cb-84d4-a3a387f23f9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:20.529981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f8b27-1a02-41cb-84d4-a3a387f23f9f None admin] RBAC: Adding query filter params (role.id=26cc723263984bd0bf00ea579afa96cb, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=597874ccdd284d9d88f3e743c4759d95) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:20.530300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f8b27-1a02-41cb-84d4-a3a387f23f9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:20.531969 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f8b27-1a02-41cb-84d4-a3a387f23f9f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:20.541252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 488/987] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:22:20 2022] GET /identity/v3/role_assignments?user.id=597874ccdd284d9d88f3e743c4759d95&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=26cc723263984bd0bf00ea579afa96cb => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:20.589863 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28c1b9-934d-486c-8cd2-d4c2df87fd8a None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:20.629655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48a54a-dd5c-4c65-9155-7d348eb37bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:20.630269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48a54a-dd5c-4c65-9155-7d348eb37bae None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:20.630542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48a54a-dd5c-4c65-9155-7d348eb37bae None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:20.630810 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48a54a-dd5c-4c65-9155-7d348eb37bae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:20.631523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48a54a-dd5c-4c65-9155-7d348eb37bae None admin] RBAC: Adding query filter params (interface=admin, service_id=e20f70ea6c8f48f68e7f26a2336fe067, region_id=RegionOne) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:20.631835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48a54a-dd5c-4c65-9155-7d348eb37bae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:20.633490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48a54a-dd5c-4c65-9155-7d348eb37bae None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:20.639592 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 500/988] 10.222.0.50 () {56 vars in 1249 bytes} [Sat Sep 17 04:22:20 2022] GET /identity/v3/endpoints?service_id=e20f70ea6c8f48f68e7f26a2336fe067&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:20.646129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f8b27-1a02-41cb-84d4-a3a387f23f9f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:20.762453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f8b27-1a02-41cb-84d4-a3a387f23f9f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:20.797523 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff938a-8862-4736-aba4-530f724d29e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:20.798734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff938a-8862-4736-aba4-530f724d29e2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:20.799073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff938a-8862-4736-aba4-530f724d29e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:20.799405 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff938a-8862-4736-aba4-530f724d29e2 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:20.800068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff938a-8862-4736-aba4-530f724d29e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:20.801525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff938a-8862-4736-aba4-530f724d29e2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:20.813240 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 489/989] 10.222.0.50 () {56 vars in 1087 bytes} [Sat Sep 17 04:22:20 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:22:22.572537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6befd-2217-4601-81d9-820bb3316ade None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:22.573267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6befd-2217-4601-81d9-820bb3316ade None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:22.573267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6befd-2217-4601-81d9-820bb3316ade None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:22.574613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 501/990] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:22.580209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e92fb8-7813-494c-a39f-9db1a8f1532e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:22.580624 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e92fb8-7813-494c-a39f-9db1a8f1532e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:22.580788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e92fb8-7813-494c-a39f-9db1a8f1532e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:22.587960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:22.599340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-10e92fb8-7813-494c-a39f-9db1a8f1532e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:22.600763 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-10e92fb8-7813-494c-a39f-9db1a8f1532e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:22.673755 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 490/991] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:22.753825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003c535-c159-479c-a732-f815d6f71710 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:22.754135 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003c535-c159-479c-a732-f815d6f71710 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:22.754375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003c535-c159-479c-a732-f815d6f71710 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:22.755837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 502/992] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:22.761178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ac322-af26-4bba-8521-7323c6650cf5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:22.761460 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ac322-af26-4bba-8521-7323c6650cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:22.761732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ac322-af26-4bba-8521-7323c6650cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:22.781227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-118ac322-af26-4bba-8521-7323c6650cf5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:22.782435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-118ac322-af26-4bba-8521-7323c6650cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:22.848600 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 491/993] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:22.944326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003c535-c159-479c-a732-f815d6f71710 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:22.971096 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a07c9-b922-4213-98ac-455e2a05198d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:22.971395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a07c9-b922-4213-98ac-455e2a05198d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:22.971761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a07c9-b922-4213-98ac-455e2a05198d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:22.973284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 492/994] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:22:22.978089 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7569f-204a-4524-9bce-3caf387e724b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:22.978372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7569f-204a-4524-9bce-3caf387e724b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:22.978644 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7569f-204a-4524-9bce-3caf387e724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:22.997436 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b9a7569f-204a-4524-9bce-3caf387e724b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:22.998511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b9a7569f-204a-4524-9bce-3caf387e724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:23.004103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:23.054959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003c535-c159-479c-a732-f815d6f71710 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:23.061514 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:23.069737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 493/995] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:22:23.093011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e4438-15dd-4257-ae49-9f3e3a0e9be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:23.093666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4438-15dd-4257-ae49-9f3e3a0e9be5 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:23.093941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4438-15dd-4257-ae49-9f3e3a0e9be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:23.094210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4438-15dd-4257-ae49-9f3e3a0e9be5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:23.095324 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e4438-15dd-4257-ae49-9f3e3a0e9be5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:23.096918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e4438-15dd-4257-ae49-9f3e3a0e9be5 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-5a9e4438-15dd-4257-ae49-9f3e3a0e9be5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:23.105945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:23.106907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:23.107729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:23.107729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:23.107729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:23.107729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:23.107729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:23.107729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:23.107729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:23.107729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:23.107729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:23.107729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:23.107729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:23.107729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:23.107729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 04:22:23.107729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:23.109062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 503/996] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:22:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:23.113471 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7569f-204a-4524-9bce-3caf387e724b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:23.122550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e4438-15dd-4257-ae49-9f3e3a0e9be5 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:23.225246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7569f-204a-4524-9bce-3caf387e724b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:23.233961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e4438-15dd-4257-ae49-9f3e3a0e9be5 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:23.252668 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:23.261550 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23338980-fbd8-432b-b3f3-fa490add30bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:23.262156 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23338980-fbd8-432b-b3f3-fa490add30bd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:23.262434 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23338980-fbd8-432b-b3f3-fa490add30bd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:23.262704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23338980-fbd8-432b-b3f3-fa490add30bd None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:23.263333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23338980-fbd8-432b-b3f3-fa490add30bd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:23.263617 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23338980-fbd8-432b-b3f3-fa490add30bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:23.265013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23338980-fbd8-432b-b3f3-fa490add30bd None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:23.270884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 494/997] 10.222.0.50 () {56 vars in 1112 bytes} [Sat Sep 17 04:22:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:23.271275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5aef6-216a-43ff-b519-2fa6eeaf2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:23.271902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5aef6-216a-43ff-b519-2fa6eeaf2da6 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:23.272182 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5aef6-216a-43ff-b519-2fa6eeaf2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:23.272574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5aef6-216a-43ff-b519-2fa6eeaf2da6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:23.273259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5aef6-216a-43ff-b519-2fa6eeaf2da6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:23.274612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5aef6-216a-43ff-b519-2fa6eeaf2da6 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:23.276282 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23338980-fbd8-432b-b3f3-fa490add30bd None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-a4b5aef6-216a-43ff-b519-2fa6eeaf2da6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:23.284258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:23.285313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:23.286138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 504/998] 10.222.0.50 () {56 vars in 1105 bytes} [Sat Sep 17 04:22:23 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:23.291115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5aef6-216a-43ff-b519-2fa6eeaf2da6 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:23.339099 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:23.382761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23338980-fbd8-432b-b3f3-fa490add30bd None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:23.393397 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5aef6-216a-43ff-b519-2fa6eeaf2da6 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:23.416598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae11125-200b-44cf-b233-cb7544c0dd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:23.421464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae11125-200b-44cf-b233-cb7544c0dd94 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:23.421464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae11125-200b-44cf-b233-cb7544c0dd94 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:23.421464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae11125-200b-44cf-b233-cb7544c0dd94 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:23.421464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae11125-200b-44cf-b233-cb7544c0dd94 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:23.421464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae11125-200b-44cf-b233-cb7544c0dd94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:23.421464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae11125-200b-44cf-b233-cb7544c0dd94 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:23.425669 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 495/999] 10.222.0.50 () {56 vars in 1112 bytes} [Sat Sep 17 04:22:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:23.426536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae11125-200b-44cf-b233-cb7544c0dd94 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:23.431859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e83205-3b52-4a5f-a142-0f7141d95c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:23.432468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e83205-3b52-4a5f-a142-0f7141d95c00 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:23.432810 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e83205-3b52-4a5f-a142-0f7141d95c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:23.433162 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e83205-3b52-4a5f-a142-0f7141d95c00 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:23.433798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e83205-3b52-4a5f-a142-0f7141d95c00 None admin] RBAC: Adding query filter params (name=image) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:23.434131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e83205-3b52-4a5f-a142-0f7141d95c00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:23.435534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e83205-3b52-4a5f-a142-0f7141d95c00 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:23.441375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 505/1000] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:23.442162 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e83205-3b52-4a5f-a142-0f7141d95c00 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:23.489028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:23.528959 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae11125-200b-44cf-b233-cb7544c0dd94 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:23.542281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e83205-3b52-4a5f-a142-0f7141d95c00 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:23.552246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:23.564562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9211fc5-b4dc-480a-a3fa-ebb84651d63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:23.565181 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211fc5-b4dc-480a-a3fa-ebb84651d63c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:23.565450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211fc5-b4dc-480a-a3fa-ebb84651d63c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:23.565715 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211fc5-b4dc-480a-a3fa-ebb84651d63c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:23.566295 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9211fc5-b4dc-480a-a3fa-ebb84651d63c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:23.567652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9211fc5-b4dc-480a-a3fa-ebb84651d63c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:23.575814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc2dd1-1e5c-4c54-8ac0-1a89d8bf4787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-d9211fc5-b4dc-480a-a3fa-ebb84651d63c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:23.576276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:23.577475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:23.578321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:23.578321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:23.578321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:23.578321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:23.578321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:23.578321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:23.578321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:23.578321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:23.578321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:23.578321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:23.578321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:23.578321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:23.578321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 04:22:23.578321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:23.579152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc2dd1-1e5c-4c54-8ac0-1a89d8bf4787 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:23.579152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc2dd1-1e5c-4c54-8ac0-1a89d8bf4787 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:23.579152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc2dd1-1e5c-4c54-8ac0-1a89d8bf4787 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:23.579535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 496/1001] 10.222.0.50 () {56 vars in 1126 bytes} [Sat Sep 17 04:22:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:23.579649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc2dd1-1e5c-4c54-8ac0-1a89d8bf4787 None admin] RBAC: Adding query filter params (interface=public, service_id=fd39a40cf016496197711a456bbb12e6, region_id=RegionOne) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:23.579649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc2dd1-1e5c-4c54-8ac0-1a89d8bf4787 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:23.579780 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9211fc5-b4dc-480a-a3fa-ebb84651d63c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:23.579847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc2dd1-1e5c-4c54-8ac0-1a89d8bf4787 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:23.585595 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 506/1002] 10.222.0.50 () {56 vars in 1251 bytes} [Sat Sep 17 04:22:23 2022] GET /identity/v3/endpoints?service_id=fd39a40cf016496197711a456bbb12e6&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:23.586373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc2dd1-1e5c-4c54-8ac0-1a89d8bf4787 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:23.679255 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9211fc5-b4dc-480a-a3fa-ebb84651d63c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:23.682040 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc2dd1-1e5c-4c54-8ac0-1a89d8bf4787 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:23.692911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:23.714791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d94443-d525-4bbc-97ca-bb33b8b9e0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:23.715189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0b360-5319-455c-8399-53a38826b2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:23.715390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94443-d525-4bbc-97ca-bb33b8b9e0ce None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:23.715667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94443-d525-4bbc-97ca-bb33b8b9e0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:23.715780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0b360-5319-455c-8399-53a38826b2ae None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:23.715934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94443-d525-4bbc-97ca-bb33b8b9e0ce None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:23.716052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0b360-5319-455c-8399-53a38826b2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:23.716318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0b360-5319-455c-8399-53a38826b2ae None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:23.716551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d94443-d525-4bbc-97ca-bb33b8b9e0ce None admin] RBAC: Adding query filter params (type=image) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:23.716866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d94443-d525-4bbc-97ca-bb33b8b9e0ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:23.716968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0b360-5319-455c-8399-53a38826b2ae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:23.717246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0b360-5319-455c-8399-53a38826b2ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:23.718243 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d94443-d525-4bbc-97ca-bb33b8b9e0ce None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:23.718742 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0b360-5319-455c-8399-53a38826b2ae None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:23.722885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 497/1003] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:23.727993 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 507/1004] 10.222.0.50 () {56 vars in 1122 bytes} [Sat Sep 17 04:22:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:23.728191 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d94443-d525-4bbc-97ca-bb33b8b9e0ce None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:23.729603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0b360-5319-455c-8399-53a38826b2ae None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:23.790775 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:23.850295 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d94443-d525-4bbc-97ca-bb33b8b9e0ce None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:23.850518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0b360-5319-455c-8399-53a38826b2ae None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:23.890585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e787a-568d-466f-a29f-58a28eae67ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:23.891203 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e787a-568d-466f-a29f-58a28eae67ba None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:23.891496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e787a-568d-466f-a29f-58a28eae67ba None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:23.892560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e787a-568d-466f-a29f-58a28eae67ba None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:23.893162 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2847cd-61fd-4261-aab2-9d6741a37af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:23.893312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e787a-568d-466f-a29f-58a28eae67ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:23.894082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2847cd-61fd-4261-aab2-9d6741a37af1 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:23.894543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2847cd-61fd-4261-aab2-9d6741a37af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:23.894656 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e787a-568d-466f-a29f-58a28eae67ba None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:23.895064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2847cd-61fd-4261-aab2-9d6741a37af1 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:23.895898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2847cd-61fd-4261-aab2-9d6741a37af1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:23.896197 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2847cd-61fd-4261-aab2-9d6741a37af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:23.897580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2847cd-61fd-4261-aab2-9d6741a37af1 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:23.903602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 498/1006] 10.222.0.50 () {56 vars in 1087 bytes} [Sat Sep 17 04:22:23 2022] GET /identity/v3/services => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:22:23.903746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 508/1006] 10.222.0.50 () {56 vars in 1122 bytes} [Sat Sep 17 04:22:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:23.910245 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e787a-568d-466f-a29f-58a28eae67ba None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:24.024371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e787a-568d-466f-a29f-58a28eae67ba None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:24.039480 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:24.061442 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b88128-5b6a-43b4-9d87-862e2db03d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:24.062071 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b88128-5b6a-43b4-9d87-862e2db03d20 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:24.062351 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b88128-5b6a-43b4-9d87-862e2db03d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:24.062626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b88128-5b6a-43b4-9d87-862e2db03d20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:24.063324 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b88128-5b6a-43b4-9d87-862e2db03d20 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:24.065520 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b88128-5b6a-43b4-9d87-862e2db03d20 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:24.149870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 499/1007] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:22:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:22:25.931347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ce808-abb8-4e59-ad68-843cd341d982 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:25.931942 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ce808-abb8-4e59-ad68-843cd341d982 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:25.932264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ce808-abb8-4e59-ad68-843cd341d982 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:25.937037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 509/1008] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:25.941019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ca478-be92-41f3-b152-f825ea7f6485 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:25.941470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ca478-be92-41f3-b152-f825ea7f6485 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:25.941564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ca478-be92-41f3-b152-f825ea7f6485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:25.960260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ae5ca478-be92-41f3-b152-f825ea7f6485 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:25.961494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ae5ca478-be92-41f3-b152-f825ea7f6485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:26.040322 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 500/1009] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:26.106137 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4667ca-61c9-42f9-8d53-5dd48303d8a9 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:26.106477 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4667ca-61c9-42f9-8d53-5dd48303d8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:26.106690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4667ca-61c9-42f9-8d53-5dd48303d8a9 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:26.108173 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 510/1010] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:26.113803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0f244-93c7-4a83-b534-772063ce588e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:26.114094 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0f244-93c7-4a83-b534-772063ce588e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:26.114367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0f244-93c7-4a83-b534-772063ce588e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:26.132679 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e5e0f244-93c7-4a83-b534-772063ce588e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:26.133880 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e5e0f244-93c7-4a83-b534-772063ce588e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:26.208676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 501/1011] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:26.312371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4667ca-61c9-42f9-8d53-5dd48303d8a9 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:26.335654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5c8c8-4d7f-4777-800a-0cb1594b8a88 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:26.335956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5c8c8-4d7f-4777-800a-0cb1594b8a88 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:26.336237 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5c8c8-4d7f-4777-800a-0cb1594b8a88 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:26.337642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 502/1012] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:26.351076 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fab265-d90a-47b6-b3b1-e286b3dc43b5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:26.351076 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fab265-d90a-47b6-b3b1-e286b3dc43b5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:26.351076 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fab265-d90a-47b6-b3b1-e286b3dc43b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:26.356098 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:26.362048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-43fab265-d90a-47b6-b3b1-e286b3dc43b5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:26.363246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-43fab265-d90a-47b6-b3b1-e286b3dc43b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:26.389646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:26.420384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4667ca-61c9-42f9-8d53-5dd48303d8a9 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:26.449096 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 503/1013] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:22:26.456569 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0d734-0335-45c9-86ff-283f1f7eae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:26.457211 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0d734-0335-45c9-86ff-283f1f7eae52 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:26.457490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0d734-0335-45c9-86ff-283f1f7eae52 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:26.457759 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0d734-0335-45c9-86ff-283f1f7eae52 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:26.458428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0d734-0335-45c9-86ff-283f1f7eae52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:26.459844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0d734-0335-45c9-86ff-283f1f7eae52 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:26.489549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fab265-d90a-47b6-b3b1-e286b3dc43b5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:26.543015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 511/1014] 10.222.0.50 () {60 vars in 1141 bytes} [Sat Sep 17 04:22:26 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:22:26.604769 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fab265-d90a-47b6-b3b1-e286b3dc43b5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:26.651612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91784b3-73ca-4ccc-bf80-92be3e33893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:26.652537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91784b3-73ca-4ccc-bf80-92be3e33893b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:26.653014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91784b3-73ca-4ccc-bf80-92be3e33893b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:26.653445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91784b3-73ca-4ccc-bf80-92be3e33893b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:26.654180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91784b3-73ca-4ccc-bf80-92be3e33893b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:26.655831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91784b3-73ca-4ccc-bf80-92be3e33893b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-a91784b3-73ca-4ccc-bf80-92be3e33893b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:26.666176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:26.667552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:26.668673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:26.668673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:26.668673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:26.668673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:26.668673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:26.668673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:26.668673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:26.668673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:26.668673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:26.668673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:26.668673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:26.668673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:26.668673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 04:22:26.668673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:26.671102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 504/1015] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:22:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:26.677830 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0d734-0335-45c9-86ff-283f1f7eae52 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:26.726541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91784b3-73ca-4ccc-bf80-92be3e33893b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:26.756164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:26.803360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:26.808974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0d734-0335-45c9-86ff-283f1f7eae52 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:26.850416 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4f184-2f5a-4bd9-8753-f373b836a887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:26.851031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4f184-2f5a-4bd9-8753-f373b836a887 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:26.851308 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4f184-2f5a-4bd9-8753-f373b836a887 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:26.851673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4f184-2f5a-4bd9-8753-f373b836a887 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:26.852213 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4f184-2f5a-4bd9-8753-f373b836a887 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:26.852513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4f184-2f5a-4bd9-8753-f373b836a887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:26.854052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4f184-2f5a-4bd9-8753-f373b836a887 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:26.860837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 512/1016] 10.222.0.50 () {56 vars in 1112 bytes} [Sat Sep 17 04:22:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:26.866290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4f184-2f5a-4bd9-8753-f373b836a887 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:26.871851 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91784b3-73ca-4ccc-bf80-92be3e33893b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:26.908372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f305c7-9382-42d0-88f1-b47a2ea17f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:26.909041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f305c7-9382-42d0-88f1-b47a2ea17f4f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:26.909311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f305c7-9382-42d0-88f1-b47a2ea17f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:26.909578 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f305c7-9382-42d0-88f1-b47a2ea17f4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:26.910710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f305c7-9382-42d0-88f1-b47a2ea17f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:26.912237 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f305c7-9382-42d0-88f1-b47a2ea17f4f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:26.913861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 505/1017] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:26.919461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f305c7-9382-42d0-88f1-b47a2ea17f4f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:27.000358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4f184-2f5a-4bd9-8753-f373b836a887 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:27.022022 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:27.037165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f305c7-9382-42d0-88f1-b47a2ea17f4f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:27.039520 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bd312-8539-48c3-b61d-5e256c2bc285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:27.040134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bd312-8539-48c3-b61d-5e256c2bc285 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:27.040413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bd312-8539-48c3-b61d-5e256c2bc285 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:27.040684 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bd312-8539-48c3-b61d-5e256c2bc285 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:27.041352 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bd312-8539-48c3-b61d-5e256c2bc285 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:27.041658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bd312-8539-48c3-b61d-5e256c2bc285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:27.043593 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bd312-8539-48c3-b61d-5e256c2bc285 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:27.049513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 513/1018] 10.222.0.50 () {56 vars in 1112 bytes} [Sat Sep 17 04:22:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:27.055244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bd312-8539-48c3-b61d-5e256c2bc285 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:27.085861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93924203-53c8-403f-bba5-472653c75381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:27.086478 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93924203-53c8-403f-bba5-472653c75381 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:27.086754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93924203-53c8-403f-bba5-472653c75381 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:27.087026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93924203-53c8-403f-bba5-472653c75381 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:27.087868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:27.088931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93924203-53c8-403f-bba5-472653c75381 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:27.091851 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93924203-53c8-403f-bba5-472653c75381 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:27.180085 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bd312-8539-48c3-b61d-5e256c2bc285 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:27.209020 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 506/1019] 10.222.0.50 () {60 vars in 1141 bytes} [Sat Sep 17 04:22:26 2022] POST /identity/v3/projects => generated 311 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:22:27.227193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d9260-a6b6-4c9e-b612-25abcf2f1d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:27.227843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d9260-a6b6-4c9e-b612-25abcf2f1d95 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:27.228119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d9260-a6b6-4c9e-b612-25abcf2f1d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:27.228446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d9260-a6b6-4c9e-b612-25abcf2f1d95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:27.229115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d9260-a6b6-4c9e-b612-25abcf2f1d95 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:27.230546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d9260-a6b6-4c9e-b612-25abcf2f1d95 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:27.319617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 514/1020] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:22:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:22:28.866775 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed87ef-5692-4905-95af-a68219eb8a95 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:28.867324 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed87ef-5692-4905-95af-a68219eb8a95 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:28.867324 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed87ef-5692-4905-95af-a68219eb8a95 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:28.869032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 507/1021] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:28.873856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdacd3-0278-4bc0-8741-ec54e5d3e7f3 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:28.874270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdacd3-0278-4bc0-8741-ec54e5d3e7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:28.874450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdacd3-0278-4bc0-8741-ec54e5d3e7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:28.893623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-02bdacd3-0278-4bc0-8741-ec54e5d3e7f3 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:28.895061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-02bdacd3-0278-4bc0-8741-ec54e5d3e7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:28.969059 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 515/1022] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:29.234054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed87ef-5692-4905-95af-a68219eb8a95 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:29.342200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed87ef-5692-4905-95af-a68219eb8a95 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:29.376500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bab15-afb4-41af-bca4-aac1b309e71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:29.377152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bab15-afb4-41af-bca4-aac1b309e71e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:29.377423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bab15-afb4-41af-bca4-aac1b309e71e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:29.377690 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bab15-afb4-41af-bca4-aac1b309e71e None admin] PATH_INFO: `/v3/services/image` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:29.378262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bab15-afb4-41af-bca4-aac1b309e71e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:29.379613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bab15-afb4-41af-bca4-aac1b309e71e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3e0bab15-afb4-41af-bca4-aac1b309e71e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:29.388509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:29.389628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:29.390483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:29.390483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:29.390483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:29.390483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:29.390483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:29.390483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:29.390483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:29.390483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:29.390483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:29.390483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:29.390483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:29.390483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:29.390483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 04:22:29.390483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:29.393154 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 508/1023] 10.222.0.50 () {56 vars in 1105 bytes} [Sat Sep 17 04:22:29 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:29.396278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdacd3-0278-4bc0-8741-ec54e5d3e7f3 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:29.407565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:29.434052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411119d-6259-4c7c-abb5-9718c1f549b8 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:29.434247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411119d-6259-4c7c-abb5-9718c1f549b8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:29.434499 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411119d-6259-4c7c-abb5-9718c1f549b8 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:29.435968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 509/1024] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:22:29.441703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99b1b-4d50-4a0d-99bf-725eae48aba5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:29.441984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99b1b-4d50-4a0d-99bf-725eae48aba5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:29.442252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99b1b-4d50-4a0d-99bf-725eae48aba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:29.450292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:29.462455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-41c99b1b-4d50-4a0d-99bf-725eae48aba5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:29.463735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-41c99b1b-4d50-4a0d-99bf-725eae48aba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:29.512904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdacd3-0278-4bc0-8741-ec54e5d3e7f3 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:29.542644 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 510/1025] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:22:29.555671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299a068-5bb9-4261-a6f2-4cf9a6524ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:29.556282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299a068-5bb9-4261-a6f2-4cf9a6524ebd None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:29.556567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299a068-5bb9-4261-a6f2-4cf9a6524ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:29.556941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299a068-5bb9-4261-a6f2-4cf9a6524ebd None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:29.557609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299a068-5bb9-4261-a6f2-4cf9a6524ebd None admin] RBAC: Adding query filter params (name=image) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:29.557917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299a068-5bb9-4261-a6f2-4cf9a6524ebd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:29.559290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299a068-5bb9-4261-a6f2-4cf9a6524ebd None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:29.571102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c99b1b-4d50-4a0d-99bf-725eae48aba5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:29.571411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 516/1026] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:29.611931 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071dab-c6d7-4248-b3bf-afe7dffdbc50 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:29.612267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071dab-c6d7-4248-b3bf-afe7dffdbc50 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:29.612475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071dab-c6d7-4248-b3bf-afe7dffdbc50 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:29.613976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 517/1027] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:29.618768 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de222e-2c1b-4326-a871-0991927ef7e6 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:29.619045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de222e-2c1b-4326-a871-0991927ef7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:29.619391 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de222e-2c1b-4326-a871-0991927ef7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:29.637655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-35de222e-2c1b-4326-a871-0991927ef7e6 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:29.642658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-35de222e-2c1b-4326-a871-0991927ef7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:29.683601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c99b1b-4d50-4a0d-99bf-725eae48aba5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:29.711806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 518/1028] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:22:29.721183 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e553417-9774-4f8b-bf34-29c67e6503b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:29.722091 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e553417-9774-4f8b-bf34-29c67e6503b7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:29.722628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e553417-9774-4f8b-bf34-29c67e6503b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:29.723104 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e553417-9774-4f8b-bf34-29c67e6503b7 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:29.724081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e553417-9774-4f8b-bf34-29c67e6503b7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:29.724604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e553417-9774-4f8b-bf34-29c67e6503b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:29.726236 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e553417-9774-4f8b-bf34-29c67e6503b7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:29.727863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:29.732264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 511/1029] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:29.738980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de222e-2c1b-4326-a871-0991927ef7e6 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:29.741638 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:29.820586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e553417-9774-4f8b-bf34-29c67e6503b7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:29.846379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de222e-2c1b-4326-a871-0991927ef7e6 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:29.883749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91df90b-8a06-4c9b-80d4-87d7ee0d7873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:29.884399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91df90b-8a06-4c9b-80d4-87d7ee0d7873 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:29.884674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91df90b-8a06-4c9b-80d4-87d7ee0d7873 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:29.884892 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91df90b-8a06-4c9b-80d4-87d7ee0d7873 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:29.885624 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91df90b-8a06-4c9b-80d4-87d7ee0d7873 None admin] RBAC: Adding query filter params (interface=public, service_id=e29ef2307e8a4add84e858c815611e16, region_id=RegionOne) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:29.885931 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91df90b-8a06-4c9b-80d4-87d7ee0d7873 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:29.887295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91df90b-8a06-4c9b-80d4-87d7ee0d7873 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:29.897137 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 519/1030] 10.222.0.50 () {56 vars in 1251 bytes} [Sat Sep 17 04:22:29 2022] GET /identity/v3/endpoints?service_id=e29ef2307e8a4add84e858c815611e16&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:29.898073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91df90b-8a06-4c9b-80d4-87d7ee0d7873 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:29.931741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e553417-9774-4f8b-bf34-29c67e6503b7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:29.966642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a93e3-529d-4715-8b99-032de5708c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:29.966837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:29.967194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a93e3-529d-4715-8b99-032de5708c64 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:29.967478 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a93e3-529d-4715-8b99-032de5708c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:29.967747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a93e3-529d-4715-8b99-032de5708c64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:29.970117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a93e3-529d-4715-8b99-032de5708c64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:29.971763 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a93e3-529d-4715-8b99-032de5708c64 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:29.976959 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 512/1031] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:29.979037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a93e3-529d-4715-8b99-032de5708c64 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:30.002770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91df90b-8a06-4c9b-80d4-87d7ee0d7873 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:30.036192 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c58a6-3260-4249-9b30-c913a644938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:30.036789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c58a6-3260-4249-9b30-c913a644938b None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:30.037094 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c58a6-3260-4249-9b30-c913a644938b None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:30.037365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c58a6-3260-4249-9b30-c913a644938b None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:30.037962 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c58a6-3260-4249-9b30-c913a644938b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:30.039321 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c58a6-3260-4249-9b30-c913a644938b None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:30.043463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:30.045862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 520/1032] 10.222.0.50 () {56 vars in 1087 bytes} [Sat Sep 17 04:22:29 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:22:30.046636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c58a6-3260-4249-9b30-c913a644938b None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:30.090634 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a93e3-529d-4715-8b99-032de5708c64 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:30.131710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190118d9-27f5-4b4f-81f0-891b11234a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:30.132331 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190118d9-27f5-4b4f-81f0-891b11234a3c None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:30.132608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190118d9-27f5-4b4f-81f0-891b11234a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:30.132884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190118d9-27f5-4b4f-81f0-891b11234a3c None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:30.133578 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190118d9-27f5-4b4f-81f0-891b11234a3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:30.135041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190118d9-27f5-4b4f-81f0-891b11234a3c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:30.165089 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c58a6-3260-4249-9b30-c913a644938b None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:30.196825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:30.202542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776299b-2eb0-4456-a186-72935cf8c890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:30.203334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776299b-2eb0-4456-a186-72935cf8c890 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:30.204134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776299b-2eb0-4456-a186-72935cf8c890 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:30.204403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776299b-2eb0-4456-a186-72935cf8c890 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:30.215540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776299b-2eb0-4456-a186-72935cf8c890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-3776299b-2eb0-4456-a186-72935cf8c890 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:22:30.221337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:30.222383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:30.223241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:30.223241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:30.223241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:30.223241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:30.223241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:22:30.223241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:22:30.223241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:22:30.223241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:22:30.223241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:22:30.223241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:22:30.223241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 04:22:30.223241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:30.223915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 521/1033] 10.222.0.50 () {56 vars in 1120 bytes} [Sat Sep 17 04:22:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:30.229158 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776299b-2eb0-4456-a186-72935cf8c890 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:30.248010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 513/1034] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:22:29 2022] POST /identity/v3/users => generated 285 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:22:30.344097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776299b-2eb0-4456-a186-72935cf8c890 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:30.382405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b4a52-e28c-48cd-9878-aab322a8801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:30.383015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b4a52-e28c-48cd-9878-aab322a8801c None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:30.383295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b4a52-e28c-48cd-9878-aab322a8801c None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:30.383552 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b4a52-e28c-48cd-9878-aab322a8801c None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:30.384290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b4a52-e28c-48cd-9878-aab322a8801c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:30.384593 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b4a52-e28c-48cd-9878-aab322a8801c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:30.386012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b4a52-e28c-48cd-9878-aab322a8801c None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:30.396235 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 522/1035] 10.222.0.50 () {56 vars in 1115 bytes} [Sat Sep 17 04:22:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:30.402519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190118d9-27f5-4b4f-81f0-891b11234a3c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:30.512496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190118d9-27f5-4b4f-81f0-891b11234a3c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:30.539545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:30.550997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae637f7-9f27-4be8-b037-aca0c01d2bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:30.551711 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae637f7-9f27-4be8-b037-aca0c01d2bfc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:30.551990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae637f7-9f27-4be8-b037-aca0c01d2bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:30.552257 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae637f7-9f27-4be8-b037-aca0c01d2bfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:30.562742 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae637f7-9f27-4be8-b037-aca0c01d2bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:30.564907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae637f7-9f27-4be8-b037-aca0c01d2bfc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1ae637f7-9f27-4be8-b037-aca0c01d2bfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:30.580653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:30.586401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:30.587351 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:30.587351 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:30.587351 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:30.587351 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 514/1036] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:30.589032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b4a52-e28c-48cd-9878-aab322a8801c None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:30.642071 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:30.689812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b4a52-e28c-48cd-9878-aab322a8801c None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:30.722856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2804ab-bb71-4928-9133-5e9bc1f24121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:30.723453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2804ab-bb71-4928-9133-5e9bc1f24121 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:30.723724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2804ab-bb71-4928-9133-5e9bc1f24121 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:30.723989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2804ab-bb71-4928-9133-5e9bc1f24121 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:30.724615 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2804ab-bb71-4928-9133-5e9bc1f24121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:30.724913 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2804ab-bb71-4928-9133-5e9bc1f24121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:30.726286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2804ab-bb71-4928-9133-5e9bc1f24121 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:30.738065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 523/1037] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:30.743592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae637f7-9f27-4be8-b037-aca0c01d2bfc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:30.847131 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae637f7-9f27-4be8-b037-aca0c01d2bfc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:30.881065 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f784f-fa53-4693-8cfd-0353ea81b178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:30.881947 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f784f-fa53-4693-8cfd-0353ea81b178 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:30.882219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f784f-fa53-4693-8cfd-0353ea81b178 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:30.882486 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f784f-fa53-4693-8cfd-0353ea81b178 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:30.890107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f784f-fa53-4693-8cfd-0353ea81b178 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:30.892291 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f784f-fa53-4693-8cfd-0353ea81b178 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-9f8f784f-fa53-4693-8cfd-0353ea81b178 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:22:30.903419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:30.904377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:30.905729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:30.905729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:30.905729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:22:30.905729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:22:30.905729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:22:30.905729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:22:30.905729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:22:30.905729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:22:30.905729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:22:30.905729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:30.909511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 515/1038] 10.222.0.50 () {56 vars in 1093 bytes} [Sat Sep 17 04:22:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:30.910880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2804ab-bb71-4928-9133-5e9bc1f24121 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:31.012431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2804ab-bb71-4928-9133-5e9bc1f24121 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:31.027347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:31.049004 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae2fc-0fc7-48a5-b1f6-c812b750e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:31.049613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae2fc-0fc7-48a5-b1f6-c812b750e700 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:31.049885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae2fc-0fc7-48a5-b1f6-c812b750e700 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:31.050149 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae2fc-0fc7-48a5-b1f6-c812b750e700 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:31.050864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ae2fc-0fc7-48a5-b1f6-c812b750e700 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:31.051164 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ae2fc-0fc7-48a5-b1f6-c812b750e700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:31.052571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ae2fc-0fc7-48a5-b1f6-c812b750e700 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:31.075905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 524/1039] 10.222.0.50 () {56 vars in 1133 bytes} [Sat Sep 17 04:22:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:31.077288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f784f-fa53-4693-8cfd-0353ea81b178 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:31.114029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:31.186781 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f784f-fa53-4693-8cfd-0353ea81b178 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:31.223296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f77d9-89d8-40b8-9737-72c51839b524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:31.223900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f77d9-89d8-40b8-9737-72c51839b524 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:31.224171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f77d9-89d8-40b8-9737-72c51839b524 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:31.224436 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f77d9-89d8-40b8-9737-72c51839b524 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:31.291505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f77d9-89d8-40b8-9737-72c51839b524 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:31.292938 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f77d9-89d8-40b8-9737-72c51839b524 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:31.325386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:31.392935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 516/1040] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:22:31 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:22:31.398479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae2fc-0fc7-48a5-b1f6-c812b750e700 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:31.497046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae2fc-0fc7-48a5-b1f6-c812b750e700 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:31.530735 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85097b-24d8-4875-92a8-527dd083fa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:31.531362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85097b-24d8-4875-92a8-527dd083fa98 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:31.532716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85097b-24d8-4875-92a8-527dd083fa98 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:31.532716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85097b-24d8-4875-92a8-527dd083fa98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:31.543957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85097b-24d8-4875-92a8-527dd083fa98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:31.545436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85097b-24d8-4875-92a8-527dd083fa98 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-ba85097b-24d8-4875-92a8-527dd083fa98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:31.560479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:31.561468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:31.563086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:31.563086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:31.563086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:31.563086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 525/1041] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:31.567447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f77d9-89d8-40b8-9737-72c51839b524 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:31.672272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f77d9-89d8-40b8-9737-72c51839b524 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:31.706632 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df8401-2c78-4dea-93a1-bbee1104c091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:31.707239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df8401-2c78-4dea-93a1-bbee1104c091 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:31.707515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df8401-2c78-4dea-93a1-bbee1104c091 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:31.707782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df8401-2c78-4dea-93a1-bbee1104c091 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:31.708410 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df8401-2c78-4dea-93a1-bbee1104c091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:31.708710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df8401-2c78-4dea-93a1-bbee1104c091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:31.710101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df8401-2c78-4dea-93a1-bbee1104c091 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:31.711564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:31.727562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 517/1042] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:31.728779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85097b-24d8-4875-92a8-527dd083fa98 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:31.755137 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:31.833210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85097b-24d8-4875-92a8-527dd083fa98 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:31.867077 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc255c-8b69-4b27-8aa7-427477961bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:31.867708 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc255c-8b69-4b27-8aa7-427477961bcb None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:31.867984 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc255c-8b69-4b27-8aa7-427477961bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:31.868254 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc255c-8b69-4b27-8aa7-427477961bcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:31.874919 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc255c-8b69-4b27-8aa7-427477961bcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:31.876468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc255c-8b69-4b27-8aa7-427477961bcb None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-e4cc255c-8b69-4b27-8aa7-427477961bcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:22:31.887799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:31.888679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:31.889757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:22:31.889757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:22:31.889757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:22:31.889757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:22:31.889757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:22:31.889757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:22:31.889757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:31.889757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:31.889757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 526/1043] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:22:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:31.895306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df8401-2c78-4dea-93a1-bbee1104c091 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:31.998427 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df8401-2c78-4dea-93a1-bbee1104c091 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:32.032862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f268fb-1a35-4ed5-ac8f-e077b2f68009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:32.033496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f268fb-1a35-4ed5-ac8f-e077b2f68009 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:32.033766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f268fb-1a35-4ed5-ac8f-e077b2f68009 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:32.034029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f268fb-1a35-4ed5-ac8f-e077b2f68009 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:32.034777 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f268fb-1a35-4ed5-ac8f-e077b2f68009 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:32.035079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f268fb-1a35-4ed5-ac8f-e077b2f68009 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:32.036542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f268fb-1a35-4ed5-ac8f-e077b2f68009 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:32.048815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 518/1044] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:22:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:32.054577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc255c-8b69-4b27-8aa7-427477961bcb None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:32.138265 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:32.165709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc255c-8b69-4b27-8aa7-427477961bcb None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:32.209485 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35625ded-f999-471b-b38c-a598f59d89a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:32.210388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625ded-f999-471b-b38c-a598f59d89a5 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:32.210840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625ded-f999-471b-b38c-a598f59d89a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:32.211313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625ded-f999-471b-b38c-a598f59d89a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:32.212200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35625ded-f999-471b-b38c-a598f59d89a5 None admin] RBAC: Adding query filter params (role.id=26cc723263984bd0bf00ea579afa96cb, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=eb70408fecfe41e0b2ea9a53c7ae0823) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:32.212745 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35625ded-f999-471b-b38c-a598f59d89a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:32.214361 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35625ded-f999-471b-b38c-a598f59d89a5 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:32.220085 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 527/1045] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:22:32 2022] GET /identity/v3/role_assignments?user.id=eb70408fecfe41e0b2ea9a53c7ae0823&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=26cc723263984bd0bf00ea579afa96cb => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:32.275600 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459aa97-51e1-4097-968a-f96c3e011663 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:32.276106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459aa97-51e1-4097-968a-f96c3e011663 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:32.276106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459aa97-51e1-4097-968a-f96c3e011663 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:32.281068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 519/1046] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:32.283888 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd25317-0ca2-4f8a-92e2-6f4e44e18a59 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:32.284165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd25317-0ca2-4f8a-92e2-6f4e44e18a59 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:32.284435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd25317-0ca2-4f8a-92e2-6f4e44e18a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:32.304433 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-0dd25317-0ca2-4f8a-92e2-6f4e44e18a59 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:32.305670 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-0dd25317-0ca2-4f8a-92e2-6f4e44e18a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:32.382031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 528/1047] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:32.520522 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523811-fca0-4ebf-931f-950d0f4c80d0 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:32.520844 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523811-fca0-4ebf-931f-950d0f4c80d0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:32.521110 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523811-fca0-4ebf-931f-950d0f4c80d0 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:32.522595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 520/1048] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:32.527857 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dae9b-eaa0-452d-af45-9312a9460def None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:32.528092 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dae9b-eaa0-452d-af45-9312a9460def None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:32.528370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dae9b-eaa0-452d-af45-9312a9460def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:32.549458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-910dae9b-eaa0-452d-af45-9312a9460def None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:32.550655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-910dae9b-eaa0-452d-af45-9312a9460def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:32.620600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 529/1049] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:32.652068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523811-fca0-4ebf-931f-950d0f4c80d0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:32.709999 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:32.756022 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523811-fca0-4ebf-931f-950d0f4c80d0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:32.789575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657fadb-c62c-486c-ba07-144cd8be33cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:32.790131 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657fadb-c62c-486c-ba07-144cd8be33cb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:32.790406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657fadb-c62c-486c-ba07-144cd8be33cb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:32.790677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657fadb-c62c-486c-ba07-144cd8be33cb None admin] PATH_INFO: `/v3/services/image` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:32.791253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657fadb-c62c-486c-ba07-144cd8be33cb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:32.792637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657fadb-c62c-486c-ba07-144cd8be33cb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3657fadb-c62c-486c-ba07-144cd8be33cb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:32.802048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:32.803056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:32.805806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 521/1050] 10.222.0.50 () {56 vars in 1105 bytes} [Sat Sep 17 04:22:32 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:32.809286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dae9b-eaa0-452d-af45-9312a9460def None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:32.818290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:32.888756 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657fadb-c62c-486c-ba07-144cd8be33cb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:32.915141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dae9b-eaa0-452d-af45-9312a9460def None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:32.961789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe2fdc-8371-40d6-83e4-d6a65fdf0e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:32.962674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe2fdc-8371-40d6-83e4-d6a65fdf0e47 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:32.963345 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe2fdc-8371-40d6-83e4-d6a65fdf0e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:32.964420 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe2fdc-8371-40d6-83e4-d6a65fdf0e47 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:32.965132 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe2fdc-8371-40d6-83e4-d6a65fdf0e47 None admin] RBAC: Adding query filter params (name=image) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:32.965558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe2fdc-8371-40d6-83e4-d6a65fdf0e47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:32.966971 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe2fdc-8371-40d6-83e4-d6a65fdf0e47 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:32.972812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 530/1051] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:32.978224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe2fdc-8371-40d6-83e4-d6a65fdf0e47 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:32.998278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657fadb-c62c-486c-ba07-144cd8be33cb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:33.018211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:33.036397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fed0a-00f6-44ab-ac5f-236c54a61649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:33.037107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fed0a-00f6-44ab-ac5f-236c54a61649 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:33.037508 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fed0a-00f6-44ab-ac5f-236c54a61649 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:33.037781 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fed0a-00f6-44ab-ac5f-236c54a61649 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:33.048006 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:33.049794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fed0a-00f6-44ab-ac5f-236c54a61649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-dd1fed0a-00f6-44ab-ac5f-236c54a61649 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:22:33.054655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:33.055595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:33.056437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:33.056437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:33.056437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:33.056437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:33.056437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:22:33.056437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:22:33.056437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:22:33.056437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:22:33.056437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:22:33.056437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:22:33.056437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:22:33.056437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:33.056437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 522/1052] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:22:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:33.063753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fed0a-00f6-44ab-ac5f-236c54a61649 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:33.089118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe2fdc-8371-40d6-83e4-d6a65fdf0e47 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:33.128503 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0dbde-e17e-4a1e-b1cb-91c42a223eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:33.129139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0dbde-e17e-4a1e-b1cb-91c42a223eaa None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:33.129418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0dbde-e17e-4a1e-b1cb-91c42a223eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:33.129691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0dbde-e17e-4a1e-b1cb-91c42a223eaa None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:33.130312 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0dbde-e17e-4a1e-b1cb-91c42a223eaa None admin] RBAC: Adding query filter params (type=image) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:33.130612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0dbde-e17e-4a1e-b1cb-91c42a223eaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:33.132239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0dbde-e17e-4a1e-b1cb-91c42a223eaa None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:33.137036 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 531/1053] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:33.142655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0dbde-e17e-4a1e-b1cb-91c42a223eaa None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:33.181671 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fed0a-00f6-44ab-ac5f-236c54a61649 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:33.216705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907bdbe-79f0-4239-8935-c466650148f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:33.217333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907bdbe-79f0-4239-8935-c466650148f4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:33.217613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907bdbe-79f0-4239-8935-c466650148f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:33.217888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907bdbe-79f0-4239-8935-c466650148f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:33.218545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907bdbe-79f0-4239-8935-c466650148f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:33.220109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907bdbe-79f0-4239-8935-c466650148f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:33.220863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907bdbe-79f0-4239-8935-c466650148f4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:33.237498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 523/1054] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:22:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:33.239486 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907bdbe-79f0-4239-8935-c466650148f4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:33.251383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0dbde-e17e-4a1e-b1cb-91c42a223eaa None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:33.285609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:33.289932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d17e9-66b5-4ffe-8aed-d5de0b6f5c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:33.290540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d17e9-66b5-4ffe-8aed-d5de0b6f5c12 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:33.290817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d17e9-66b5-4ffe-8aed-d5de0b6f5c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:33.291082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d17e9-66b5-4ffe-8aed-d5de0b6f5c12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:33.291743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d17e9-66b5-4ffe-8aed-d5de0b6f5c12 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:33.293129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d17e9-66b5-4ffe-8aed-d5de0b6f5c12 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:33.297700 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:33.347579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907bdbe-79f0-4239-8935-c466650148f4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:33.380418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a4790-22b3-4167-b8d4-96c4e562590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:33.387063 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a4790-22b3-4167-b8d4-96c4e562590d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:33.387063 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a4790-22b3-4167-b8d4-96c4e562590d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:33.387063 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a4790-22b3-4167-b8d4-96c4e562590d None admin] PATH_INFO: `/v3/users/155d8c4bb9aa4fffb76c667d77eb813f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:33.396129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a4790-22b3-4167-b8d4-96c4e562590d None admin] RBAC: Authorizing `identity:get_user(user_id=155d8c4bb9aa4fffb76c667d77eb813f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:33.397621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a4790-22b3-4167-b8d4-96c4e562590d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:33.399287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 524/1055] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:22:33 2022] GET /identity/v3/users/155d8c4bb9aa4fffb76c667d77eb813f => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:33.404942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a4790-22b3-4167-b8d4-96c4e562590d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:33.412143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 532/1056] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:22:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:22:33.552418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:33.557104 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a4790-22b3-4167-b8d4-96c4e562590d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:33.604137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fa1c8-cf4b-4d76-9c72-6f32e252fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:33.604675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fa1c8-cf4b-4d76-9c72-6f32e252fa3e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:33.604954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fa1c8-cf4b-4d76-9c72-6f32e252fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:33.605260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fa1c8-cf4b-4d76-9c72-6f32e252fa3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:33.675403 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fa1c8-cf4b-4d76-9c72-6f32e252fa3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:33.676847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fa1c8-cf4b-4d76-9c72-6f32e252fa3e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:33.769598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:33.781038 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 525/1057] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:22:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 04:22:33.783826 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d17e9-66b5-4ffe-8aed-d5de0b6f5c12 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:33.885212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d17e9-66b5-4ffe-8aed-d5de0b6f5c12 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:33.920492 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4df8f-533c-4114-a844-f448a8345fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:33.921173 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4df8f-533c-4114-a844-f448a8345fbf None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:33.921453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4df8f-533c-4114-a844-f448a8345fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:33.921724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4df8f-533c-4114-a844-f448a8345fbf None admin] PATH_INFO: `/v3/projects/b115511a33cc47ffb914b3c3792d8b1f` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:33.923808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4df8f-533c-4114-a844-f448a8345fbf None admin] RBAC: Authorizing `identity:get_project(project_id=b115511a33cc47ffb914b3c3792d8b1f)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:33.925269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4df8f-533c-4114-a844-f448a8345fbf None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:33.931869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 533/1058] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:22:33 2022] GET /identity/v3/projects/b115511a33cc47ffb914b3c3792d8b1f => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:33.933107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fa1c8-cf4b-4d76-9c72-6f32e252fa3e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:34.033309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fa1c8-cf4b-4d76-9c72-6f32e252fa3e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:34.067889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576b080-34f7-457f-9912-35c34d153513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:34.068494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576b080-34f7-457f-9912-35c34d153513 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:34.068767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576b080-34f7-457f-9912-35c34d153513 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:34.069055 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576b080-34f7-457f-9912-35c34d153513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:34.069780 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576b080-34f7-457f-9912-35c34d153513 None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=b115511a33cc47ffb914b3c3792d8b1f, user.id=155d8c4bb9aa4fffb76c667d77eb813f) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:34.070086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576b080-34f7-457f-9912-35c34d153513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:34.071500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576b080-34f7-457f-9912-35c34d153513 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:34.085025 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 526/1059] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:22:33 2022] GET /identity/v3/role_assignments?user.id=155d8c4bb9aa4fffb76c667d77eb813f&scope.project.id=b115511a33cc47ffb914b3c3792d8b1f&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:34.373480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f94398-289c-486c-bf49-23a86482f883 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:34.374014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f94398-289c-486c-bf49-23a86482f883 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:34.374014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f94398-289c-486c-bf49-23a86482f883 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:34.375583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 534/1060] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:34.380736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6582e-382c-4a58-9d9a-3abca32c69b1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:34.381429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6582e-382c-4a58-9d9a-3abca32c69b1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:34.381583 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6582e-382c-4a58-9d9a-3abca32c69b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:34.399783 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-75a6582e-382c-4a58-9d9a-3abca32c69b1 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:34.400952 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-75a6582e-382c-4a58-9d9a-3abca32c69b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:34.453677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:34.467729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 527/1061] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:34.737153 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f94398-289c-486c-bf49-23a86482f883 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:34.797862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:34.840422 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f94398-289c-486c-bf49-23a86482f883 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:34.874307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242139a0-1130-489f-880b-da29ef79fb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:34.874928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242139a0-1130-489f-880b-da29ef79fb08 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:34.875421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242139a0-1130-489f-880b-da29ef79fb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:34.875928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242139a0-1130-489f-880b-da29ef79fb08 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:34.887081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242139a0-1130-489f-880b-da29ef79fb08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-242139a0-1130-489f-880b-da29ef79fb08 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:22:34.892467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:34.893647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:34.894487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:34.894487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:34.894487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:34.894487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:34.894487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:22:34.894487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:22:34.894487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:22:34.894487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:22:34.894487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:22:34.894487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:22:34.894487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 04:22:34.894487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:34.897303 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 535/1062] 10.222.0.50 () {56 vars in 1120 bytes} [Sat Sep 17 04:22:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:34.899668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6582e-382c-4a58-9d9a-3abca32c69b1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:35.001969 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6582e-382c-4a58-9d9a-3abca32c69b1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:35.035808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f757bc0-7b50-4c15-b27e-558b865f391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:35.036403 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f757bc0-7b50-4c15-b27e-558b865f391b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:35.036674 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f757bc0-7b50-4c15-b27e-558b865f391b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:35.036937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f757bc0-7b50-4c15-b27e-558b865f391b None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:35.037617 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f757bc0-7b50-4c15-b27e-558b865f391b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:35.037911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f757bc0-7b50-4c15-b27e-558b865f391b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:35.039264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f757bc0-7b50-4c15-b27e-558b865f391b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:35.051917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 528/1063] 10.222.0.50 () {56 vars in 1115 bytes} [Sat Sep 17 04:22:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:35.053680 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242139a0-1130-489f-880b-da29ef79fb08 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:35.160232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242139a0-1130-489f-880b-da29ef79fb08 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:35.177724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:35.194342 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506f56f-6d83-4e94-a777-51b8d4d516b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:35.199552 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506f56f-6d83-4e94-a777-51b8d4d516b2 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:35.199552 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506f56f-6d83-4e94-a777-51b8d4d516b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:35.199552 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506f56f-6d83-4e94-a777-51b8d4d516b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:35.205821 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506f56f-6d83-4e94-a777-51b8d4d516b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:35.207334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506f56f-6d83-4e94-a777-51b8d4d516b2 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-d506f56f-6d83-4e94-a777-51b8d4d516b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:35.221669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:35.222599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:35.223977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:35.223977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:35.223977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:35.225309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 536/1064] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:35.228660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f757bc0-7b50-4c15-b27e-558b865f391b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:35.280256 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:35.336721 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f757bc0-7b50-4c15-b27e-558b865f391b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:35.371565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffd65d-4828-4b53-8618-83268ae292c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:35.372166 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffd65d-4828-4b53-8618-83268ae292c9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:35.372438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffd65d-4828-4b53-8618-83268ae292c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:35.372703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffd65d-4828-4b53-8618-83268ae292c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:35.373374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffd65d-4828-4b53-8618-83268ae292c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:35.373675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffd65d-4828-4b53-8618-83268ae292c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:35.375065 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffd65d-4828-4b53-8618-83268ae292c9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:35.387392 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 529/1065] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:35.392940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506f56f-6d83-4e94-a777-51b8d4d516b2 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:35.494500 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506f56f-6d83-4e94-a777-51b8d4d516b2 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:35.530952 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa96dfe-220d-42b4-89ce-5f88af4619dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:35.532089 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa96dfe-220d-42b4-89ce-5f88af4619dc None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:35.532363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa96dfe-220d-42b4-89ce-5f88af4619dc None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:35.532714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa96dfe-220d-42b4-89ce-5f88af4619dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:35.540147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa96dfe-220d-42b4-89ce-5f88af4619dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:35.541608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa96dfe-220d-42b4-89ce-5f88af4619dc None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-8fa96dfe-220d-42b4-89ce-5f88af4619dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:22:35.552568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:35.553664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:35.554996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:35.554996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:35.554996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:22:35.554996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:22:35.554996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:22:35.554996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:22:35.554996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:22:35.554996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:22:35.554996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:22:35.554996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:35.557330 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 537/1066] 10.222.0.50 () {56 vars in 1093 bytes} [Sat Sep 17 04:22:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:35.559292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffd65d-4828-4b53-8618-83268ae292c9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:35.611054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cda4e-9f7a-4942-b9f2-b7be49a1974e None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:35.611403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cda4e-9f7a-4942-b9f2-b7be49a1974e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:35.611632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cda4e-9f7a-4942-b9f2-b7be49a1974e None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:35.613052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 538/1067] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:35.617959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb0c52-afe7-411f-b064-36a0113a06d3 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:35.618242 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb0c52-afe7-411f-b064-36a0113a06d3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:35.618513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb0c52-afe7-411f-b064-36a0113a06d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:35.637344 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-0abb0c52-afe7-411f-b064-36a0113a06d3 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:35.638525 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-0abb0c52-afe7-411f-b064-36a0113a06d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:35.662241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:35.665820 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffd65d-4828-4b53-8618-83268ae292c9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:35.679124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:35.703905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5f3e0-12bc-4583-aad2-3cecb2171441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:35.704501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5f3e0-12bc-4583-aad2-3cecb2171441 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:35.704771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5f3e0-12bc-4583-aad2-3cecb2171441 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:35.705057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5f3e0-12bc-4583-aad2-3cecb2171441 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:35.705781 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5f3e0-12bc-4583-aad2-3cecb2171441 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:35.706078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5f3e0-12bc-4583-aad2-3cecb2171441 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:35.707443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 539/1068] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:22:35.707551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5f3e0-12bc-4583-aad2-3cecb2171441 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:35.729210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 530/1069] 10.222.0.50 () {56 vars in 1133 bytes} [Sat Sep 17 04:22:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:35.730311 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb0c52-afe7-411f-b064-36a0113a06d3 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:35.832762 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb0c52-afe7-411f-b064-36a0113a06d3 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:35.867533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee743569-4c95-40b5-bb2a-2e67d4b05443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:35.868164 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee743569-4c95-40b5-bb2a-2e67d4b05443 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:35.868438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee743569-4c95-40b5-bb2a-2e67d4b05443 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:35.868704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee743569-4c95-40b5-bb2a-2e67d4b05443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:35.878789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee743569-4c95-40b5-bb2a-2e67d4b05443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:35.880253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee743569-4c95-40b5-bb2a-2e67d4b05443 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-ee743569-4c95-40b5-bb2a-2e67d4b05443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:35.894910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:35.895941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:35.896815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:35.896815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:35.896815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:35.896815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 540/1070] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:35.901624 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5f3e0-12bc-4583-aad2-3cecb2171441 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:35.983243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee743569-4c95-40b5-bb2a-2e67d4b05443 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:35.998819 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:36.003774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5f3e0-12bc-4583-aad2-3cecb2171441 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:36.040006 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e9caf-899a-463f-bc79-00a702428092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:36.040610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e9caf-899a-463f-bc79-00a702428092 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:36.040934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e9caf-899a-463f-bc79-00a702428092 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:36.041171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e9caf-899a-463f-bc79-00a702428092 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:36.041839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e9caf-899a-463f-bc79-00a702428092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:36.042110 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e9caf-899a-463f-bc79-00a702428092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:36.043468 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e9caf-899a-463f-bc79-00a702428092 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:36.056136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 531/1071] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:36.061609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e9caf-899a-463f-bc79-00a702428092 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:36.089849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee743569-4c95-40b5-bb2a-2e67d4b05443 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:36.091356 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:36.127608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd4cc6-9635-45d0-81fd-fb8b3721826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:36.128234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd4cc6-9635-45d0-81fd-fb8b3721826e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:36.128502 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd4cc6-9635-45d0-81fd-fb8b3721826e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:36.128771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd4cc6-9635-45d0-81fd-fb8b3721826e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:36.178541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e9caf-899a-463f-bc79-00a702428092 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:36.206970 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd4cc6-9635-45d0-81fd-fb8b3721826e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:36.208522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd4cc6-9635-45d0-81fd-fb8b3721826e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:36.214318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee4a52-a76a-4508-ae7e-997cce9bf987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:36.214949 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee4a52-a76a-4508-ae7e-997cce9bf987 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:36.215227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee4a52-a76a-4508-ae7e-997cce9bf987 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:36.215495 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee4a52-a76a-4508-ae7e-997cce9bf987 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:36.223017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee4a52-a76a-4508-ae7e-997cce9bf987 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:36.223945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:36.224462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee4a52-a76a-4508-ae7e-997cce9bf987 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-13ee4a52-a76a-4508-ae7e-997cce9bf987 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:22:36.236593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:36.237725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:36.238832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:22:36.238832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:22:36.238832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:22:36.238832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:22:36.238832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:22:36.238832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:22:36.238832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:36.238832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:36.238832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 532/1072] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:22:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:36.239425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600a198-30e3-4e5a-8e33-c83cab36fe14 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:36.239425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600a198-30e3-4e5a-8e33-c83cab36fe14 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:36.239704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600a198-30e3-4e5a-8e33-c83cab36fe14 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:36.241077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 533/1073] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:36.243499 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600a198-30e3-4e5a-8e33-c83cab36fe14 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:36.312785 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 541/1074] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:22:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 04:22:36.314086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866021c-a8c8-457d-be26-903aa5c4585d None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:36.314364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866021c-a8c8-457d-be26-903aa5c4585d None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:36.314631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866021c-a8c8-457d-be26-903aa5c4585d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:36.331523 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:36.333251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-7866021c-a8c8-457d-be26-903aa5c4585d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:36.334438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7866021c-a8c8-457d-be26-903aa5c4585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:36.344596 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600a198-30e3-4e5a-8e33-c83cab36fe14 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:36.379707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f108e-b0e9-462a-9d27-b69f253b4d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:36.380308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f108e-b0e9-462a-9d27-b69f253b4d30 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:36.380661 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f108e-b0e9-462a-9d27-b69f253b4d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:36.381120 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f108e-b0e9-462a-9d27-b69f253b4d30 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:36.381814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f108e-b0e9-462a-9d27-b69f253b4d30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:36.382114 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f108e-b0e9-462a-9d27-b69f253b4d30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:36.383531 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f108e-b0e9-462a-9d27-b69f253b4d30 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:36.395796 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 534/1075] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:22:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:36.395796 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f108e-b0e9-462a-9d27-b69f253b4d30 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:36.407575 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 542/1076] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:36.408390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866021c-a8c8-457d-be26-903aa5c4585d None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:36.459055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:36.507973 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f108e-b0e9-462a-9d27-b69f253b4d30 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:36.520564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866021c-a8c8-457d-be26-903aa5c4585d None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:36.543873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf6c68-b79f-4ce7-a2e4-410a2a13c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:36.544503 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf6c68-b79f-4ce7-a2e4-410a2a13c466 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:36.544784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf6c68-b79f-4ce7-a2e4-410a2a13c466 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:36.545100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf6c68-b79f-4ce7-a2e4-410a2a13c466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:36.556441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77b787-e36c-48d4-9243-5fdd93450e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:36.556678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf6c68-b79f-4ce7-a2e4-410a2a13c466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:36.557121 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77b787-e36c-48d4-9243-5fdd93450e99 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:36.557400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77b787-e36c-48d4-9243-5fdd93450e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:36.557670 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77b787-e36c-48d4-9243-5fdd93450e99 None admin] PATH_INFO: `/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/eb70408fecfe41e0b2ea9a53c7ae0823/roles/26cc723263984bd0bf00ea579afa96cb` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:36.558179 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf6c68-b79f-4ce7-a2e4-410a2a13c466 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:36.559804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77b787-e36c-48d4-9243-5fdd93450e99 None admin] RBAC: Authorizing `identity:create_grant(project_id=d50a1cd322404bd4b0fa7a8c388dc217, user_id=eb70408fecfe41e0b2ea9a53c7ae0823, role_id=26cc723263984bd0bf00ea579afa96cb)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:36.561238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77b787-e36c-48d4-9243-5fdd93450e99 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:36.566782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-47bf6c68-b79f-4ce7-a2e4-410a2a13c466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:36.573626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:36.574713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:36.575650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:36.575650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:36.575650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:36.575650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 535/1077] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:36.581086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf6c68-b79f-4ce7-a2e4-410a2a13c466 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:36.634906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 543/1078] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:22:36 2022] PUT /identity/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/eb70408fecfe41e0b2ea9a53c7ae0823/roles/26cc723263984bd0bf00ea579afa96cb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:22:36.685602 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77b787-e36c-48d4-9243-5fdd93450e99 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:36.694333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf6c68-b79f-4ce7-a2e4-410a2a13c466 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:36.733924 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86ae95-804e-48c2-8832-5b86886425db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:36.734751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86ae95-804e-48c2-8832-5b86886425db None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:36.735579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86ae95-804e-48c2-8832-5b86886425db None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:36.735857 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86ae95-804e-48c2-8832-5b86886425db None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:36.736524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86ae95-804e-48c2-8832-5b86886425db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:36.736831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86ae95-804e-48c2-8832-5b86886425db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:36.738266 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86ae95-804e-48c2-8832-5b86886425db None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:36.757060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 536/1079] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:36.820390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77b787-e36c-48d4-9243-5fdd93450e99 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:36.822267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:36.862960 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989d46a-982c-4a9c-b2b0-d5e50fc5a9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:36.863898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989d46a-982c-4a9c-b2b0-d5e50fc5a9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:36.864178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989d46a-982c-4a9c-b2b0-d5e50fc5a9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:36.864449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989d46a-982c-4a9c-b2b0-d5e50fc5a9f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:36.877079 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989d46a-982c-4a9c-b2b0-d5e50fc5a9f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-4989d46a-982c-4a9c-b2b0-d5e50fc5a9f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:22:36.882288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:36.883536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:36.884412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:36.884412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:36.884412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:36.884412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:36.884412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:22:36.884412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:22:36.884412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:22:36.884412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:22:36.884412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:22:36.884412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:22:36.884412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:22:36.884412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:36.884412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 544/1080] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:22:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:36.889606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86ae95-804e-48c2-8832-5b86886425db None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:36.955302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:36.998298 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86ae95-804e-48c2-8832-5b86886425db None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:37.035406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48818caa-5502-4eb2-8718-b2c20c5a8454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:37.036026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48818caa-5502-4eb2-8718-b2c20c5a8454 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:37.036306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48818caa-5502-4eb2-8718-b2c20c5a8454 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:37.036577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48818caa-5502-4eb2-8718-b2c20c5a8454 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:37.037277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48818caa-5502-4eb2-8718-b2c20c5a8454 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:37.037615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48818caa-5502-4eb2-8718-b2c20c5a8454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:37.038989 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48818caa-5502-4eb2-8718-b2c20c5a8454 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:37.048624 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 537/1081] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:22:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:37.054597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989d46a-982c-4a9c-b2b0-d5e50fc5a9f4 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:37.164654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989d46a-982c-4a9c-b2b0-d5e50fc5a9f4 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:37.197942 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c473233-6a33-4257-92db-e9cd2ff40026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:37.198561 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473233-6a33-4257-92db-e9cd2ff40026 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:37.198835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473233-6a33-4257-92db-e9cd2ff40026 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:37.199103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473233-6a33-4257-92db-e9cd2ff40026 None admin] PATH_INFO: `/v3/users/155d8c4bb9aa4fffb76c667d77eb813f` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:37.200209 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c473233-6a33-4257-92db-e9cd2ff40026 None admin] RBAC: Authorizing `identity:get_user(user_id=155d8c4bb9aa4fffb76c667d77eb813f)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:37.201662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c473233-6a33-4257-92db-e9cd2ff40026 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:37.203278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 545/1082] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:22:37 2022] GET /identity/v3/users/155d8c4bb9aa4fffb76c667d77eb813f => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:37.208923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48818caa-5502-4eb2-8718-b2c20c5a8454 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:37.304391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48818caa-5502-4eb2-8718-b2c20c5a8454 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:37.326086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:37.337056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9efe9-1e33-4e68-ac6d-a5d05776eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:37.343318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9efe9-1e33-4e68-ac6d-a5d05776eb1a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:37.343318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9efe9-1e33-4e68-ac6d-a5d05776eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:37.343318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9efe9-1e33-4e68-ac6d-a5d05776eb1a None admin] PATH_INFO: `/v3/projects/b115511a33cc47ffb914b3c3792d8b1f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:37.343318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9efe9-1e33-4e68-ac6d-a5d05776eb1a None admin] RBAC: Authorizing `identity:get_project(project_id=b115511a33cc47ffb914b3c3792d8b1f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:37.343318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9efe9-1e33-4e68-ac6d-a5d05776eb1a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:37.343318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 538/1083] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:22:37 2022] GET /identity/v3/projects/b115511a33cc47ffb914b3c3792d8b1f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:37.348655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c473233-6a33-4257-92db-e9cd2ff40026 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:37.379480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:37.447646 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c473233-6a33-4257-92db-e9cd2ff40026 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:37.479541 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c4f51-5abb-4561-8728-a5cd4eacca45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:37.480189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4f51-5abb-4561-8728-a5cd4eacca45 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:37.480467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4f51-5abb-4561-8728-a5cd4eacca45 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:37.480736 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4f51-5abb-4561-8728-a5cd4eacca45 None admin] PATH_INFO: `/v3/projects/b115511a33cc47ffb914b3c3792d8b1f/users/155d8c4bb9aa4fffb76c667d77eb813f/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:37.482609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c4f51-5abb-4561-8728-a5cd4eacca45 None admin] RBAC: Authorizing `identity:create_grant(project_id=b115511a33cc47ffb914b3c3792d8b1f, user_id=155d8c4bb9aa4fffb76c667d77eb813f, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:37.484018 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c4f51-5abb-4561-8728-a5cd4eacca45 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:37.548360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 546/1084] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:22:37 2022] PUT /identity/v3/projects/b115511a33cc47ffb914b3c3792d8b1f/users/155d8c4bb9aa4fffb76c667d77eb813f/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:22:38.835757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e124f-5422-4fcb-85f5-440dd7baad95 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:38.836278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e124f-5422-4fcb-85f5-440dd7baad95 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:38.836278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e124f-5422-4fcb-85f5-440dd7baad95 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:38.837669 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 539/1085] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:38.842894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439db8b-57ed-4712-9147-dab646f1d965 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:38.843281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439db8b-57ed-4712-9147-dab646f1d965 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:38.843428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439db8b-57ed-4712-9147-dab646f1d965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:38.862358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-e439db8b-57ed-4712-9147-dab646f1d965 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:38.863514 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-e439db8b-57ed-4712-9147-dab646f1d965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:38.927250 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 547/1086] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:39.195741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e124f-5422-4fcb-85f5-440dd7baad95 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:39.294651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e124f-5422-4fcb-85f5-440dd7baad95 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:39.328226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a39bf3-5766-4478-8852-eb9cfc49fe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:39.328843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a39bf3-5766-4478-8852-eb9cfc49fe7e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:39.329157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a39bf3-5766-4478-8852-eb9cfc49fe7e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:39.329424 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a39bf3-5766-4478-8852-eb9cfc49fe7e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:39.339864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a39bf3-5766-4478-8852-eb9cfc49fe7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-f3a39bf3-5766-4478-8852-eb9cfc49fe7e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:22:39.344752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:39.345964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:39.346809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:39.346809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:39.346809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:39.346809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:39.346809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:22:39.346809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:22:39.346809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:22:39.346809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:22:39.346809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:22:39.346809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:22:39.346809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 04:22:39.346809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:39.346809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 540/1087] 10.222.0.50 () {56 vars in 1120 bytes} [Sat Sep 17 04:22:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:39.351960 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439db8b-57ed-4712-9147-dab646f1d965 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:39.372826 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:39.448293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439db8b-57ed-4712-9147-dab646f1d965 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:39.481967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb9dbe-138b-49a8-a7d9-26e95a61fd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:39.482585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb9dbe-138b-49a8-a7d9-26e95a61fd16 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:39.482851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb9dbe-138b-49a8-a7d9-26e95a61fd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:39.483119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb9dbe-138b-49a8-a7d9-26e95a61fd16 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:39.483779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb9dbe-138b-49a8-a7d9-26e95a61fd16 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:39.484080 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb9dbe-138b-49a8-a7d9-26e95a61fd16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:39.485673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb9dbe-138b-49a8-a7d9-26e95a61fd16 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:39.493943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 548/1088] 10.222.0.50 () {56 vars in 1115 bytes} [Sat Sep 17 04:22:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:39.499782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a39bf3-5766-4478-8852-eb9cfc49fe7e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:39.552904 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:39.610629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a39bf3-5766-4478-8852-eb9cfc49fe7e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:39.645472 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfb515-23bd-44f7-99d2-3b7a6a7a6ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:39.646097 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfb515-23bd-44f7-99d2-3b7a6a7a6ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:39.646375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfb515-23bd-44f7-99d2-3b7a6a7a6ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:39.646645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfb515-23bd-44f7-99d2-3b7a6a7a6ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:39.657683 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfb515-23bd-44f7-99d2-3b7a6a7a6ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:39.659147 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfb515-23bd-44f7-99d2-3b7a6a7a6ef5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-09cfb515-23bd-44f7-99d2-3b7a6a7a6ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:39.673972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:39.674979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:39.675874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:39.675874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:39.675874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:39.675874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 541/1089] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:39.680961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb9dbe-138b-49a8-a7d9-26e95a61fd16 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:39.685367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace9fd-835c-4bd4-ae4d-c20133d8cc5a None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:39.685653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace9fd-835c-4bd4-ae4d-c20133d8cc5a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:39.685931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace9fd-835c-4bd4-ae4d-c20133d8cc5a None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:39.687735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 542/1090] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:22:39.693378 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07af8a-f45c-4763-bbc3-0f9558f058b6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:39.693659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07af8a-f45c-4763-bbc3-0f9558f058b6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:39.693935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07af8a-f45c-4763-bbc3-0f9558f058b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:39.712707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0d07af8a-f45c-4763-bbc3-0f9558f058b6 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:39.713815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0d07af8a-f45c-4763-bbc3-0f9558f058b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:39.764063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:39.780481 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 543/1091] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:22:39.782682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb9dbe-138b-49a8-a7d9-26e95a61fd16 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:39.817166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e661b9-5951-4258-81c3-4b70defb3112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:39.817774 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e661b9-5951-4258-81c3-4b70defb3112 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:39.818053 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e661b9-5951-4258-81c3-4b70defb3112 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:39.818325 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e661b9-5951-4258-81c3-4b70defb3112 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:39.818962 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e661b9-5951-4258-81c3-4b70defb3112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:39.819267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e661b9-5951-4258-81c3-4b70defb3112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:39.820636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e661b9-5951-4258-81c3-4b70defb3112 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:39.832968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 549/1092] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:39.838605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07af8a-f45c-4763-bbc3-0f9558f058b6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:39.868088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:39.935263 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07af8a-f45c-4763-bbc3-0f9558f058b6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:39.975650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af8a90-36c3-4be1-aa45-21b5d53bc305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:39.976193 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af8a90-36c3-4be1-aa45-21b5d53bc305 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:39.976466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af8a90-36c3-4be1-aa45-21b5d53bc305 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:39.976727 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af8a90-36c3-4be1-aa45-21b5d53bc305 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:39.983630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af8a90-36c3-4be1-aa45-21b5d53bc305 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:39.985657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af8a90-36c3-4be1-aa45-21b5d53bc305 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-35af8a90-36c3-4be1-aa45-21b5d53bc305 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:22:39.996694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:39.997818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:39.998866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:39.998866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:39.998866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:22:39.998866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:22:39.998866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:22:39.998866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:22:39.998866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:22:39.998866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:22:39.998866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 04:22:39.998866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:39.998866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 544/1093] 10.222.0.50 () {56 vars in 1093 bytes} [Sat Sep 17 04:22:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:40.004327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e661b9-5951-4258-81c3-4b70defb3112 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:40.048741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af8a90-36c3-4be1-aa45-21b5d53bc305 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:40.101046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e661b9-5951-4258-81c3-4b70defb3112 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:40.135210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151cc41-5b55-48d1-bc72-932af2c72ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:40.135804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151cc41-5b55-48d1-bc72-932af2c72ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:40.136078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151cc41-5b55-48d1-bc72-932af2c72ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:40.136348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151cc41-5b55-48d1-bc72-932af2c72ed3 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:40.137095 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151cc41-5b55-48d1-bc72-932af2c72ed3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:40.137399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151cc41-5b55-48d1-bc72-932af2c72ed3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:40.138827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151cc41-5b55-48d1-bc72-932af2c72ed3 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:40.138957 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:40.147491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af8a90-36c3-4be1-aa45-21b5d53bc305 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:40.153411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:40.157574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 550/1094] 10.222.0.50 () {56 vars in 1133 bytes} [Sat Sep 17 04:22:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:40.163402 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151cc41-5b55-48d1-bc72-932af2c72ed3 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:40.186542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c8485-ae56-4cca-ad4f-7ac6cb8bf995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:40.187277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c8485-ae56-4cca-ad4f-7ac6cb8bf995 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:40.187926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c8485-ae56-4cca-ad4f-7ac6cb8bf995 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:40.188192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c8485-ae56-4cca-ad4f-7ac6cb8bf995 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:40.198127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c8485-ae56-4cca-ad4f-7ac6cb8bf995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-2c3c8485-ae56-4cca-ad4f-7ac6cb8bf995 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:22:40.203876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:40.204813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:40.205697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:40.205697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:40.205697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:40.205697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:40.205697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:22:40.205697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:22:40.205697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:22:40.205697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:22:40.205697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:22:40.205697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:22:40.205697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:22:40.205697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:22:40.205697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 545/1095] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:22:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:22:40.210909 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c8485-ae56-4cca-ad4f-7ac6cb8bf995 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:40.261318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151cc41-5b55-48d1-bc72-932af2c72ed3 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:40.294633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dceaf1-e65c-4ab2-935d-10dde17aeca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:40.295231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dceaf1-e65c-4ab2-935d-10dde17aeca8 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:40.295507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dceaf1-e65c-4ab2-935d-10dde17aeca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:40.295775 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dceaf1-e65c-4ab2-935d-10dde17aeca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:40.308011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c8485-ae56-4cca-ad4f-7ac6cb8bf995 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:40.340665 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f5c1d-8ae5-4855-ab21-104653c19a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:40.341294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f5c1d-8ae5-4855-ab21-104653c19a84 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:40.341573 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f5c1d-8ae5-4855-ab21-104653c19a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:40.341844 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f5c1d-8ae5-4855-ab21-104653c19a84 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:40.342501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f5c1d-8ae5-4855-ab21-104653c19a84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:40.342797 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f5c1d-8ae5-4855-ab21-104653c19a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:40.345427 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f5c1d-8ae5-4855-ab21-104653c19a84 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:40.354794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 546/1096] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:22:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:40.361238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f5c1d-8ae5-4855-ab21-104653c19a84 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:40.366490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:40.368964 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dceaf1-e65c-4ab2-935d-10dde17aeca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:40.370473 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dceaf1-e65c-4ab2-935d-10dde17aeca8 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:40.376254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:40.460594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f5c1d-8ae5-4855-ab21-104653c19a84 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:40.467434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 551/1097] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:22:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 04:22:40.473895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dceaf1-e65c-4ab2-935d-10dde17aeca8 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:40.499061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a33b73-67e3-46bb-825e-c0bdde3d3f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:40.499742 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a33b73-67e3-46bb-825e-c0bdde3d3f8a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:40.500030 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a33b73-67e3-46bb-825e-c0bdde3d3f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:40.500295 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a33b73-67e3-46bb-825e-c0bdde3d3f8a None admin] PATH_INFO: `/v3/users/155d8c4bb9aa4fffb76c667d77eb813f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:40.501464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a33b73-67e3-46bb-825e-c0bdde3d3f8a None admin] RBAC: Authorizing `identity:get_user(user_id=155d8c4bb9aa4fffb76c667d77eb813f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:40.502897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a33b73-67e3-46bb-825e-c0bdde3d3f8a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:40.504528 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 547/1098] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:22:40 2022] GET /identity/v3/users/155d8c4bb9aa4fffb76c667d77eb813f => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:40.510511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a33b73-67e3-46bb-825e-c0bdde3d3f8a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:40.571530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:40.574537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dceaf1-e65c-4ab2-935d-10dde17aeca8 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:40.589257 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:40.607038 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a33b73-67e3-46bb-825e-c0bdde3d3f8a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:40.608419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ee628-f3c8-4f2d-9e86-a5a178be795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:40.609736 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ee628-f3c8-4f2d-9e86-a5a178be795f None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:40.610121 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ee628-f3c8-4f2d-9e86-a5a178be795f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:40.610468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ee628-f3c8-4f2d-9e86-a5a178be795f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:40.620210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ee628-f3c8-4f2d-9e86-a5a178be795f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:40.621900 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ee628-f3c8-4f2d-9e86-a5a178be795f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-bf7ee628-f3c8-4f2d-9e86-a5a178be795f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:22:40.636204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:40.637208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:22:40.638093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:22:40.638093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:22:40.638093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:40.638093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 552/1099] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:40.643317 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ee628-f3c8-4f2d-9e86-a5a178be795f None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:40.646579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d3584-a157-47c4-a2ba-382ada8292aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:40.647212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d3584-a157-47c4-a2ba-382ada8292aa None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:40.647487 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d3584-a157-47c4-a2ba-382ada8292aa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:40.647751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d3584-a157-47c4-a2ba-382ada8292aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:40.714019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d3584-a157-47c4-a2ba-382ada8292aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:40.715462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d3584-a157-47c4-a2ba-382ada8292aa None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:40.745617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ee628-f3c8-4f2d-9e86-a5a178be795f None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:40.779129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05612b53-f656-411d-850d-8bfd5bdb6b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:40.779723 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05612b53-f656-411d-850d-8bfd5bdb6b9a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:40.780000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05612b53-f656-411d-850d-8bfd5bdb6b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:40.780271 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05612b53-f656-411d-850d-8bfd5bdb6b9a None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:40.781526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05612b53-f656-411d-850d-8bfd5bdb6b9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:40.781869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05612b53-f656-411d-850d-8bfd5bdb6b9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:40.783232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05612b53-f656-411d-850d-8bfd5bdb6b9a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:40.793332 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:40.795288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 553/1100] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:40.801820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05612b53-f656-411d-850d-8bfd5bdb6b9a None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:40.817142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 548/1101] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:22:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 04:22:40.817309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:40.818442 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d3584-a157-47c4-a2ba-382ada8292aa None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:40.901645 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05612b53-f656-411d-850d-8bfd5bdb6b9a None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:40.915942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d3584-a157-47c4-a2ba-382ada8292aa None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:40.935717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f2925-7157-4dce-8029-2c6e6b9e5063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:40.936340 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f2925-7157-4dce-8029-2c6e6b9e5063 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:40.936613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f2925-7157-4dce-8029-2c6e6b9e5063 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:40.936886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f2925-7157-4dce-8029-2c6e6b9e5063 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:40.943748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f2925-7157-4dce-8029-2c6e6b9e5063 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:40.945255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f2925-7157-4dce-8029-2c6e6b9e5063 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:40.949729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbc849-b7ea-49ce-ba83-524bb8449945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:40.950348 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc849-b7ea-49ce-ba83-524bb8449945 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:40.950623 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc849-b7ea-49ce-ba83-524bb8449945 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:40.950890 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc849-b7ea-49ce-ba83-524bb8449945 None admin] PATH_INFO: `/v3/projects/b115511a33cc47ffb914b3c3792d8b1f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:40.951983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbc849-b7ea-49ce-ba83-524bb8449945 None admin] RBAC: Authorizing `identity:get_project(project_id=b115511a33cc47ffb914b3c3792d8b1f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:40.954043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbc849-b7ea-49ce-ba83-524bb8449945 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:40.955662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 549/1102] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:22:40 2022] GET /identity/v3/projects/b115511a33cc47ffb914b3c3792d8b1f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-659f2925-7157-4dce-8029-2c6e6b9e5063 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:22:40.957410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:22:40.958441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:22:40.959442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:22:40.959442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:22:40.959442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:22:40.959442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:22:40.959442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:22:40.959442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:22:40.959442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:22:40.959442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:22:40.959442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 554/1103] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:22:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:22:40.961843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbc849-b7ea-49ce-ba83-524bb8449945 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:40.965743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f2925-7157-4dce-8029-2c6e6b9e5063 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:41.013242 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:41.034700 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:41.060489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbc849-b7ea-49ce-ba83-524bb8449945 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:41.064632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f2925-7157-4dce-8029-2c6e6b9e5063 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:41.094988 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4ffec-00ac-446b-90cb-795f8bd88495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:41.095591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4ffec-00ac-446b-90cb-795f8bd88495 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:41.095872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4ffec-00ac-446b-90cb-795f8bd88495 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:41.096144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4ffec-00ac-446b-90cb-795f8bd88495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:41.096865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4ffec-00ac-446b-90cb-795f8bd88495 None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=b115511a33cc47ffb914b3c3792d8b1f, user.id=155d8c4bb9aa4fffb76c667d77eb813f) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:41.097202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4ffec-00ac-446b-90cb-795f8bd88495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:41.097310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e6c9b-4ae4-43e4-a9fd-0150a4a8ded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:41.097830 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e6c9b-4ae4-43e4-a9fd-0150a4a8ded1 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:41.098107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e6c9b-4ae4-43e4-a9fd-0150a4a8ded1 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:41.098379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e6c9b-4ae4-43e4-a9fd-0150a4a8ded1 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:41.098628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4ffec-00ac-446b-90cb-795f8bd88495 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:41.099060 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e6c9b-4ae4-43e4-a9fd-0150a4a8ded1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:41.099373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e6c9b-4ae4-43e4-a9fd-0150a4a8ded1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:41.101187 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e6c9b-4ae4-43e4-a9fd-0150a4a8ded1 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:41.109129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 550/1104] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:22:40 2022] GET /identity/v3/role_assignments?user.id=155d8c4bb9aa4fffb76c667d77eb813f&scope.project.id=b115511a33cc47ffb914b3c3792d8b1f&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:41.115377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 555/1105] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:22:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:41.121787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4ffec-00ac-446b-90cb-795f8bd88495 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:41.229547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4ffec-00ac-446b-90cb-795f8bd88495 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:41.244228 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:41.265557 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce610026-341a-44df-9813-bb1035e52c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:41.266165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce610026-341a-44df-9813-bb1035e52c00 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:41.266440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce610026-341a-44df-9813-bb1035e52c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:41.266713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce610026-341a-44df-9813-bb1035e52c00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:41.267447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce610026-341a-44df-9813-bb1035e52c00 None admin] RBAC: Adding query filter params (role.id=26cc723263984bd0bf00ea579afa96cb, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=eb70408fecfe41e0b2ea9a53c7ae0823) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:41.267757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce610026-341a-44df-9813-bb1035e52c00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:41.269220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce610026-341a-44df-9813-bb1035e52c00 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:41.275334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 551/1106] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:22:41 2022] GET /identity/v3/role_assignments?user.id=eb70408fecfe41e0b2ea9a53c7ae0823&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=26cc723263984bd0bf00ea579afa96cb => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:43.294440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213b8c6-37aa-4077-83f5-ac1d0e39471d None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:43.294982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213b8c6-37aa-4077-83f5-ac1d0e39471d None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:43.294982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213b8c6-37aa-4077-83f5-ac1d0e39471d None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:43.296293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 556/1107] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:43.301750 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11310071-b3c3-4553-89b9-177ed4d5256d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:43.302168 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11310071-b3c3-4553-89b9-177ed4d5256d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:43.302299 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11310071-b3c3-4553-89b9-177ed4d5256d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:43.320622 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-11310071-b3c3-4553-89b9-177ed4d5256d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:43.321834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-11310071-b3c3-4553-89b9-177ed4d5256d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:43.386451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 552/1108] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:43.653670 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213b8c6-37aa-4077-83f5-ac1d0e39471d None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:43.753654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213b8c6-37aa-4077-83f5-ac1d0e39471d None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:43.781474 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:43.786049 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9fd4b-3d2a-4e51-9bbf-8a6db2f53a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:43.786665 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9fd4b-3d2a-4e51-9bbf-8a6db2f53a77 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:43.786937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9fd4b-3d2a-4e51-9bbf-8a6db2f53a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:43.787203 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9fd4b-3d2a-4e51-9bbf-8a6db2f53a77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:43.788276 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9fd4b-3d2a-4e51-9bbf-8a6db2f53a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:43.789717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9fd4b-3d2a-4e51-9bbf-8a6db2f53a77 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:43.791243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 557/1109] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:43.797626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11310071-b3c3-4553-89b9-177ed4d5256d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:43.892212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11310071-b3c3-4553-89b9-177ed4d5256d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:43.900929 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:43.925162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee84ca-2f75-4ed4-9ef5-5ee80e54d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:43.925698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee84ca-2f75-4ed4-9ef5-5ee80e54d53a None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:43.925974 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee84ca-2f75-4ed4-9ef5-5ee80e54d53a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:43.926240 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee84ca-2f75-4ed4-9ef5-5ee80e54d53a None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:43.926888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee84ca-2f75-4ed4-9ef5-5ee80e54d53a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:43.928304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee84ca-2f75-4ed4-9ef5-5ee80e54d53a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:44.003967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 553/1110] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:22:43 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:22:46.165475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05aa7f-0b9b-4efa-9dfd-65efeaec41de None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:46.165933 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05aa7f-0b9b-4efa-9dfd-65efeaec41de None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:46.166031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05aa7f-0b9b-4efa-9dfd-65efeaec41de None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:46.167349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 558/1111] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:46.173209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0e312-2690-4770-8735-729ca91aeddf None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:46.173639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0e312-2690-4770-8735-729ca91aeddf None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:46.173732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0e312-2690-4770-8735-729ca91aeddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:46.192036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-54b0e312-2690-4770-8735-729ca91aeddf None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:46.193231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-54b0e312-2690-4770-8735-729ca91aeddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:46.257053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 554/1112] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:46.522054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05aa7f-0b9b-4efa-9dfd-65efeaec41de None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:46.621737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05aa7f-0b9b-4efa-9dfd-65efeaec41de None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:46.654538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d87cf-c34b-4d56-98f3-6840e9180886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:46.655140 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d87cf-c34b-4d56-98f3-6840e9180886 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:46.656063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d87cf-c34b-4d56-98f3-6840e9180886 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:46.656302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d87cf-c34b-4d56-98f3-6840e9180886 None admin] PATH_INFO: `/v3/roles/22f7e3b007984ad79378413e11b1a86f` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:46.657704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d87cf-c34b-4d56-98f3-6840e9180886 None admin] RBAC: Authorizing `identity:get_role(role_id=22f7e3b007984ad79378413e11b1a86f)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:46.659050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d87cf-c34b-4d56-98f3-6840e9180886 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:46.660404 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 559/1113] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:22:46 2022] GET /identity/v3/roles/22f7e3b007984ad79378413e11b1a86f => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:46.666258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0e312-2690-4770-8735-729ca91aeddf None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:46.759144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:46.767759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0e312-2690-4770-8735-729ca91aeddf None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:46.801094 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b022e-b393-4255-baea-edd083a9e547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:46.801709 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b022e-b393-4255-baea-edd083a9e547 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:46.801987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b022e-b393-4255-baea-edd083a9e547 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:46.802267 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b022e-b393-4255-baea-edd083a9e547 None admin] PATH_INFO: `/v3/users/5dbf3be206fd453e8f7bb6d3d3fbcbfe` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:46.815118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b022e-b393-4255-baea-edd083a9e547 None admin] RBAC: Authorizing `identity:get_user(user_id=5dbf3be206fd453e8f7bb6d3d3fbcbfe)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:46.816552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b022e-b393-4255-baea-edd083a9e547 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:46.818169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 555/1114] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:22:46 2022] GET /identity/v3/users/5dbf3be206fd453e8f7bb6d3d3fbcbfe => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:22:46.823934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d87cf-c34b-4d56-98f3-6840e9180886 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:46.889636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:46.923649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d87cf-c34b-4d56-98f3-6840e9180886 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:46.956735 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70082fa-b41c-4f22-a497-c714d389f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:46.957364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70082fa-b41c-4f22-a497-c714d389f2bc None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:46.957643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70082fa-b41c-4f22-a497-c714d389f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:46.957916 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70082fa-b41c-4f22-a497-c714d389f2bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:47.024863 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70082fa-b41c-4f22-a497-c714d389f2bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:47.026331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70082fa-b41c-4f22-a497-c714d389f2bc None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:47.089898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:47.122913 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 560/1115] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:22:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:22:47.129480 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b022e-b393-4255-baea-edd083a9e547 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:47.226568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b022e-b393-4255-baea-edd083a9e547 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:47.259616 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be51187-db01-4e24-9cc9-5f596e016a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:47.260224 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be51187-db01-4e24-9cc9-5f596e016a54 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:47.260493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be51187-db01-4e24-9cc9-5f596e016a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:47.260757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be51187-db01-4e24-9cc9-5f596e016a54 None admin] PATH_INFO: `/v3/projects/b115511a33cc47ffb914b3c3792d8b1f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:47.261877 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be51187-db01-4e24-9cc9-5f596e016a54 None admin] RBAC: Authorizing `identity:get_project(project_id=b115511a33cc47ffb914b3c3792d8b1f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:47.263294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be51187-db01-4e24-9cc9-5f596e016a54 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:47.265798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 556/1116] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:22:47 2022] GET /identity/v3/projects/b115511a33cc47ffb914b3c3792d8b1f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:47.271722 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70082fa-b41c-4f22-a497-c714d389f2bc None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:47.366238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70082fa-b41c-4f22-a497-c714d389f2bc None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:47.399987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33f557-45ce-4153-b03a-7912cca26ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:47.400574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33f557-45ce-4153-b03a-7912cca26ebf None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:47.400849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33f557-45ce-4153-b03a-7912cca26ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:47.401190 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33f557-45ce-4153-b03a-7912cca26ebf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:47.401899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33f557-45ce-4153-b03a-7912cca26ebf None admin] RBAC: Adding query filter params (role.id=22f7e3b007984ad79378413e11b1a86f, scope.project.id=b115511a33cc47ffb914b3c3792d8b1f, user.id=5dbf3be206fd453e8f7bb6d3d3fbcbfe) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:47.402202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33f557-45ce-4153-b03a-7912cca26ebf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:47.403608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33f557-45ce-4153-b03a-7912cca26ebf None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:47.408882 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 561/1117] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:22:47 2022] GET /identity/v3/role_assignments?user.id=5dbf3be206fd453e8f7bb6d3d3fbcbfe&scope.project.id=b115511a33cc47ffb914b3c3792d8b1f&role.id=22f7e3b007984ad79378413e11b1a86f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:49.501597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e69cdd-f0cc-4047-9671-263dd135cd3b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:49.502107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e69cdd-f0cc-4047-9671-263dd135cd3b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:49.502107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e69cdd-f0cc-4047-9671-263dd135cd3b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:49.503380 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 557/1118] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:49.508693 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519096cb-0823-48fe-96c7-e187a3532921 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:49.509202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519096cb-0823-48fe-96c7-e187a3532921 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:49.509292 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519096cb-0823-48fe-96c7-e187a3532921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:49.526946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-519096cb-0823-48fe-96c7-e187a3532921 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:49.528123 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-519096cb-0823-48fe-96c7-e187a3532921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:49.553788 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:49.592482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 562/1119] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:49.862273 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e69cdd-f0cc-4047-9671-263dd135cd3b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:49.884372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:49.959881 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e69cdd-f0cc-4047-9671-263dd135cd3b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:49.992578 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef378d4-831b-4e91-b6d3-2d426e01916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:49.993236 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef378d4-831b-4e91-b6d3-2d426e01916a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:49.993515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef378d4-831b-4e91-b6d3-2d426e01916a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:49.993782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef378d4-831b-4e91-b6d3-2d426e01916a None admin] PATH_INFO: `/v3/roles/22f7e3b007984ad79378413e11b1a86f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:49.995156 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef378d4-831b-4e91-b6d3-2d426e01916a None admin] RBAC: Authorizing `identity:get_role(role_id=22f7e3b007984ad79378413e11b1a86f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:49.996521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef378d4-831b-4e91-b6d3-2d426e01916a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:49.997880 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 558/1120] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:22:49 2022] GET /identity/v3/roles/22f7e3b007984ad79378413e11b1a86f => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:50.004342 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519096cb-0823-48fe-96c7-e187a3532921 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:50.099056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519096cb-0823-48fe-96c7-e187a3532921 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:50.131770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe43965-7220-439e-8269-68907e5cfda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:50.132315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe43965-7220-439e-8269-68907e5cfda0 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:50.132592 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe43965-7220-439e-8269-68907e5cfda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:50.132861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe43965-7220-439e-8269-68907e5cfda0 None admin] PATH_INFO: `/v3/users/5dbf3be206fd453e8f7bb6d3d3fbcbfe` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:50.133982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe43965-7220-439e-8269-68907e5cfda0 None admin] RBAC: Authorizing `identity:get_user(user_id=5dbf3be206fd453e8f7bb6d3d3fbcbfe)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:50.135398 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe43965-7220-439e-8269-68907e5cfda0 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:50.136935 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 563/1121] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:22:50 2022] GET /identity/v3/users/5dbf3be206fd453e8f7bb6d3d3fbcbfe => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:50.142587 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef378d4-831b-4e91-b6d3-2d426e01916a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:50.227164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:50.239126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef378d4-831b-4e91-b6d3-2d426e01916a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:50.271929 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840344e-f91e-47d1-b02d-a314833b9e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:50.272541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840344e-f91e-47d1-b02d-a314833b9e3a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:50.272813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840344e-f91e-47d1-b02d-a314833b9e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:50.273106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840344e-f91e-47d1-b02d-a314833b9e3a None admin] PATH_INFO: `/v3/projects/b115511a33cc47ffb914b3c3792d8b1f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:50.274192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840344e-f91e-47d1-b02d-a314833b9e3a None admin] RBAC: Authorizing `identity:get_project(project_id=b115511a33cc47ffb914b3c3792d8b1f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:50.275616 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840344e-f91e-47d1-b02d-a314833b9e3a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:50.277252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 559/1122] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:22:50 2022] GET /identity/v3/projects/b115511a33cc47ffb914b3c3792d8b1f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:50.283698 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe43965-7220-439e-8269-68907e5cfda0 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:50.313307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:50.380689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe43965-7220-439e-8269-68907e5cfda0 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:50.413659 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79388d-98c4-40f5-9c53-66af49331f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:50.414247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79388d-98c4-40f5-9c53-66af49331f15 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:50.414524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79388d-98c4-40f5-9c53-66af49331f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:50.414793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79388d-98c4-40f5-9c53-66af49331f15 None admin] PATH_INFO: `/v3/projects/b115511a33cc47ffb914b3c3792d8b1f/users/5dbf3be206fd453e8f7bb6d3d3fbcbfe/roles/22f7e3b007984ad79378413e11b1a86f` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:50.416899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79388d-98c4-40f5-9c53-66af49331f15 None admin] RBAC: Authorizing `identity:create_grant(project_id=b115511a33cc47ffb914b3c3792d8b1f, user_id=5dbf3be206fd453e8f7bb6d3d3fbcbfe, role_id=22f7e3b007984ad79378413e11b1a86f)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:50.418339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79388d-98c4-40f5-9c53-66af49331f15 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:50.505732 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 564/1123] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:22:50 2022] PUT /identity/v3/projects/b115511a33cc47ffb914b3c3792d8b1f/users/5dbf3be206fd453e8f7bb6d3d3fbcbfe/roles/22f7e3b007984ad79378413e11b1a86f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:22:52.644473 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd68bb-6fb3-40c5-b0e7-4a722c92a441 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:52.645031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd68bb-6fb3-40c5-b0e7-4a722c92a441 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:52.645031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd68bb-6fb3-40c5-b0e7-4a722c92a441 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:52.646376 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 560/1124] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:52.651480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4dd2d-8cca-4057-be94-10709e022870 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:52.651851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4dd2d-8cca-4057-be94-10709e022870 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:52.652015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4dd2d-8cca-4057-be94-10709e022870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:52.670140 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-34c4dd2d-8cca-4057-be94-10709e022870 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:52.671941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-34c4dd2d-8cca-4057-be94-10709e022870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:52.737447 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 565/1125] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:53.008968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd68bb-6fb3-40c5-b0e7-4a722c92a441 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:53.107940 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd68bb-6fb3-40c5-b0e7-4a722c92a441 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:53.140789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c76d4-739c-4479-b674-0fe7a91babb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:53.141428 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c76d4-739c-4479-b674-0fe7a91babb0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:53.141705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c76d4-739c-4479-b674-0fe7a91babb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:53.141973 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c76d4-739c-4479-b674-0fe7a91babb0 None admin] PATH_INFO: `/v3/roles/22f7e3b007984ad79378413e11b1a86f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:53.143351 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c76d4-739c-4479-b674-0fe7a91babb0 None admin] RBAC: Authorizing `identity:get_role(role_id=22f7e3b007984ad79378413e11b1a86f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:53.144710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c76d4-739c-4479-b674-0fe7a91babb0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:53.146048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 561/1126] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:22:53 2022] GET /identity/v3/roles/22f7e3b007984ad79378413e11b1a86f => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:53.151847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4dd2d-8cca-4057-be94-10709e022870 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:53.173361 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:53.248089 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4dd2d-8cca-4057-be94-10709e022870 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:53.281037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144e325-b43b-4793-b485-400383b7b2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:53.281581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e325-b43b-4793-b485-400383b7b2cc None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:53.281855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e325-b43b-4793-b485-400383b7b2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:53.282124 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e325-b43b-4793-b485-400383b7b2cc None admin] PATH_INFO: `/v3/users/5dbf3be206fd453e8f7bb6d3d3fbcbfe` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:53.283231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144e325-b43b-4793-b485-400383b7b2cc None admin] RBAC: Authorizing `identity:get_user(user_id=5dbf3be206fd453e8f7bb6d3d3fbcbfe)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:53.284690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144e325-b43b-4793-b485-400383b7b2cc None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:53.286257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 566/1127] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:22:53 2022] GET /identity/v3/users/5dbf3be206fd453e8f7bb6d3d3fbcbfe => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:53.292140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c76d4-739c-4479-b674-0fe7a91babb0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:53.316758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:53.388401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c76d4-739c-4479-b674-0fe7a91babb0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:53.421330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b4395-147e-417d-825d-76183550fdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:53.421915 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b4395-147e-417d-825d-76183550fdd3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:53.422188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b4395-147e-417d-825d-76183550fdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:53.422455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b4395-147e-417d-825d-76183550fdd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:53.486310 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b4395-147e-417d-825d-76183550fdd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:53.487738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b4395-147e-417d-825d-76183550fdd3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:53.510201 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:53.581718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 562/1128] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:22:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:22:53.587621 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144e325-b43b-4793-b485-400383b7b2cc None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:53.671977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:53.683256 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144e325-b43b-4793-b485-400383b7b2cc None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:53.715933 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bad9a-ea60-4ffc-aded-c05d18322662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:53.716542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bad9a-ea60-4ffc-aded-c05d18322662 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:53.716818 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bad9a-ea60-4ffc-aded-c05d18322662 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:53.717135 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bad9a-ea60-4ffc-aded-c05d18322662 None admin] PATH_INFO: `/v3/projects/b115511a33cc47ffb914b3c3792d8b1f` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:53.718324 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bad9a-ea60-4ffc-aded-c05d18322662 None admin] RBAC: Authorizing `identity:get_project(project_id=b115511a33cc47ffb914b3c3792d8b1f)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:53.719739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bad9a-ea60-4ffc-aded-c05d18322662 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:53.721370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 567/1129] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:22:53 2022] GET /identity/v3/projects/b115511a33cc47ffb914b3c3792d8b1f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:53.727500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b4395-147e-417d-825d-76183550fdd3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:53.822664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b4395-147e-417d-825d-76183550fdd3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:53.845059 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:53.855090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cf3c5-70a4-4ad0-a350-2a11ae004fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:53.860287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cf3c5-70a4-4ad0-a350-2a11ae004fcc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:53.860287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cf3c5-70a4-4ad0-a350-2a11ae004fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:53.860287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cf3c5-70a4-4ad0-a350-2a11ae004fcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:53.860287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cf3c5-70a4-4ad0-a350-2a11ae004fcc None admin] RBAC: Adding query filter params (role.id=22f7e3b007984ad79378413e11b1a86f, scope.project.id=b115511a33cc47ffb914b3c3792d8b1f, user.id=5dbf3be206fd453e8f7bb6d3d3fbcbfe) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:22:53.860287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cf3c5-70a4-4ad0-a350-2a11ae004fcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:53.860287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cf3c5-70a4-4ad0-a350-2a11ae004fcc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:53.864750 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 563/1130] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:22:53 2022] GET /identity/v3/role_assignments?user.id=5dbf3be206fd453e8f7bb6d3d3fbcbfe&scope.project.id=b115511a33cc47ffb914b3c3792d8b1f&role.id=22f7e3b007984ad79378413e11b1a86f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:56.074665 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37a720-f17e-46bb-ae5c-3de398b39cc8 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:56.075314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37a720-f17e-46bb-ae5c-3de398b39cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:56.075314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37a720-f17e-46bb-ae5c-3de398b39cc8 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:56.076564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 568/1131] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:56.082562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7e258-48be-4e55-830d-cc72073d857b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:56.082965 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7e258-48be-4e55-830d-cc72073d857b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:56.083105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7e258-48be-4e55-830d-cc72073d857b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:56.101248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-65a7e258-48be-4e55-830d-cc72073d857b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:56.102426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-65a7e258-48be-4e55-830d-cc72073d857b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:56.167584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 564/1132] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:56.433372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37a720-f17e-46bb-ae5c-3de398b39cc8 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:56.531764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37a720-f17e-46bb-ae5c-3de398b39cc8 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:56.563269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bc33a-49f8-450e-8d22-15bdb40a79cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:56.563877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bc33a-49f8-450e-8d22-15bdb40a79cf None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:56.564152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bc33a-49f8-450e-8d22-15bdb40a79cf None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:56.564421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bc33a-49f8-450e-8d22-15bdb40a79cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:56.565538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bc33a-49f8-450e-8d22-15bdb40a79cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:56.566962 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bc33a-49f8-450e-8d22-15bdb40a79cf None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:56.568495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 569/1133] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:56.574164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7e258-48be-4e55-830d-cc72073d857b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:56.670244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7e258-48be-4e55-830d-cc72073d857b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:56.686826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:56.703377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06936d65-3da4-4863-b66a-db3ce557fed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:56.708812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06936d65-3da4-4863-b66a-db3ce557fed6 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:56.708812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06936d65-3da4-4863-b66a-db3ce557fed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:56.708812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06936d65-3da4-4863-b66a-db3ce557fed6 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:56.708812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06936d65-3da4-4863-b66a-db3ce557fed6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:56.708812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06936d65-3da4-4863-b66a-db3ce557fed6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:56.791751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 565/1134] 10.222.0.50 () {60 vars in 1141 bytes} [Sat Sep 17 04:22:56 2022] POST /identity/v3/projects => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:22:58.959735 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054fc4a-59a8-4963-9cf7-8f58d292aec1 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:58.960295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054fc4a-59a8-4963-9cf7-8f58d292aec1 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:58.960295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054fc4a-59a8-4963-9cf7-8f58d292aec1 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:58.961654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 570/1135] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:22:58.966896 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58a59-fa53-49a7-9b2e-05402bd71b46 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:58.967304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58a59-fa53-49a7-9b2e-05402bd71b46 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:58.967437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58a59-fa53-49a7-9b2e-05402bd71b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:58.986012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-efd58a59-fa53-49a7-9b2e-05402bd71b46 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:22:58.987178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-efd58a59-fa53-49a7-9b2e-05402bd71b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:22:59.050648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 566/1136] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:22:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:22:59.327657 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054fc4a-59a8-4963-9cf7-8f58d292aec1 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:59.352252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:59.428178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054fc4a-59a8-4963-9cf7-8f58d292aec1 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:59.461276 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57009b48-3700-4014-bdb9-734ab3c3654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:59.461891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57009b48-3700-4014-bdb9-734ab3c3654a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:59.462170 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57009b48-3700-4014-bdb9-734ab3c3654a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:59.462441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57009b48-3700-4014-bdb9-734ab3c3654a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:59.463545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57009b48-3700-4014-bdb9-734ab3c3654a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:59.464965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57009b48-3700-4014-bdb9-734ab3c3654a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:59.466542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 571/1137] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:22:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:22:59.472447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58a59-fa53-49a7-9b2e-05402bd71b46 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:22:59.564584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:22:59.567440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58a59-fa53-49a7-9b2e-05402bd71b46 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:22:59.600627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3462f6-f83c-4673-a1f7-ecc16677e98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:22:59.601200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3462f6-f83c-4673-a1f7-ecc16677e98a None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:22:59.601478 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3462f6-f83c-4673-a1f7-ecc16677e98a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:22:59.601747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3462f6-f83c-4673-a1f7-ecc16677e98a None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:22:59.602394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3462f6-f83c-4673-a1f7-ecc16677e98a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:22:59.603811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3462f6-f83c-4673-a1f7-ecc16677e98a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:22:59.677100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 567/1138] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:22:59 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:23:01.840742 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f9da7-30d8-4c7c-bf53-22eb0827f749 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:01.841325 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f9da7-30d8-4c7c-bf53-22eb0827f749 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:01.841325 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f9da7-30d8-4c7c-bf53-22eb0827f749 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:01.843214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 572/1139] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:23:01.848473 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731bf31-92fb-4e23-96a1-999c03fbe0a0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:01.848894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731bf31-92fb-4e23-96a1-999c03fbe0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:01.849224 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731bf31-92fb-4e23-96a1-999c03fbe0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:01.866886 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c731bf31-92fb-4e23-96a1-999c03fbe0a0 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:23:01.868053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c731bf31-92fb-4e23-96a1-999c03fbe0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:23:01.932489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 568/1140] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:23:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:23:02.202495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f9da7-30d8-4c7c-bf53-22eb0827f749 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:02.291353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:02.300592 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f9da7-30d8-4c7c-bf53-22eb0827f749 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:02.333934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe142ab3-687e-474d-9f88-0e349955ef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:02.334553 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe142ab3-687e-474d-9f88-0e349955ef74 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:02.334829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe142ab3-687e-474d-9f88-0e349955ef74 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:02.335099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe142ab3-687e-474d-9f88-0e349955ef74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:02.344835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe142ab3-687e-474d-9f88-0e349955ef74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-fe142ab3-687e-474d-9f88-0e349955ef74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:23:02.349773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:23:02.350917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:23:02.351850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:23:02.351850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:23:02.351850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:23:02.351850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:23:02.351850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:23:02.351850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:23:02.351850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:23:02.351850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:23:02.351850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:23:02.351850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:23:02.351850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:23:02.351850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:23:02.351850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 573/1141] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:23:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:23:02.357217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731bf31-92fb-4e23-96a1-999c03fbe0a0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:02.440109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:02.454248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731bf31-92fb-4e23-96a1-999c03fbe0a0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:02.487859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41343c4-5187-41da-a66c-c3a086e6e109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:02.488457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41343c4-5187-41da-a66c-c3a086e6e109 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:02.488734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41343c4-5187-41da-a66c-c3a086e6e109 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:02.489025 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41343c4-5187-41da-a66c-c3a086e6e109 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:02.489696 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41343c4-5187-41da-a66c-c3a086e6e109 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:23:02.490000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41343c4-5187-41da-a66c-c3a086e6e109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:02.491367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41343c4-5187-41da-a66c-c3a086e6e109 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:02.499765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 569/1142] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:23:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:02.505979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe142ab3-687e-474d-9f88-0e349955ef74 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:02.602731 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe142ab3-687e-474d-9f88-0e349955ef74 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:02.636258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b73d10-590c-4533-9ac4-e1caf253c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:02.636870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b73d10-590c-4533-9ac4-e1caf253c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:02.637177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b73d10-590c-4533-9ac4-e1caf253c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:02.637449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b73d10-590c-4533-9ac4-e1caf253c7b8 None admin] PATH_INFO: `/v3/users/3bd4dcd3f6364f0c9f167c50074dd3ba` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:02.650183 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b73d10-590c-4533-9ac4-e1caf253c7b8 None admin] RBAC: Authorizing `identity:get_user(user_id=3bd4dcd3f6364f0c9f167c50074dd3ba)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:02.651613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b73d10-590c-4533-9ac4-e1caf253c7b8 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:02.653260 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 574/1143] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:23:02 2022] GET /identity/v3/users/3bd4dcd3f6364f0c9f167c50074dd3ba => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:02.659342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41343c4-5187-41da-a66c-c3a086e6e109 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:02.754710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41343c4-5187-41da-a66c-c3a086e6e109 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:02.788349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ce7cf-fcfb-4e41-b877-631abb8bbe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:02.788959 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ce7cf-fcfb-4e41-b877-631abb8bbe3e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:02.789276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ce7cf-fcfb-4e41-b877-631abb8bbe3e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:02.789545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ce7cf-fcfb-4e41-b877-631abb8bbe3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:02.809621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:02.860095 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ce7cf-fcfb-4e41-b877-631abb8bbe3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:02.861577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ce7cf-fcfb-4e41-b877-631abb8bbe3e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:02.964611 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 570/1144] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:23:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:23:02.971337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b73d10-590c-4533-9ac4-e1caf253c7b8 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:02.983985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:03.069740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b73d10-590c-4533-9ac4-e1caf253c7b8 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:03.101673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde55b5e-1bd8-43af-8bae-f6168dae5976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:03.102288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde55b5e-1bd8-43af-8bae-f6168dae5976 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:03.102559 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde55b5e-1bd8-43af-8bae-f6168dae5976 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:03.102825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde55b5e-1bd8-43af-8bae-f6168dae5976 None admin] PATH_INFO: `/v3/projects/d6aa463a45354aa792413d603a790cda` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:03.103910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde55b5e-1bd8-43af-8bae-f6168dae5976 None admin] RBAC: Authorizing `identity:get_project(project_id=d6aa463a45354aa792413d603a790cda)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:03.105355 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde55b5e-1bd8-43af-8bae-f6168dae5976 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:03.107070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 575/1145] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:23:02 2022] GET /identity/v3/projects/d6aa463a45354aa792413d603a790cda => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:03.114076 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ce7cf-fcfb-4e41-b877-631abb8bbe3e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:03.161574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:03.212055 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ce7cf-fcfb-4e41-b877-631abb8bbe3e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:03.244549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938e9a8-6b33-4f77-9226-631f3c2c50a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:03.245167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938e9a8-6b33-4f77-9226-631f3c2c50a4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:03.245441 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938e9a8-6b33-4f77-9226-631f3c2c50a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:03.245705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938e9a8-6b33-4f77-9226-631f3c2c50a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:03.246420 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938e9a8-6b33-4f77-9226-631f3c2c50a4 None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=d6aa463a45354aa792413d603a790cda, user.id=3bd4dcd3f6364f0c9f167c50074dd3ba) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:23:03.246722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938e9a8-6b33-4f77-9226-631f3c2c50a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:03.248156 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938e9a8-6b33-4f77-9226-631f3c2c50a4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:03.253320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 571/1146] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:23:03 2022] GET /identity/v3/role_assignments?user.id=3bd4dcd3f6364f0c9f167c50074dd3ba&scope.project.id=d6aa463a45354aa792413d603a790cda&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:05.338514 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeffa9-283e-40b0-a978-75e120352b86 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:05.339063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeffa9-283e-40b0-a978-75e120352b86 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:05.339063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeffa9-283e-40b0-a978-75e120352b86 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:05.340355 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 576/1147] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:23:05.346246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a046-e652-4c64-9006-ab77db78d3df None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:05.346661 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a046-e652-4c64-9006-ab77db78d3df None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:05.346770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a046-e652-4c64-9006-ab77db78d3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:05.365079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b638a046-e652-4c64-9006-ab77db78d3df None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:23:05.366286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b638a046-e652-4c64-9006-ab77db78d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:23:05.430119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 572/1148] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:23:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:23:05.701225 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afeffa9-283e-40b0-a978-75e120352b86 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:05.777582 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:05.798928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afeffa9-283e-40b0-a978-75e120352b86 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:05.831369 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e067be-9dc7-4f19-87b3-42c79fda0a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:05.831973 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e067be-9dc7-4f19-87b3-42c79fda0a53 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:05.832246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e067be-9dc7-4f19-87b3-42c79fda0a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:05.832513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e067be-9dc7-4f19-87b3-42c79fda0a53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:05.842597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e067be-9dc7-4f19-87b3-42c79fda0a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-e0e067be-9dc7-4f19-87b3-42c79fda0a53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:23:05.847231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:23:05.848295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:23:05.849335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:23:05.849335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:23:05.849335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:23:05.849335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:23:05.849335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:23:05.849335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:23:05.849335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:23:05.849335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:23:05.849335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:23:05.849335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:23:05.849335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:23:05.849335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:23:05.849335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 577/1149] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:23:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:23:05.854280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638a046-e652-4c64-9006-ab77db78d3df None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:05.896326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:05.950050 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638a046-e652-4c64-9006-ab77db78d3df None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:05.982966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb49d7-c52d-49ac-b872-ea4165376788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:05.983492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb49d7-c52d-49ac-b872-ea4165376788 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:05.983764 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb49d7-c52d-49ac-b872-ea4165376788 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:05.984029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb49d7-c52d-49ac-b872-ea4165376788 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:05.984676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb49d7-c52d-49ac-b872-ea4165376788 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:23:05.984972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb49d7-c52d-49ac-b872-ea4165376788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:05.986354 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb49d7-c52d-49ac-b872-ea4165376788 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:05.994007 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 573/1150] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:23:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:05.999813 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e067be-9dc7-4f19-87b3-42c79fda0a53 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:06.096408 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e067be-9dc7-4f19-87b3-42c79fda0a53 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:06.129123 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487df1a-1e10-496e-a0c9-dad3f05b1452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:06.129737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487df1a-1e10-496e-a0c9-dad3f05b1452 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:06.130013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487df1a-1e10-496e-a0c9-dad3f05b1452 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:06.130284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487df1a-1e10-496e-a0c9-dad3f05b1452 None admin] PATH_INFO: `/v3/users/3bd4dcd3f6364f0c9f167c50074dd3ba` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:06.131381 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487df1a-1e10-496e-a0c9-dad3f05b1452 None admin] RBAC: Authorizing `identity:get_user(user_id=3bd4dcd3f6364f0c9f167c50074dd3ba)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:06.132806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487df1a-1e10-496e-a0c9-dad3f05b1452 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:06.134393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 578/1151] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:23:05 2022] GET /identity/v3/users/3bd4dcd3f6364f0c9f167c50074dd3ba => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:06.140293 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb49d7-c52d-49ac-b872-ea4165376788 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:06.238772 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb49d7-c52d-49ac-b872-ea4165376788 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:06.241053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:06.273556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00be2a-92f9-4364-8b9f-be40ae5a96a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:06.274178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00be2a-92f9-4364-8b9f-be40ae5a96a8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:06.274457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00be2a-92f9-4364-8b9f-be40ae5a96a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:06.274726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00be2a-92f9-4364-8b9f-be40ae5a96a8 None admin] PATH_INFO: `/v3/projects/d6aa463a45354aa792413d603a790cda` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:06.275842 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00be2a-92f9-4364-8b9f-be40ae5a96a8 None admin] RBAC: Authorizing `identity:get_project(project_id=d6aa463a45354aa792413d603a790cda)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:06.277315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00be2a-92f9-4364-8b9f-be40ae5a96a8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:06.278950 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 574/1152] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:23:06 2022] GET /identity/v3/projects/d6aa463a45354aa792413d603a790cda => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:06.285370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487df1a-1e10-496e-a0c9-dad3f05b1452 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:06.293878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:06.379970 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487df1a-1e10-496e-a0c9-dad3f05b1452 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:06.412511 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59962ec-da78-4bd2-a207-56e2a08fb4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:06.413175 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59962ec-da78-4bd2-a207-56e2a08fb4d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:06.413450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59962ec-da78-4bd2-a207-56e2a08fb4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:06.413716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59962ec-da78-4bd2-a207-56e2a08fb4d8 None admin] PATH_INFO: `/v3/projects/d6aa463a45354aa792413d603a790cda/users/3bd4dcd3f6364f0c9f167c50074dd3ba/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:06.415567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59962ec-da78-4bd2-a207-56e2a08fb4d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6aa463a45354aa792413d603a790cda, user_id=3bd4dcd3f6364f0c9f167c50074dd3ba, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:06.416972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59962ec-da78-4bd2-a207-56e2a08fb4d8 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:06.475713 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 579/1153] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:23:06 2022] PUT /identity/v3/projects/d6aa463a45354aa792413d603a790cda/users/3bd4dcd3f6364f0c9f167c50074dd3ba/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:23:08.647270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631da1-078b-40b9-93b0-96583584b8bd None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:08.647822 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631da1-078b-40b9-93b0-96583584b8bd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:08.647822 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631da1-078b-40b9-93b0-96583584b8bd None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:08.649187 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 575/1154] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:23:08.654446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bf53b-0038-4dc3-b259-785212d5fbd7 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:08.654840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bf53b-0038-4dc3-b259-785212d5fbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:08.654985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bf53b-0038-4dc3-b259-785212d5fbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:08.673764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-fb9bf53b-0038-4dc3-b259-785212d5fbd7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:23:08.674927 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-fb9bf53b-0038-4dc3-b259-785212d5fbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:23:08.731518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:08.738987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 580/1155] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:23:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:23:09.005169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89631da1-078b-40b9-93b0-96583584b8bd None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:09.102176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89631da1-078b-40b9-93b0-96583584b8bd None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:09.135255 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a5572-0eb7-418b-81c3-55d9ab2f6a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:09.135871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a5572-0eb7-418b-81c3-55d9ab2f6a41 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:09.136146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a5572-0eb7-418b-81c3-55d9ab2f6a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:09.136415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a5572-0eb7-418b-81c3-55d9ab2f6a41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:09.146726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a5572-0eb7-418b-81c3-55d9ab2f6a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-d13a5572-0eb7-418b-81c3-55d9ab2f6a41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:23:09.151547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:23:09.152640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:23:09.153568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:23:09.153568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:23:09.153568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:23:09.153568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:23:09.153568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:23:09.153568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:23:09.153568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:23:09.153568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:23:09.153568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:23:09.153568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:23:09.153568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:23:09.153568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:23:09.153568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 576/1156] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:23:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:23:09.159453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bf53b-0038-4dc3-b259-785212d5fbd7 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:09.254036 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bf53b-0038-4dc3-b259-785212d5fbd7 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:09.286725 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9523f-5974-4a61-8ee4-c872f1cda885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:09.287253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9523f-5974-4a61-8ee4-c872f1cda885 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:09.287524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9523f-5974-4a61-8ee4-c872f1cda885 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:09.287790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9523f-5974-4a61-8ee4-c872f1cda885 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:09.288443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9523f-5974-4a61-8ee4-c872f1cda885 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:23:09.288740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9523f-5974-4a61-8ee4-c872f1cda885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:09.290121 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9523f-5974-4a61-8ee4-c872f1cda885 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:09.297976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 581/1157] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:23:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:09.303853 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a5572-0eb7-418b-81c3-55d9ab2f6a41 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:09.334383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:09.400043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a5572-0eb7-418b-81c3-55d9ab2f6a41 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:09.432019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b3fb4-7f5a-4c82-9082-81a96f909934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:09.432625 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b3fb4-7f5a-4c82-9082-81a96f909934 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:09.432899 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b3fb4-7f5a-4c82-9082-81a96f909934 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:09.433198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b3fb4-7f5a-4c82-9082-81a96f909934 None admin] PATH_INFO: `/v3/users/3bd4dcd3f6364f0c9f167c50074dd3ba` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:09.434311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b3fb4-7f5a-4c82-9082-81a96f909934 None admin] RBAC: Authorizing `identity:get_user(user_id=3bd4dcd3f6364f0c9f167c50074dd3ba)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:09.435779 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b3fb4-7f5a-4c82-9082-81a96f909934 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:09.437366 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 577/1158] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:23:09 2022] GET /identity/v3/users/3bd4dcd3f6364f0c9f167c50074dd3ba => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:09.443194 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9523f-5974-4a61-8ee4-c872f1cda885 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:09.503152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:09.546434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9523f-5974-4a61-8ee4-c872f1cda885 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:09.580644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a93a5-49b1-4717-9bfe-fd10ab2acf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:09.581265 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a93a5-49b1-4717-9bfe-fd10ab2acf25 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:09.581546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a93a5-49b1-4717-9bfe-fd10ab2acf25 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:09.581816 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a93a5-49b1-4717-9bfe-fd10ab2acf25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:09.647522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a93a5-49b1-4717-9bfe-fd10ab2acf25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:09.648950 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a93a5-49b1-4717-9bfe-fd10ab2acf25 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:09.702791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:09.742792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 582/1159] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:23:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:23:09.749232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b3fb4-7f5a-4c82-9082-81a96f909934 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:09.844718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:09.847584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b3fb4-7f5a-4c82-9082-81a96f909934 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:09.881087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75ff45-5d45-4fbe-ad8f-fc2c32726205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:09.881820 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75ff45-5d45-4fbe-ad8f-fc2c32726205 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:09.882146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75ff45-5d45-4fbe-ad8f-fc2c32726205 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:09.882702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75ff45-5d45-4fbe-ad8f-fc2c32726205 None admin] PATH_INFO: `/v3/projects/d6aa463a45354aa792413d603a790cda` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:09.883811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75ff45-5d45-4fbe-ad8f-fc2c32726205 None admin] RBAC: Authorizing `identity:get_project(project_id=d6aa463a45354aa792413d603a790cda)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:09.885258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75ff45-5d45-4fbe-ad8f-fc2c32726205 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:09.886863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 578/1160] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:23:09 2022] GET /identity/v3/projects/d6aa463a45354aa792413d603a790cda => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:09.893970 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a93a5-49b1-4717-9bfe-fd10ab2acf25 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:09.991396 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a93a5-49b1-4717-9bfe-fd10ab2acf25 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:10.024264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bc621-2a0e-4772-b641-a8876185d684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:10.024845 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bc621-2a0e-4772-b641-a8876185d684 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:10.025144 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bc621-2a0e-4772-b641-a8876185d684 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:10.025414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bc621-2a0e-4772-b641-a8876185d684 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:10.026123 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bc621-2a0e-4772-b641-a8876185d684 None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=d6aa463a45354aa792413d603a790cda, user.id=3bd4dcd3f6364f0c9f167c50074dd3ba) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:23:10.026423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bc621-2a0e-4772-b641-a8876185d684 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:10.027822 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bc621-2a0e-4772-b641-a8876185d684 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:10.033481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 583/1161] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:23:09 2022] GET /identity/v3/role_assignments?user.id=3bd4dcd3f6364f0c9f167c50074dd3ba&scope.project.id=d6aa463a45354aa792413d603a790cda&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:12.202214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce8f62-0da6-4718-ae84-ff09096866a3 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:12.202701 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce8f62-0da6-4718-ae84-ff09096866a3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:12.202791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce8f62-0da6-4718-ae84-ff09096866a3 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:12.204089 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 579/1162] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:23:12.209277 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48d17d-0b6d-4cf9-942e-d186556ae7f2 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:12.209654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48d17d-0b6d-4cf9-942e-d186556ae7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:12.209816 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48d17d-0b6d-4cf9-942e-d186556ae7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:12.228213 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2e48d17d-0b6d-4cf9-942e-d186556ae7f2 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:23:12.229474 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2e48d17d-0b6d-4cf9-942e-d186556ae7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:23:12.245220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:12.294060 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 584/1163] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:23:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:23:12.565595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce8f62-0da6-4718-ae84-ff09096866a3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:12.665318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce8f62-0da6-4718-ae84-ff09096866a3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:12.697873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64586d-3f54-4d84-bcf6-09fe5d7fec5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:12.698467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64586d-3f54-4d84-bcf6-09fe5d7fec5d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:12.698739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64586d-3f54-4d84-bcf6-09fe5d7fec5d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:12.699003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64586d-3f54-4d84-bcf6-09fe5d7fec5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:12.731876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:12.764145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64586d-3f54-4d84-bcf6-09fe5d7fec5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:12.765613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64586d-3f54-4d84-bcf6-09fe5d7fec5d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:12.859623 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 580/1164] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:23:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:23:12.865590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48d17d-0b6d-4cf9-942e-d186556ae7f2 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:12.963440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48d17d-0b6d-4cf9-942e-d186556ae7f2 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:12.995657 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97925a34-a917-404a-b854-cdf19386d2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:12.996268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97925a34-a917-404a-b854-cdf19386d2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:12.996538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97925a34-a917-404a-b854-cdf19386d2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:12.996800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97925a34-a917-404a-b854-cdf19386d2a9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:13.004580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97925a34-a917-404a-b854-cdf19386d2a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:13.006036 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97925a34-a917-404a-b854-cdf19386d2a9 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-97925a34-a917-404a-b854-cdf19386d2a9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:23:13.016934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:23:13.018142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:23:13.019205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 585/1165] 10.222.0.50 () {56 vars in 1117 bytes} [Sat Sep 17 04:23:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:23:13.024050 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64586d-3f54-4d84-bcf6-09fe5d7fec5d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:13.087356 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:13.118819 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64586d-3f54-4d84-bcf6-09fe5d7fec5d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:13.151787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61945fa5-31a5-479a-9d87-3354ace2cff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:13.152390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61945fa5-31a5-479a-9d87-3354ace2cff9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:13.152662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61945fa5-31a5-479a-9d87-3354ace2cff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:13.152926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61945fa5-31a5-479a-9d87-3354ace2cff9 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:13.153621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61945fa5-31a5-479a-9d87-3354ace2cff9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:23:13.153920 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61945fa5-31a5-479a-9d87-3354ace2cff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:13.155331 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61945fa5-31a5-479a-9d87-3354ace2cff9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:13.162624 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 581/1166] 10.222.0.50 () {56 vars in 1115 bytes} [Sat Sep 17 04:23:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:15.281092 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b227508-da16-4553-80f3-7818c39225df None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:15.281610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b227508-da16-4553-80f3-7818c39225df None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:15.281610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b227508-da16-4553-80f3-7818c39225df None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:15.282971 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 586/1167] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:23:15.288100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc5dca-7e4d-4125-8463-252dcb1bc7ab None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:15.288494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc5dca-7e4d-4125-8463-252dcb1bc7ab None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:15.288648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc5dca-7e4d-4125-8463-252dcb1bc7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:15.306380 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f8dc5dca-7e4d-4125-8463-252dcb1bc7ab None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:23:15.307546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f8dc5dca-7e4d-4125-8463-252dcb1bc7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:23:15.371644 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 582/1168] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:23:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:23:15.639209 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b227508-da16-4553-80f3-7818c39225df None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:15.655161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:15.743146 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b227508-da16-4553-80f3-7818c39225df None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:15.776540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a68324-85c3-4baf-9692-9c06c6da1a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:15.777171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a68324-85c3-4baf-9692-9c06c6da1a16 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:15.777453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a68324-85c3-4baf-9692-9c06c6da1a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:15.777727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a68324-85c3-4baf-9692-9c06c6da1a16 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:15.779408 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a68324-85c3-4baf-9692-9c06c6da1a16 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:15.780775 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a68324-85c3-4baf-9692-9c06c6da1a16 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:15.859940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 587/1169] 10.222.0.50 () {60 vars in 1138 bytes} [Sat Sep 17 04:23:15 2022] POST /identity/v3/domains => generated 267 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:23:18.021419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672ab40-7775-4918-9c99-45181f0911ae None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:18.021953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672ab40-7775-4918-9c99-45181f0911ae None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:18.021953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672ab40-7775-4918-9c99-45181f0911ae None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:18.023311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 583/1170] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:23:18.029214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37d59-0558-4c20-a174-8481a61d2632 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:18.029630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37d59-0558-4c20-a174-8481a61d2632 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:18.029760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37d59-0558-4c20-a174-8481a61d2632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:18.048127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-a2b37d59-0558-4c20-a174-8481a61d2632 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:23:18.049350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a2b37d59-0558-4c20-a174-8481a61d2632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:23:18.116749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 588/1171] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:23:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:23:18.391242 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672ab40-7775-4918-9c99-45181f0911ae None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:18.451461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:18.488638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672ab40-7775-4918-9c99-45181f0911ae None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:18.521010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb636d4-f8de-4e18-bd3b-cbf7b3d29b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:18.521637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb636d4-f8de-4e18-bd3b-cbf7b3d29b34 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:18.521909 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb636d4-f8de-4e18-bd3b-cbf7b3d29b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:18.522178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb636d4-f8de-4e18-bd3b-cbf7b3d29b34 None admin] PATH_INFO: `/v3/domains/b38e0cde3a9942b8b16513c670ea48a2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:18.532716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb636d4-f8de-4e18-bd3b-cbf7b3d29b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b38e0cde3a9942b8b16513c670ea48a2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:18.534184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb636d4-f8de-4e18-bd3b-cbf7b3d29b34 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:18.535732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 584/1172] 10.222.0.50 () {56 vars in 1183 bytes} [Sat Sep 17 04:23:18 2022] GET /identity/v3/domains/b38e0cde3a9942b8b16513c670ea48a2 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:18.541579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b37d59-0558-4c20-a174-8481a61d2632 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:18.543800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:18.638195 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b37d59-0558-4c20-a174-8481a61d2632 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:18.670311 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d8699-5029-47bc-b21c-fa665224f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:18.670852 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d8699-5029-47bc-b21c-fa665224f9ad None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:18.671131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d8699-5029-47bc-b21c-fa665224f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:18.671398 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d8699-5029-47bc-b21c-fa665224f9ad None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:18.672046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d8699-5029-47bc-b21c-fa665224f9ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:18.673517 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d8699-5029-47bc-b21c-fa665224f9ad None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:18.767876 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 589/1173] 10.222.0.50 () {60 vars in 1141 bytes} [Sat Sep 17 04:23:18 2022] POST /identity/v3/projects => generated 361 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:23:20.937052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04978fdb-2c75-47ea-8aa8-d5114191f046 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:20.937578 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04978fdb-2c75-47ea-8aa8-d5114191f046 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:20.937578 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04978fdb-2c75-47ea-8aa8-d5114191f046 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:20.938940 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 585/1174] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:23:20.944278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f431e7-f2fa-4a68-957a-371a4ed3706f None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:20.944649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f431e7-f2fa-4a68-957a-371a4ed3706f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:20.944835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f431e7-f2fa-4a68-957a-371a4ed3706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:20.962653 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-f7f431e7-f2fa-4a68-957a-371a4ed3706f None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:23:20.963831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f7f431e7-f2fa-4a68-957a-371a4ed3706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:23:21.012630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:21.029674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 590/1175] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:23:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:23:21.300018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04978fdb-2c75-47ea-8aa8-d5114191f046 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:21.398761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04978fdb-2c75-47ea-8aa8-d5114191f046 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:21.420310 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:21.431248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd99bd3-3702-4609-9091-febcdd5437b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:21.431863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd99bd3-3702-4609-9091-febcdd5437b5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:21.432135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd99bd3-3702-4609-9091-febcdd5437b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:21.432403 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd99bd3-3702-4609-9091-febcdd5437b5 None admin] PATH_INFO: `/v3/domains/b38e0cde3a9942b8b16513c670ea48a2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:21.433556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd99bd3-3702-4609-9091-febcdd5437b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b38e0cde3a9942b8b16513c670ea48a2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:21.435012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd99bd3-3702-4609-9091-febcdd5437b5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:21.436552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 586/1176] 10.222.0.50 () {56 vars in 1183 bytes} [Sat Sep 17 04:23:21 2022] GET /identity/v3/domains/b38e0cde3a9942b8b16513c670ea48a2 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:21.442394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f431e7-f2fa-4a68-957a-371a4ed3706f None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:21.537875 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f431e7-f2fa-4a68-957a-371a4ed3706f None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:21.569915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30794b7-9e82-4df1-a3f4-ae961bb31654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:21.570452 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30794b7-9e82-4df1-a3f4-ae961bb31654 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:21.570726 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30794b7-9e82-4df1-a3f4-ae961bb31654 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:21.570993 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30794b7-9e82-4df1-a3f4-ae961bb31654 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:21.571622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30794b7-9e82-4df1-a3f4-ae961bb31654 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:21.573050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30794b7-9e82-4df1-a3f4-ae961bb31654 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:21.645514 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 591/1177] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:23:21 2022] POST /identity/v3/users => generated 311 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:23:23.818497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b31831-07ae-440d-83d2-c89c11e84774 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:23.819100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b31831-07ae-440d-83d2-c89c11e84774 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:23.819100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b31831-07ae-440d-83d2-c89c11e84774 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:23.820393 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 587/1178] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:23:23.825677 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46423c1f-40d7-42a8-853a-33b0e2793af4 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:23.826222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46423c1f-40d7-42a8-853a-33b0e2793af4 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:23.826222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46423c1f-40d7-42a8-853a-33b0e2793af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:23.844727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-46423c1f-40d7-42a8-853a-33b0e2793af4 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:23:23.845923 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-46423c1f-40d7-42a8-853a-33b0e2793af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:23:23.878748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:23.909898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 592/1179] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:23:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:23:24.180079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b31831-07ae-440d-83d2-c89c11e84774 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:24.279656 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b31831-07ae-440d-83d2-c89c11e84774 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:24.312325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19215a-b408-424d-9724-30fccda6b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:24.312936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19215a-b408-424d-9724-30fccda6b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:24.313241 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19215a-b408-424d-9724-30fccda6b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:24.313510 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19215a-b408-424d-9724-30fccda6b7f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:24.323867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19215a-b408-424d-9724-30fccda6b7f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-fd19215a-b408-424d-9724-30fccda6b7f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:23:24.328667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:23:24.329792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:23:24.330803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:23:24.330803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:23:24.330803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:23:24.330803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:23:24.330803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:23:24.330803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:23:24.330803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:23:24.330803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:23:24.330803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:23:24.330803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:23:24.330803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:23:24.330803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:23:24.330803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 588/1180] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:23:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:23:24.335859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46423c1f-40d7-42a8-853a-33b0e2793af4 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:24.434045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46423c1f-40d7-42a8-853a-33b0e2793af4 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:24.467098 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb96a4a-29dd-4fd4-b339-26a5a5ea1c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:24.467793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb96a4a-29dd-4fd4-b339-26a5a5ea1c60 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:24.468074 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb96a4a-29dd-4fd4-b339-26a5a5ea1c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:24.468345 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb96a4a-29dd-4fd4-b339-26a5a5ea1c60 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:24.469020 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb96a4a-29dd-4fd4-b339-26a5a5ea1c60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:23:24.469320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb96a4a-29dd-4fd4-b339-26a5a5ea1c60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:24.470684 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb96a4a-29dd-4fd4-b339-26a5a5ea1c60 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:24.478605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 593/1181] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:23:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:24.485381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19215a-b408-424d-9724-30fccda6b7f9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:24.537525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:24.586467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19215a-b408-424d-9724-30fccda6b7f9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:24.620420 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fa243-626e-4bdd-9ad6-43bb8108e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:24.621051 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa243-626e-4bdd-9ad6-43bb8108e57f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:24.621331 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa243-626e-4bdd-9ad6-43bb8108e57f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:24.621597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa243-626e-4bdd-9ad6-43bb8108e57f None admin] PATH_INFO: `/v3/users/8183b9dd93484869a15391845bf4e245` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:24.634415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fa243-626e-4bdd-9ad6-43bb8108e57f None admin] RBAC: Authorizing `identity:get_user(user_id=8183b9dd93484869a15391845bf4e245)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:24.635851 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fa243-626e-4bdd-9ad6-43bb8108e57f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:24.637468 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 589/1182] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:23:24 2022] GET /identity/v3/users/8183b9dd93484869a15391845bf4e245 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:24.643587 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb96a4a-29dd-4fd4-b339-26a5a5ea1c60 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:24.674932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:24.740710 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb96a4a-29dd-4fd4-b339-26a5a5ea1c60 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:24.773146 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44e0a7-8aad-4264-a3c6-bc992b7bba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:24.773733 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44e0a7-8aad-4264-a3c6-bc992b7bba8b None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:24.774009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44e0a7-8aad-4264-a3c6-bc992b7bba8b None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:24.774280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44e0a7-8aad-4264-a3c6-bc992b7bba8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:24.839168 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44e0a7-8aad-4264-a3c6-bc992b7bba8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:24.840603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44e0a7-8aad-4264-a3c6-bc992b7bba8b None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:24.869462 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:24.935649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 594/1183] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:23:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:23:24.941548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fa243-626e-4bdd-9ad6-43bb8108e57f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:25.038226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fa243-626e-4bdd-9ad6-43bb8108e57f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:25.047091 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:25.070548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a315bee-6fbe-46cc-8526-aa74c842bc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:25.071163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a315bee-6fbe-46cc-8526-aa74c842bc8a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:25.071438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a315bee-6fbe-46cc-8526-aa74c842bc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:25.071706 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a315bee-6fbe-46cc-8526-aa74c842bc8a None admin] PATH_INFO: `/v3/projects/4b238eeb58824b1cbde9be906fc2377e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:25.072802 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a315bee-6fbe-46cc-8526-aa74c842bc8a None admin] RBAC: Authorizing `identity:get_project(project_id=4b238eeb58824b1cbde9be906fc2377e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:25.074267 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a315bee-6fbe-46cc-8526-aa74c842bc8a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:25.076404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 590/1184] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:23:24 2022] GET /identity/v3/projects/4b238eeb58824b1cbde9be906fc2377e => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:25.082442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44e0a7-8aad-4264-a3c6-bc992b7bba8b None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:25.179111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44e0a7-8aad-4264-a3c6-bc992b7bba8b None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:25.208704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:25.213560 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406e469-4a27-4678-94c7-1877dca9cecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:25.214174 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406e469-4a27-4678-94c7-1877dca9cecd None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:25.214458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406e469-4a27-4678-94c7-1877dca9cecd None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:25.214728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406e469-4a27-4678-94c7-1877dca9cecd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:25.215441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406e469-4a27-4678-94c7-1877dca9cecd None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=4b238eeb58824b1cbde9be906fc2377e, user.id=8183b9dd93484869a15391845bf4e245) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:23:25.215769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406e469-4a27-4678-94c7-1877dca9cecd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:25.218235 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406e469-4a27-4678-94c7-1877dca9cecd None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:25.223430 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 595/1185] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:23:25 2022] GET /identity/v3/role_assignments?user.id=8183b9dd93484869a15391845bf4e245&scope.project.id=4b238eeb58824b1cbde9be906fc2377e&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:27.434989 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a6117-459f-4865-afbb-37eedcd888f6 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:27.435538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a6117-459f-4865-afbb-37eedcd888f6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:27.435538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a6117-459f-4865-afbb-37eedcd888f6 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:27.436766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 591/1186] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:23:27.441957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408c706-e186-4577-9392-69f9690ae0cc None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:27.442461 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408c706-e186-4577-9392-69f9690ae0cc None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:27.442918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408c706-e186-4577-9392-69f9690ae0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:27.462778 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c408c706-e186-4577-9392-69f9690ae0cc None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:23:27.463959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c408c706-e186-4577-9392-69f9690ae0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:23:27.528841 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 596/1187] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:23:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:23:27.793654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a6117-459f-4865-afbb-37eedcd888f6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:27.890496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a6117-459f-4865-afbb-37eedcd888f6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:27.923188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a5645-b1f0-4691-ba28-6ab72f3e3276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:27.923794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a5645-b1f0-4691-ba28-6ab72f3e3276 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:27.924067 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a5645-b1f0-4691-ba28-6ab72f3e3276 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:27.924334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a5645-b1f0-4691-ba28-6ab72f3e3276 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:27.933946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a5645-b1f0-4691-ba28-6ab72f3e3276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-650a5645-b1f0-4691-ba28-6ab72f3e3276 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:23:27.938914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:23:27.940044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:23:27.941498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:23:27.941498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:23:27.941498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:23:27.941498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:23:27.941498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:23:27.941498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:23:27.941498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:23:27.941498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:23:27.941498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:23:27.941498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:23:27.941498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:23:27.941498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:23:27.941498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 592/1188] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:23:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:23:27.945827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408c706-e186-4577-9392-69f9690ae0cc None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:28.041296 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408c706-e186-4577-9392-69f9690ae0cc None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:28.065239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:28.073166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109e331-6b63-40d1-9eb6-2c5e22b0afe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:28.077145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109e331-6b63-40d1-9eb6-2c5e22b0afe0 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:28.077145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109e331-6b63-40d1-9eb6-2c5e22b0afe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:28.077145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109e331-6b63-40d1-9eb6-2c5e22b0afe0 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:28.077145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109e331-6b63-40d1-9eb6-2c5e22b0afe0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:23:28.077145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109e331-6b63-40d1-9eb6-2c5e22b0afe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:28.077145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109e331-6b63-40d1-9eb6-2c5e22b0afe0 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:28.084679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 597/1189] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:23:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:28.091827 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a5645-b1f0-4691-ba28-6ab72f3e3276 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:28.125307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:28.187765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a5645-b1f0-4691-ba28-6ab72f3e3276 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:28.222193 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972bfea-621d-4060-9bbc-f3f7e19b56a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:28.222801 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972bfea-621d-4060-9bbc-f3f7e19b56a2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:28.223076 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972bfea-621d-4060-9bbc-f3f7e19b56a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:28.223344 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972bfea-621d-4060-9bbc-f3f7e19b56a2 None admin] PATH_INFO: `/v3/users/8183b9dd93484869a15391845bf4e245` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:28.224455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972bfea-621d-4060-9bbc-f3f7e19b56a2 None admin] RBAC: Authorizing `identity:get_user(user_id=8183b9dd93484869a15391845bf4e245)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:28.225913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972bfea-621d-4060-9bbc-f3f7e19b56a2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:28.227469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 593/1190] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:23:28 2022] GET /identity/v3/users/8183b9dd93484869a15391845bf4e245 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:28.233320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109e331-6b63-40d1-9eb6-2c5e22b0afe0 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:28.329867 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109e331-6b63-40d1-9eb6-2c5e22b0afe0 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:28.361224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ccf11-4d5a-48c1-82bd-fd5919bad19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:28.361834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ccf11-4d5a-48c1-82bd-fd5919bad19a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:28.362109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ccf11-4d5a-48c1-82bd-fd5919bad19a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:28.362378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ccf11-4d5a-48c1-82bd-fd5919bad19a None admin] PATH_INFO: `/v3/projects/4b238eeb58824b1cbde9be906fc2377e` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:28.363470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ccf11-4d5a-48c1-82bd-fd5919bad19a None admin] RBAC: Authorizing `identity:get_project(project_id=4b238eeb58824b1cbde9be906fc2377e)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:28.364883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ccf11-4d5a-48c1-82bd-fd5919bad19a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:28.366486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 598/1191] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:23:28 2022] GET /identity/v3/projects/4b238eeb58824b1cbde9be906fc2377e => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:28.373287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972bfea-621d-4060-9bbc-f3f7e19b56a2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:28.470064 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972bfea-621d-4060-9bbc-f3f7e19b56a2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:28.472282 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:28.504441 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03018ffa-cdc3-45ac-be68-4a82d7a0bade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:28.505128 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03018ffa-cdc3-45ac-be68-4a82d7a0bade None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:28.505407 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03018ffa-cdc3-45ac-be68-4a82d7a0bade None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:28.505677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03018ffa-cdc3-45ac-be68-4a82d7a0bade None admin] PATH_INFO: `/v3/projects/4b238eeb58824b1cbde9be906fc2377e/users/8183b9dd93484869a15391845bf4e245/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:28.507556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03018ffa-cdc3-45ac-be68-4a82d7a0bade None admin] RBAC: Authorizing `identity:create_grant(project_id=4b238eeb58824b1cbde9be906fc2377e, user_id=8183b9dd93484869a15391845bf4e245, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:28.509009 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03018ffa-cdc3-45ac-be68-4a82d7a0bade None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:28.571175 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 594/1192] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:23:28 2022] PUT /identity/v3/projects/4b238eeb58824b1cbde9be906fc2377e/users/8183b9dd93484869a15391845bf4e245/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:23:30.703330 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324e959-a03e-4be5-99a0-0b4e995e71f4 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:30.703902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324e959-a03e-4be5-99a0-0b4e995e71f4 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:30.703902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324e959-a03e-4be5-99a0-0b4e995e71f4 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:30.705232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 599/1193] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:23:30.710580 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561d424-1608-4c22-aecd-4f25ccbd8879 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:30.710955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561d424-1608-4c22-aecd-4f25ccbd8879 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:30.711126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561d424-1608-4c22-aecd-4f25ccbd8879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:30.729499 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f561d424-1608-4c22-aecd-4f25ccbd8879 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:23:30.730702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f561d424-1608-4c22-aecd-4f25ccbd8879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:23:30.797288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 595/1194] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:23:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:23:31.079145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324e959-a03e-4be5-99a0-0b4e995e71f4 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:31.134250 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:31.178727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324e959-a03e-4be5-99a0-0b4e995e71f4 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:31.210879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364f76d-00a0-4307-982e-831d15d344ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:31.211525 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364f76d-00a0-4307-982e-831d15d344ab None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:31.211802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364f76d-00a0-4307-982e-831d15d344ab None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:31.212072 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364f76d-00a0-4307-982e-831d15d344ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:31.222699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364f76d-00a0-4307-982e-831d15d344ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-b364f76d-00a0-4307-982e-831d15d344ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:23:31.227431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:23:31.228494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:23:31.229513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:23:31.229513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:23:31.229513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:23:31.229513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:23:31.229513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:23:31.229513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:23:31.229513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:23:31.229513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:23:31.229513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:23:31.229513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:23:31.229513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:23:31.229513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:23:31.233169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 600/1195] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:23:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:23:31.234630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561d424-1608-4c22-aecd-4f25ccbd8879 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:31.323883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:31.334833 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561d424-1608-4c22-aecd-4f25ccbd8879 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:31.364561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efe22c-d648-41a0-9da2-04fa57ee8cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:31.365183 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efe22c-d648-41a0-9da2-04fa57ee8cde None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:31.365461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efe22c-d648-41a0-9da2-04fa57ee8cde None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:31.365733 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efe22c-d648-41a0-9da2-04fa57ee8cde None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:31.366395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efe22c-d648-41a0-9da2-04fa57ee8cde None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:23:31.366699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efe22c-d648-41a0-9da2-04fa57ee8cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:31.368064 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efe22c-d648-41a0-9da2-04fa57ee8cde None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:31.376660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 596/1196] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:23:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:31.382455 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364f76d-00a0-4307-982e-831d15d344ab None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:31.480376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364f76d-00a0-4307-982e-831d15d344ab None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:31.495497 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:31.513414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c9b83-d8e2-4a62-b4e4-89a26136a155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:31.514024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c9b83-d8e2-4a62-b4e4-89a26136a155 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:31.514298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c9b83-d8e2-4a62-b4e4-89a26136a155 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:31.514568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c9b83-d8e2-4a62-b4e4-89a26136a155 None admin] PATH_INFO: `/v3/users/8183b9dd93484869a15391845bf4e245` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:31.515671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c9b83-d8e2-4a62-b4e4-89a26136a155 None admin] RBAC: Authorizing `identity:get_user(user_id=8183b9dd93484869a15391845bf4e245)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:31.517122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c9b83-d8e2-4a62-b4e4-89a26136a155 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:31.518666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 601/1197] 10.222.0.50 () {56 vars in 1177 bytes} [Sat Sep 17 04:23:31 2022] GET /identity/v3/users/8183b9dd93484869a15391845bf4e245 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:31.524851 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efe22c-d648-41a0-9da2-04fa57ee8cde None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:31.625028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efe22c-d648-41a0-9da2-04fa57ee8cde None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:31.657302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf028272-3578-493e-b200-3433f0e2650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:31.657893 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf028272-3578-493e-b200-3433f0e2650a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:31.658165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf028272-3578-493e-b200-3433f0e2650a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:31.658430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf028272-3578-493e-b200-3433f0e2650a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:31.682071 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:31.723140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf028272-3578-493e-b200-3433f0e2650a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:31.724559 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf028272-3578-493e-b200-3433f0e2650a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:31.818725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 597/1198] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:23:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:23:31.824633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c9b83-d8e2-4a62-b4e4-89a26136a155 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:31.920831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c9b83-d8e2-4a62-b4e4-89a26136a155 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:31.952620 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72457f1-ab6e-4103-acc9-b3b770196d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:31.953249 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72457f1-ab6e-4103-acc9-b3b770196d8a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:31.953523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72457f1-ab6e-4103-acc9-b3b770196d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:31.953787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72457f1-ab6e-4103-acc9-b3b770196d8a None admin] PATH_INFO: `/v3/projects/4b238eeb58824b1cbde9be906fc2377e` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:31.954878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72457f1-ab6e-4103-acc9-b3b770196d8a None admin] RBAC: Authorizing `identity:get_project(project_id=4b238eeb58824b1cbde9be906fc2377e)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:31.956301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72457f1-ab6e-4103-acc9-b3b770196d8a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:31.957913 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 602/1199] 10.222.0.50 () {56 vars in 1186 bytes} [Sat Sep 17 04:23:31 2022] GET /identity/v3/projects/4b238eeb58824b1cbde9be906fc2377e => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:31.964130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf028272-3578-493e-b200-3433f0e2650a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:23:32.018869 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:32.061747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf028272-3578-493e-b200-3433f0e2650a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:23:32.094294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9096b-1ebb-4d92-be7f-6b731cb6c56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:23:32.094885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9096b-1ebb-4d92-be7f-6b731cb6c56b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:23:32.095160 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9096b-1ebb-4d92-be7f-6b731cb6c56b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:23:32.095430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9096b-1ebb-4d92-be7f-6b731cb6c56b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:23:32.096145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9096b-1ebb-4d92-be7f-6b731cb6c56b None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=4b238eeb58824b1cbde9be906fc2377e, user.id=8183b9dd93484869a15391845bf4e245) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:23:32.096448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9096b-1ebb-4d92-be7f-6b731cb6c56b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:23:32.097895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9096b-1ebb-4d92-be7f-6b731cb6c56b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:23:32.103476 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 598/1200] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:23:31 2022] GET /identity/v3/role_assignments?user.id=8183b9dd93484869a15391845bf4e245&scope.project.id=4b238eeb58824b1cbde9be906fc2377e&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:23:41.948577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=74 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:23:42.100887 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=40 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:44.594193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb6437-b0cf-425c-99ef-8d453dbda7ef None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:44.594809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb6437-b0cf-425c-99ef-8d453dbda7ef None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:44.594907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb6437-b0cf-425c-99ef-8d453dbda7ef None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:44.596238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 603/1201] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:24:44.601466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82c146-b502-43a0-8009-3c2351f05793 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:44.601907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82c146-b502-43a0-8009-3c2351f05793 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:44.602110 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82c146-b502-43a0-8009-3c2351f05793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:44.620693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5d82c146-b502-43a0-8009-3c2351f05793 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:24:44.621906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5d82c146-b502-43a0-8009-3c2351f05793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:24:44.687585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 599/1202] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:24:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:24:44.958975 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb6437-b0cf-425c-99ef-8d453dbda7ef None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:45.058077 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb6437-b0cf-425c-99ef-8d453dbda7ef None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:45.091214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d2aa8-0e07-40fd-8991-1448b5ff2321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:45.091832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d2aa8-0e07-40fd-8991-1448b5ff2321 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:45.092111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d2aa8-0e07-40fd-8991-1448b5ff2321 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:45.092383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d2aa8-0e07-40fd-8991-1448b5ff2321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:45.103303 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d2aa8-0e07-40fd-8991-1448b5ff2321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:45.104737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d2aa8-0e07-40fd-8991-1448b5ff2321 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-9f2d2aa8-0e07-40fd-8991-1448b5ff2321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:24:45.118894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:45.120578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:24:45.121797 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:24:45.121797 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:24:45.121797 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:24:45.121797 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 604/1203] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:45.126649 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82c146-b502-43a0-8009-3c2351f05793 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:45.225437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82c146-b502-43a0-8009-3c2351f05793 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:45.253346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:45.259186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631dee4-f164-457a-90b8-4f92bfa58df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:45.262440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631dee4-f164-457a-90b8-4f92bfa58df0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:45.262440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631dee4-f164-457a-90b8-4f92bfa58df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:45.262440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631dee4-f164-457a-90b8-4f92bfa58df0 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:45.262440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631dee4-f164-457a-90b8-4f92bfa58df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:45.262440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631dee4-f164-457a-90b8-4f92bfa58df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:45.262855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631dee4-f164-457a-90b8-4f92bfa58df0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:45.273987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 600/1204] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:45.279827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d2aa8-0e07-40fd-8991-1448b5ff2321 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:45.332924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:45.379334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d2aa8-0e07-40fd-8991-1448b5ff2321 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:45.411836 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89655dc1-e292-444b-9d55-020ba6dc6abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:45.412508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89655dc1-e292-444b-9d55-020ba6dc6abb None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:45.412788 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89655dc1-e292-444b-9d55-020ba6dc6abb None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:45.413104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89655dc1-e292-444b-9d55-020ba6dc6abb None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:45.413758 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89655dc1-e292-444b-9d55-020ba6dc6abb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:45.415193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89655dc1-e292-444b-9d55-020ba6dc6abb None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:45.510307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 605/1205] 10.222.0.50 () {60 vars in 1132 bytes} [Sat Sep 17 04:24:45 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:24:47.694277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43166a6b-8ebb-4bc9-a2f5-b2d97d340d35 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:47.695156 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43166a6b-8ebb-4bc9-a2f5-b2d97d340d35 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:47.695328 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43166a6b-8ebb-4bc9-a2f5-b2d97d340d35 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:47.696679 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 601/1206] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:24:47.701988 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02143e39-7b65-4e68-9cbe-d9636c843969 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:47.702415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02143e39-7b65-4e68-9cbe-d9636c843969 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:47.702518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02143e39-7b65-4e68-9cbe-d9636c843969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:47.720560 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-02143e39-7b65-4e68-9cbe-d9636c843969 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:24:47.721783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-02143e39-7b65-4e68-9cbe-d9636c843969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:24:47.787384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 606/1207] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:24:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:24:48.065679 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43166a6b-8ebb-4bc9-a2f5-b2d97d340d35 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:48.169068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43166a6b-8ebb-4bc9-a2f5-b2d97d340d35 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:48.203683 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6e516-0c59-4f13-b7c1-957deb673bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:48.204306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6e516-0c59-4f13-b7c1-957deb673bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:48.204583 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6e516-0c59-4f13-b7c1-957deb673bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:48.204855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6e516-0c59-4f13-b7c1-957deb673bf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:48.215340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6e516-0c59-4f13-b7c1-957deb673bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-85e6e516-0c59-4f13-b7c1-957deb673bf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:24:48.221343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:48.225361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:48.226412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:48.226412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:48.226412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:48.226412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:48.226412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:24:48.226412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:24:48.226412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:24:48.226412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:24:48.226412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:24:48.226412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:24:48.226412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:24:48.226412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:24:48.226412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 602/1208] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:24:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:48.228501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02143e39-7b65-4e68-9cbe-d9636c843969 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:48.267677 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:48.326038 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02143e39-7b65-4e68-9cbe-d9636c843969 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:48.359582 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d77843-576c-456b-bcb8-263cfdfb0bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:48.360182 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77843-576c-456b-bcb8-263cfdfb0bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:48.360458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77843-576c-456b-bcb8-263cfdfb0bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:48.360722 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77843-576c-456b-bcb8-263cfdfb0bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:48.361464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d77843-576c-456b-bcb8-263cfdfb0bc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:48.367983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d77843-576c-456b-bcb8-263cfdfb0bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:48.367983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d77843-576c-456b-bcb8-263cfdfb0bc6 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:48.370744 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 607/1209] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:24:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:48.377048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6e516-0c59-4f13-b7c1-957deb673bf2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:48.428339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:48.478275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6e516-0c59-4f13-b7c1-957deb673bf2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:48.512710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b2f8b-1205-4007-b67d-90dd69eb04a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:48.513356 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2f8b-1205-4007-b67d-90dd69eb04a2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:48.513634 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2f8b-1205-4007-b67d-90dd69eb04a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:48.513902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2f8b-1205-4007-b67d-90dd69eb04a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:48.525272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b2f8b-1205-4007-b67d-90dd69eb04a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:48.527785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b2f8b-1205-4007-b67d-90dd69eb04a2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-120b2f8b-1205-4007-b67d-90dd69eb04a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:24:48.541125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:48.542265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:24:48.543341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:24:48.543341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:24:48.543341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:24:48.543341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 603/1210] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:48.547989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d77843-576c-456b-bcb8-263cfdfb0bc6 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:48.644396 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:48.647299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d77843-576c-456b-bcb8-263cfdfb0bc6 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:48.680268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1209afd-0e83-4018-9690-2d1bb2448fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:48.680856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1209afd-0e83-4018-9690-2d1bb2448fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:48.681161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1209afd-0e83-4018-9690-2d1bb2448fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:48.681430 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1209afd-0e83-4018-9690-2d1bb2448fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:48.682052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1209afd-0e83-4018-9690-2d1bb2448fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:48.682349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1209afd-0e83-4018-9690-2d1bb2448fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:48.683703 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1209afd-0e83-4018-9690-2d1bb2448fe9 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:48.694962 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 608/1211] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:48.700833 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b2f8b-1205-4007-b67d-90dd69eb04a2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:48.804985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b2f8b-1205-4007-b67d-90dd69eb04a2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:48.806603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:48.838550 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead9762-fb50-422d-83ed-74a471521df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:48.839163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead9762-fb50-422d-83ed-74a471521df8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:48.839436 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead9762-fb50-422d-83ed-74a471521df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:48.839700 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead9762-fb50-422d-83ed-74a471521df8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:48.847475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead9762-fb50-422d-83ed-74a471521df8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:48.848909 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead9762-fb50-422d-83ed-74a471521df8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3ead9762-fb50-422d-83ed-74a471521df8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:24:48.859732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:48.860954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:48.862325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:48.862325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:48.862325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:24:48.862325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:24:48.862325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:24:48.862325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:24:48.862325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:24:48.862325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:24:48.862325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 04:24:48.862325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:24:48.862325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 604/1212] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:24:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:48.866782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1209afd-0e83-4018-9690-2d1bb2448fe9 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:48.964478 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1209afd-0e83-4018-9690-2d1bb2448fe9 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:48.997918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9371d-8b59-4a8e-b57f-843b69f8cf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:48.998573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9371d-8b59-4a8e-b57f-843b69f8cf34 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:48.998846 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9371d-8b59-4a8e-b57f-843b69f8cf34 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:48.999110 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9371d-8b59-4a8e-b57f-843b69f8cf34 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:49.000320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9371d-8b59-4a8e-b57f-843b69f8cf34 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:49.000619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9371d-8b59-4a8e-b57f-843b69f8cf34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:49.002224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9371d-8b59-4a8e-b57f-843b69f8cf34 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:49.019585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 609/1213] 10.222.0.50 () {56 vars in 1143 bytes} [Sat Sep 17 04:24:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:49.025467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead9762-fb50-422d-83ed-74a471521df8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:49.130200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead9762-fb50-422d-83ed-74a471521df8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:49.165387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c71a0-7524-4e68-8c41-a65193fb13c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:49.166073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c71a0-7524-4e68-8c41-a65193fb13c3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:49.166359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c71a0-7524-4e68-8c41-a65193fb13c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:49.166631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c71a0-7524-4e68-8c41-a65193fb13c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:49.196892 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:49.233203 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c71a0-7524-4e68-8c41-a65193fb13c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:49.234808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c71a0-7524-4e68-8c41-a65193fb13c3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:49.330132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 605/1214] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:24:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:24:49.336151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9371d-8b59-4a8e-b57f-843b69f8cf34 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:49.355287 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:49.435749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9371d-8b59-4a8e-b57f-843b69f8cf34 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:49.472108 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b7897-a775-4827-8728-c3f075bb0a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:49.472732 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b7897-a775-4827-8728-c3f075bb0a3d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:49.473030 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b7897-a775-4827-8728-c3f075bb0a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:49.473308 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b7897-a775-4827-8728-c3f075bb0a3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:49.491203 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b7897-a775-4827-8728-c3f075bb0a3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:49.491203 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b7897-a775-4827-8728-c3f075bb0a3d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-9b0b7897-a775-4827-8728-c3f075bb0a3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:24:49.501523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:49.502667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:24:49.503730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:24:49.503730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:24:49.503730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:24:49.503730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 610/1215] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:49.508601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c71a0-7524-4e68-8c41-a65193fb13c3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:49.568461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:49.604871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c71a0-7524-4e68-8c41-a65193fb13c3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:49.638052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3883471-fa73-47b1-87d7-a5b96a6ee728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:49.638652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883471-fa73-47b1-87d7-a5b96a6ee728 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:49.638924 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883471-fa73-47b1-87d7-a5b96a6ee728 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:49.639196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883471-fa73-47b1-87d7-a5b96a6ee728 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:49.641467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3883471-fa73-47b1-87d7-a5b96a6ee728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:49.641467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3883471-fa73-47b1-87d7-a5b96a6ee728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:49.641684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3883471-fa73-47b1-87d7-a5b96a6ee728 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:49.652869 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 606/1216] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:49.658697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b7897-a775-4827-8728-c3f075bb0a3d None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:49.726497 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:49.757527 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b7897-a775-4827-8728-c3f075bb0a3d None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:49.789497 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4e60d-38cb-43f6-bdc9-84e7d0c9537c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:49.790116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e60d-38cb-43f6-bdc9-84e7d0c9537c None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:49.790391 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e60d-38cb-43f6-bdc9-84e7d0c9537c None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:49.790662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e60d-38cb-43f6-bdc9-84e7d0c9537c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:49.798403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4e60d-38cb-43f6-bdc9-84e7d0c9537c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:49.801700 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4e60d-38cb-43f6-bdc9-84e7d0c9537c None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-76d4e60d-38cb-43f6-bdc9-84e7d0c9537c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:24:49.810934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:49.812486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:49.813601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:24:49.813601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:24:49.813601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:24:49.813601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:24:49.813601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:24:49.813601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:24:49.813601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:24:49.813601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:24:49.813601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 611/1217] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:24:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:49.818651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3883471-fa73-47b1-87d7-a5b96a6ee728 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:49.917931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3883471-fa73-47b1-87d7-a5b96a6ee728 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:49.940288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:49.951592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abd42f-5988-4488-8f10-e338552e827a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:49.952216 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abd42f-5988-4488-8f10-e338552e827a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:49.952494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abd42f-5988-4488-8f10-e338552e827a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:49.952757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abd42f-5988-4488-8f10-e338552e827a None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:49.953572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abd42f-5988-4488-8f10-e338552e827a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:49.953983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abd42f-5988-4488-8f10-e338552e827a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:49.955412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abd42f-5988-4488-8f10-e338552e827a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:49.967462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 607/1218] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:24:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:49.974345 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4e60d-38cb-43f6-bdc9-84e7d0c9537c None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:50.074647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4e60d-38cb-43f6-bdc9-84e7d0c9537c None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:50.102655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:50.108381 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece7d8b-6d4b-45ea-be5e-96784ab7a7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:50.109821 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece7d8b-6d4b-45ea-be5e-96784ab7a7fe None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:50.110097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece7d8b-6d4b-45ea-be5e-96784ab7a7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:50.110366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece7d8b-6d4b-45ea-be5e-96784ab7a7fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:50.111073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece7d8b-6d4b-45ea-be5e-96784ab7a7fe None admin] RBAC: Adding query filter params (role.id=b1cf59e6d9dd49179551b98cee02776c, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=931a947711a2468baaeef701bbee60c3) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:50.111372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece7d8b-6d4b-45ea-be5e-96784ab7a7fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:50.112814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece7d8b-6d4b-45ea-be5e-96784ab7a7fe None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:50.118093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 612/1219] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:24:49 2022] GET /identity/v3/role_assignments?user.id=931a947711a2468baaeef701bbee60c3&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=b1cf59e6d9dd49179551b98cee02776c => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:52.240653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7227929-1ff5-44c6-80e4-def73c1b23cc None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:52.241210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7227929-1ff5-44c6-80e4-def73c1b23cc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:52.241210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7227929-1ff5-44c6-80e4-def73c1b23cc None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:52.242564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 608/1220] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:24:52.248230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a1dcc-afaa-4f38-a907-6e460c0496cf None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:52.248622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a1dcc-afaa-4f38-a907-6e460c0496cf None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:52.248761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a1dcc-afaa-4f38-a907-6e460c0496cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:52.267157 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-907a1dcc-afaa-4f38-a907-6e460c0496cf None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:24:52.268332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-907a1dcc-afaa-4f38-a907-6e460c0496cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:24:52.333249 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 613/1221] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:24:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:24:52.603489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7227929-1ff5-44c6-80e4-def73c1b23cc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:52.702810 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7227929-1ff5-44c6-80e4-def73c1b23cc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:52.735926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5b470-78a4-4fc1-a3d7-d6b227f608fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:52.736539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5b470-78a4-4fc1-a3d7-d6b227f608fd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:52.736811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5b470-78a4-4fc1-a3d7-d6b227f608fd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:52.737105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5b470-78a4-4fc1-a3d7-d6b227f608fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:52.747307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5b470-78a4-4fc1-a3d7-d6b227f608fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-85e5b470-78a4-4fc1-a3d7-d6b227f608fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:24:52.752145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:52.753307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:52.754401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:52.754401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:52.754401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:52.754401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:52.754401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:24:52.754401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:24:52.754401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:24:52.754401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:24:52.754401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:24:52.754401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:24:52.754401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:24:52.754401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:24:52.754401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 609/1222] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:24:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:52.759545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a1dcc-afaa-4f38-a907-6e460c0496cf None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:52.858889 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a1dcc-afaa-4f38-a907-6e460c0496cf None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:52.881671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:52.892012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932696d-a9d5-442c-a6f3-0fa9617e46dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:52.892616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932696d-a9d5-442c-a6f3-0fa9617e46dd None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:52.892892 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932696d-a9d5-442c-a6f3-0fa9617e46dd None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:52.893191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932696d-a9d5-442c-a6f3-0fa9617e46dd None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:52.893847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932696d-a9d5-442c-a6f3-0fa9617e46dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:52.894147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932696d-a9d5-442c-a6f3-0fa9617e46dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:52.895508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932696d-a9d5-442c-a6f3-0fa9617e46dd None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:52.903078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 614/1223] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:24:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:52.909564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5b470-78a4-4fc1-a3d7-d6b227f608fd None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:52.952353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:53.006351 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5b470-78a4-4fc1-a3d7-d6b227f608fd None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:53.038421 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4407b-5536-4b60-bb96-6bca544780ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:53.039041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4407b-5536-4b60-bb96-6bca544780ef None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:53.039316 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4407b-5536-4b60-bb96-6bca544780ef None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:53.039586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4407b-5536-4b60-bb96-6bca544780ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:53.050641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4407b-5536-4b60-bb96-6bca544780ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:53.052081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4407b-5536-4b60-bb96-6bca544780ef None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-d4a4407b-5536-4b60-bb96-6bca544780ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:24:53.066340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:53.067371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:24:53.068251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:24:53.068251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:24:53.068251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:24:53.068251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 610/1224] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:53.073291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932696d-a9d5-442c-a6f3-0fa9617e46dd None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:53.172166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932696d-a9d5-442c-a6f3-0fa9617e46dd None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:53.204195 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86384ae3-7eb5-4875-977a-948c2ec0a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:53.204793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86384ae3-7eb5-4875-977a-948c2ec0a95e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:53.205105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86384ae3-7eb5-4875-977a-948c2ec0a95e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:53.205379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86384ae3-7eb5-4875-977a-948c2ec0a95e None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:53.206029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86384ae3-7eb5-4875-977a-948c2ec0a95e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:53.206325 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86384ae3-7eb5-4875-977a-948c2ec0a95e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:53.207681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86384ae3-7eb5-4875-977a-948c2ec0a95e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:53.220058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 615/1225] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:53.225901 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4407b-5536-4b60-bb96-6bca544780ef None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:53.318096 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:53.325270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4407b-5536-4b60-bb96-6bca544780ef None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:53.357313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459539b-7d22-45a4-acb6-c0d30f82f454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:53.357983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459539b-7d22-45a4-acb6-c0d30f82f454 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:53.358780 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459539b-7d22-45a4-acb6-c0d30f82f454 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:53.359044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459539b-7d22-45a4-acb6-c0d30f82f454 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:53.366549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459539b-7d22-45a4-acb6-c0d30f82f454 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:53.368013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459539b-7d22-45a4-acb6-c0d30f82f454 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-6459539b-7d22-45a4-acb6-c0d30f82f454 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:24:53.380507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:53.381662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:53.382641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:53.382641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:53.382641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:24:53.382641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:24:53.382641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:24:53.382641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:24:53.382641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:24:53.382641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:24:53.382641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 04:24:53.382641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:24:53.382641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 611/1226] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:24:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:53.387407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86384ae3-7eb5-4875-977a-948c2ec0a95e None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:53.433445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:53.485906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86384ae3-7eb5-4875-977a-948c2ec0a95e None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:53.520933 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1c3d1-9fd7-441e-8386-8fddd906ee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:53.521564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1c3d1-9fd7-441e-8386-8fddd906ee10 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:53.521842 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1c3d1-9fd7-441e-8386-8fddd906ee10 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:53.522118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1c3d1-9fd7-441e-8386-8fddd906ee10 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:53.522831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1c3d1-9fd7-441e-8386-8fddd906ee10 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:53.523137 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1c3d1-9fd7-441e-8386-8fddd906ee10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:53.524556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1c3d1-9fd7-441e-8386-8fddd906ee10 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:53.541341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 616/1227] 10.222.0.50 () {56 vars in 1143 bytes} [Sat Sep 17 04:24:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:53.547906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459539b-7d22-45a4-acb6-c0d30f82f454 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:53.647687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459539b-7d22-45a4-acb6-c0d30f82f454 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:53.682363 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba24dc6-4c23-4921-977e-9cf30e012487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:53.682999 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba24dc6-4c23-4921-977e-9cf30e012487 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:53.683290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba24dc6-4c23-4921-977e-9cf30e012487 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:53.683600 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba24dc6-4c23-4921-977e-9cf30e012487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:53.697603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba24dc6-4c23-4921-977e-9cf30e012487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:53.699059 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba24dc6-4c23-4921-977e-9cf30e012487 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-6ba24dc6-4c23-4921-977e-9cf30e012487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:24:53.714085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:53.715259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:24:53.716370 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:24:53.716370 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:24:53.716370 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:24:53.716370 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 612/1228] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:53.721565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1c3d1-9fd7-441e-8386-8fddd906ee10 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:53.818971 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1c3d1-9fd7-441e-8386-8fddd906ee10 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:53.821322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:53.851900 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b5e8e-2551-4572-8a79-9893af09c183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:53.852485 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b5e8e-2551-4572-8a79-9893af09c183 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:53.852759 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b5e8e-2551-4572-8a79-9893af09c183 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:53.853167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b5e8e-2551-4572-8a79-9893af09c183 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:53.853806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b5e8e-2551-4572-8a79-9893af09c183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:53.854102 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b5e8e-2551-4572-8a79-9893af09c183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:53.855449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b5e8e-2551-4572-8a79-9893af09c183 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:53.866830 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 617/1229] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:53.872844 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba24dc6-4c23-4921-977e-9cf30e012487 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:53.882122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:53.971667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba24dc6-4c23-4921-977e-9cf30e012487 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:54.016140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a777c3-5d97-4956-9312-e124e672b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:54.016763 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a777c3-5d97-4956-9312-e124e672b885 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:54.017112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a777c3-5d97-4956-9312-e124e672b885 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:54.017386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a777c3-5d97-4956-9312-e124e672b885 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:54.024014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a777c3-5d97-4956-9312-e124e672b885 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:54.025516 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a777c3-5d97-4956-9312-e124e672b885 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e9a777c3-5d97-4956-9312-e124e672b885 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:24:54.037415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:54.038680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:54.039686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:24:54.039686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:24:54.039686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:24:54.039686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:24:54.039686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:24:54.039686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:24:54.039686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:24:54.039686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:24:54.039686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 613/1230] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:24:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:24:54.044582 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b5e8e-2551-4572-8a79-9893af09c183 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:54.142114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b5e8e-2551-4572-8a79-9893af09c183 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:54.176148 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a696a4-3821-48fa-aa0f-61a5f8d9d56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:54.176748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a696a4-3821-48fa-aa0f-61a5f8d9d56d None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:54.177046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a696a4-3821-48fa-aa0f-61a5f8d9d56d None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:54.177316 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a696a4-3821-48fa-aa0f-61a5f8d9d56d None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:54.177991 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a696a4-3821-48fa-aa0f-61a5f8d9d56d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:54.178290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a696a4-3821-48fa-aa0f-61a5f8d9d56d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:54.179699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a696a4-3821-48fa-aa0f-61a5f8d9d56d None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:54.191327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 618/1231] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:24:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:54.197489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a777c3-5d97-4956-9312-e124e672b885 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:54.261801 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:54.296773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a777c3-5d97-4956-9312-e124e672b885 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:54.329162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e681c-2de9-453e-a158-96c001613c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:54.329813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e681c-2de9-453e-a158-96c001613c56 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:54.330087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e681c-2de9-453e-a158-96c001613c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:54.330357 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e681c-2de9-453e-a158-96c001613c56 None admin] PATH_INFO: `/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/931a947711a2468baaeef701bbee60c3/roles/b1cf59e6d9dd49179551b98cee02776c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:54.344764 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e681c-2de9-453e-a158-96c001613c56 None admin] RBAC: Authorizing `identity:create_grant(project_id=d50a1cd322404bd4b0fa7a8c388dc217, user_id=931a947711a2468baaeef701bbee60c3, role_id=b1cf59e6d9dd49179551b98cee02776c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:54.346234 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e681c-2de9-453e-a158-96c001613c56 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:54.428750 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 614/1232] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:24:54 2022] PUT /identity/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/931a947711a2468baaeef701bbee60c3/roles/b1cf59e6d9dd49179551b98cee02776c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:24:56.587597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81360c-d3c7-4aa5-9858-8885aee13564 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:56.588136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81360c-d3c7-4aa5-9858-8885aee13564 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:56.588136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81360c-d3c7-4aa5-9858-8885aee13564 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:56.589538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 619/1233] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:24:56.594826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf934bc-4170-47c6-afc0-6d2f3189c7f7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:56.596637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf934bc-4170-47c6-afc0-6d2f3189c7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:56.596637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf934bc-4170-47c6-afc0-6d2f3189c7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:56.613440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5cf934bc-4170-47c6-afc0-6d2f3189c7f7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:24:56.614623 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5cf934bc-4170-47c6-afc0-6d2f3189c7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:24:56.679783 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 615/1234] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:24:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:24:56.948027 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81360c-d3c7-4aa5-9858-8885aee13564 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:56.973486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:57.048105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81360c-d3c7-4aa5-9858-8885aee13564 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:57.081388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e93c-afc1-4c22-a050-c80ab30c3bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:57.082009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e93c-afc1-4c22-a050-c80ab30c3bbb None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:57.082287 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e93c-afc1-4c22-a050-c80ab30c3bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:57.082557 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e93c-afc1-4c22-a050-c80ab30c3bbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:57.092631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7e93c-afc1-4c22-a050-c80ab30c3bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-a0d7e93c-afc1-4c22-a050-c80ab30c3bbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:24:57.097574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:57.099403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:57.100375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:57.100375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:57.100375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:57.100375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:57.100375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:24:57.100375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:24:57.100375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:24:57.100375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:24:57.100375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:24:57.100375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:24:57.100375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 04:24:57.100375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:24:57.100375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 620/1235] 10.222.0.50 () {56 vars in 1102 bytes} [Sat Sep 17 04:24:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:57.104914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf934bc-4170-47c6-afc0-6d2f3189c7f7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:57.152385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:57.204821 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf934bc-4170-47c6-afc0-6d2f3189c7f7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:57.238152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b951333-0f56-445a-8517-1c710993851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:57.238748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b951333-0f56-445a-8517-1c710993851f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:57.239020 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b951333-0f56-445a-8517-1c710993851f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:57.239285 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b951333-0f56-445a-8517-1c710993851f None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:57.239941 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b951333-0f56-445a-8517-1c710993851f None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:57.240242 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b951333-0f56-445a-8517-1c710993851f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:57.241673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b951333-0f56-445a-8517-1c710993851f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:57.250341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 616/1236] 10.222.0.50 () {56 vars in 1103 bytes} [Sat Sep 17 04:24:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:57.256219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e93c-afc1-4c22-a050-c80ab30c3bbb None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:57.340053 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:57.355110 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e93c-afc1-4c22-a050-c80ab30c3bbb None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:57.389833 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10326f42-0456-4f71-9c91-aa940bc1a6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:57.390450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326f42-0456-4f71-9c91-aa940bc1a6ac None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:57.390753 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326f42-0456-4f71-9c91-aa940bc1a6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:57.391023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326f42-0456-4f71-9c91-aa940bc1a6ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:57.400744 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10326f42-0456-4f71-9c91-aa940bc1a6ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:57.402216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10326f42-0456-4f71-9c91-aa940bc1a6ac None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-10326f42-0456-4f71-9c91-aa940bc1a6ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:24:57.417905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:57.419012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:24:57.419928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:24:57.419928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:24:57.419928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:24:57.419928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 621/1237] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:57.425506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b951333-0f56-445a-8517-1c710993851f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:57.522540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b951333-0f56-445a-8517-1c710993851f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:57.531452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:57.556529 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537e90f-36d9-4618-aa6b-9f1f0ab52502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:57.557165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537e90f-36d9-4618-aa6b-9f1f0ab52502 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:57.557437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537e90f-36d9-4618-aa6b-9f1f0ab52502 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:57.557700 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537e90f-36d9-4618-aa6b-9f1f0ab52502 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:57.558442 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537e90f-36d9-4618-aa6b-9f1f0ab52502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:57.558744 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537e90f-36d9-4618-aa6b-9f1f0ab52502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:57.560165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537e90f-36d9-4618-aa6b-9f1f0ab52502 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:57.571835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 617/1238] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:57.577630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10326f42-0456-4f71-9c91-aa940bc1a6ac None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:57.675626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10326f42-0456-4f71-9c91-aa940bc1a6ac None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:57.708193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a85cce-4d28-403e-a857-b4bff774b524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:57.708807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a85cce-4d28-403e-a857-b4bff774b524 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:57.709112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a85cce-4d28-403e-a857-b4bff774b524 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:57.709381 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a85cce-4d28-403e-a857-b4bff774b524 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:57.711949 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:57.718081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a85cce-4d28-403e-a857-b4bff774b524 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:57.719735 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a85cce-4d28-403e-a857-b4bff774b524 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-84a85cce-4d28-403e-a857-b4bff774b524 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:24:57.730699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:57.731781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:57.732779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:57.732779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:57.732779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:24:57.732779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:24:57.732779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:24:57.732779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:24:57.732779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:24:57.732779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:24:57.732779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 04:24:57.732779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:24:57.732779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 622/1239] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:24:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:57.738417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537e90f-36d9-4618-aa6b-9f1f0ab52502 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:57.837847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537e90f-36d9-4618-aa6b-9f1f0ab52502 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:57.870996 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff934c-532d-4deb-9261-c01abeb2a88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:57.871910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff934c-532d-4deb-9261-c01abeb2a88b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:57.872189 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff934c-532d-4deb-9261-c01abeb2a88b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:57.872460 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff934c-532d-4deb-9261-c01abeb2a88b None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:57.873195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff934c-532d-4deb-9261-c01abeb2a88b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:57.874103 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff934c-532d-4deb-9261-c01abeb2a88b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:57.875539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff934c-532d-4deb-9261-c01abeb2a88b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:57.892340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 618/1240] 10.222.0.50 () {56 vars in 1143 bytes} [Sat Sep 17 04:24:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:57.898058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a85cce-4d28-403e-a857-b4bff774b524 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:57.995209 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a85cce-4d28-403e-a857-b4bff774b524 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:58.027760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287a65-c427-4810-99f7-48065cd77a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:58.028346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287a65-c427-4810-99f7-48065cd77a7a None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:58.028635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287a65-c427-4810-99f7-48065cd77a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:58.028884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287a65-c427-4810-99f7-48065cd77a7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:58.087711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:58.093980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287a65-c427-4810-99f7-48065cd77a7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:58.095348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287a65-c427-4810-99f7-48065cd77a7a None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:58.191765 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 623/1241] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:24:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:24:58.197549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff934c-532d-4deb-9261-c01abeb2a88b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:58.224793 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:58.294653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff934c-532d-4deb-9261-c01abeb2a88b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:58.327150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105974e3-7972-4d0c-b31e-52d65e86221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:58.327711 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105974e3-7972-4d0c-b31e-52d65e86221b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:58.327983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105974e3-7972-4d0c-b31e-52d65e86221b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:58.328274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105974e3-7972-4d0c-b31e-52d65e86221b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:58.337873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105974e3-7972-4d0c-b31e-52d65e86221b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:58.339293 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105974e3-7972-4d0c-b31e-52d65e86221b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-105974e3-7972-4d0c-b31e-52d65e86221b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:24:58.354568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:58.355539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:24:58.356497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:24:58.356497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:24:58.356497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:24:58.356497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 619/1242] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:58.362102 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287a65-c427-4810-99f7-48065cd77a7a None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:58.453185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:58.458769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287a65-c427-4810-99f7-48065cd77a7a None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:58.491943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aefa64-cd10-478f-b450-ffe99c1baf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:58.492534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aefa64-cd10-478f-b450-ffe99c1baf17 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:58.492811 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aefa64-cd10-478f-b450-ffe99c1baf17 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:58.493112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aefa64-cd10-478f-b450-ffe99c1baf17 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:58.493742 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aefa64-cd10-478f-b450-ffe99c1baf17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:58.494042 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aefa64-cd10-478f-b450-ffe99c1baf17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:58.495396 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aefa64-cd10-478f-b450-ffe99c1baf17 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:58.506422 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 624/1243] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:58.512142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105974e3-7972-4d0c-b31e-52d65e86221b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:58.593185 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:24:58.774149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105974e3-7972-4d0c-b31e-52d65e86221b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:58.774149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7d910-83dc-441a-aadd-4680b5c3f480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:58.774149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7d910-83dc-441a-aadd-4680b5c3f480 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:58.774149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7d910-83dc-441a-aadd-4680b5c3f480 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:58.775121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7d910-83dc-441a-aadd-4680b5c3f480 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:58.775121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7d910-83dc-441a-aadd-4680b5c3f480 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:58.775121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7d910-83dc-441a-aadd-4680b5c3f480 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:58.775121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-53c7d910-83dc-441a-aadd-4680b5c3f480 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:24:58.775121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:24:58.775121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:24:58.775121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:24:58.775121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:24:58.775121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:24:58.775121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:24:58.775850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:24:58.777018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:24:58.778102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 620/1244] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:24:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:24:58.778194 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aefa64-cd10-478f-b450-ffe99c1baf17 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:58.778194 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aefa64-cd10-478f-b450-ffe99c1baf17 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:58.812357 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db1fc2-1172-41b8-b2c4-45b7f80daad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:58.812954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db1fc2-1172-41b8-b2c4-45b7f80daad7 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:58.813262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db1fc2-1172-41b8-b2c4-45b7f80daad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:58.813534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db1fc2-1172-41b8-b2c4-45b7f80daad7 None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:58.814219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db1fc2-1172-41b8-b2c4-45b7f80daad7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:58.814522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db1fc2-1172-41b8-b2c4-45b7f80daad7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:58.815941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db1fc2-1172-41b8-b2c4-45b7f80daad7 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:58.827632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 625/1245] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:24:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:24:58.833772 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7d910-83dc-441a-aadd-4680b5c3f480 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:24:58.934281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7d910-83dc-441a-aadd-4680b5c3f480 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:24:58.966229 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc2fd7-1c9e-48ae-8d7e-b8defc192bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:24:58.966815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc2fd7-1c9e-48ae-8d7e-b8defc192bca None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:24:58.967084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc2fd7-1c9e-48ae-8d7e-b8defc192bca None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:24:58.967867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc2fd7-1c9e-48ae-8d7e-b8defc192bca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:24:58.968576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc2fd7-1c9e-48ae-8d7e-b8defc192bca None admin] RBAC: Adding query filter params (role.id=b1cf59e6d9dd49179551b98cee02776c, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=931a947711a2468baaeef701bbee60c3) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:24:58.968875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc2fd7-1c9e-48ae-8d7e-b8defc192bca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:24:58.970555 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc2fd7-1c9e-48ae-8d7e-b8defc192bca None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:24:58.976295 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 621/1246] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:24:58 2022] GET /identity/v3/role_assignments?user.id=931a947711a2468baaeef701bbee60c3&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=b1cf59e6d9dd49179551b98cee02776c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:01.178679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9aee-d3d6-47c7-afd3-f8ba27376323 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:01.179183 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9aee-d3d6-47c7-afd3-f8ba27376323 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:01.179275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9aee-d3d6-47c7-afd3-f8ba27376323 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:01.180535 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 626/1247] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:25:01.186392 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f4a98-27a0-4ccd-acb2-3d559c698a47 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:01.186951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f4a98-27a0-4ccd-acb2-3d559c698a47 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:01.187041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f4a98-27a0-4ccd-acb2-3d559c698a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:01.193536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:01.206066 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a55f4a98-27a0-4ccd-acb2-3d559c698a47 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:25:01.207241 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a55f4a98-27a0-4ccd-acb2-3d559c698a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:25:01.272079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 622/1248] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:25:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:25:01.547719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e9aee-d3d6-47c7-afd3-f8ba27376323 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:01.565976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:01.645771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e9aee-d3d6-47c7-afd3-f8ba27376323 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:01.679700 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc126744-e7b7-4d8f-9e67-a07887432546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:01.680377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc126744-e7b7-4d8f-9e67-a07887432546 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:01.680616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc126744-e7b7-4d8f-9e67-a07887432546 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:01.680883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc126744-e7b7-4d8f-9e67-a07887432546 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:01.692193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc126744-e7b7-4d8f-9e67-a07887432546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-dc126744-e7b7-4d8f-9e67-a07887432546 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:25:01.697043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:01.698113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:01.699150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:01.699150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:01.699150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:01.699150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:01.699150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:25:01.699150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:25:01.699150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:25:01.699150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:25:01.699150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:25:01.699150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:25:01.699150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:25:01.699150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:25:01.699150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 627/1249] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:25:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:01.704204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f4a98-27a0-4ccd-acb2-3d559c698a47 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:01.805794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f4a98-27a0-4ccd-acb2-3d559c698a47 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:01.835423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:01.840241 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ef74d-8204-46cf-b59c-5076ccbfe950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:01.840846 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ef74d-8204-46cf-b59c-5076ccbfe950 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:01.841157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ef74d-8204-46cf-b59c-5076ccbfe950 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:01.841429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ef74d-8204-46cf-b59c-5076ccbfe950 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:01.842406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ef74d-8204-46cf-b59c-5076ccbfe950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:01.842800 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ef74d-8204-46cf-b59c-5076ccbfe950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:01.844197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ef74d-8204-46cf-b59c-5076ccbfe950 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:01.852051 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 623/1250] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:25:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:01.858950 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc126744-e7b7-4d8f-9e67-a07887432546 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:01.937480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:01.959769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc126744-e7b7-4d8f-9e67-a07887432546 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:01.993959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dfeb7-be7f-4b5d-ae39-3639a27a7736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:01.994579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dfeb7-be7f-4b5d-ae39-3639a27a7736 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:01.994851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dfeb7-be7f-4b5d-ae39-3639a27a7736 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:01.995116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dfeb7-be7f-4b5d-ae39-3639a27a7736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:02.005622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dfeb7-be7f-4b5d-ae39-3639a27a7736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:02.007050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dfeb7-be7f-4b5d-ae39-3639a27a7736 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-3c8dfeb7-be7f-4b5d-ae39-3639a27a7736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:25:02.020438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:02.021636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:25:02.022666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:25:02.022666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:25:02.022666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:25:02.022666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 628/1251] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:02.027336 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ef74d-8204-46cf-b59c-5076ccbfe950 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:02.126746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ef74d-8204-46cf-b59c-5076ccbfe950 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:02.159268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89888fd-6c02-4646-a528-c38e3cc7a7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:02.159876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89888fd-6c02-4646-a528-c38e3cc7a7da None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:02.160153 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89888fd-6c02-4646-a528-c38e3cc7a7da None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:02.160422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89888fd-6c02-4646-a528-c38e3cc7a7da None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:02.161509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89888fd-6c02-4646-a528-c38e3cc7a7da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:02.161509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89888fd-6c02-4646-a528-c38e3cc7a7da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:02.162736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89888fd-6c02-4646-a528-c38e3cc7a7da None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:02.174834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 624/1252] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:02.180494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dfeb7-be7f-4b5d-ae39-3639a27a7736 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:02.278556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dfeb7-be7f-4b5d-ae39-3639a27a7736 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:02.305121 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:02.313238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d498eb-b62e-4d05-9bb1-a655168e23e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:02.313857 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d498eb-b62e-4d05-9bb1-a655168e23e3 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:02.314132 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d498eb-b62e-4d05-9bb1-a655168e23e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:02.314403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d498eb-b62e-4d05-9bb1-a655168e23e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:02.321688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d498eb-b62e-4d05-9bb1-a655168e23e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:02.323121 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d498eb-b62e-4d05-9bb1-a655168e23e3 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-55d498eb-b62e-4d05-9bb1-a655168e23e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:25:02.334105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:02.335257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:02.336482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:02.336482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:02.336482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:25:02.336482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:25:02.336482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:25:02.336482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:25:02.336482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:25:02.336482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:25:02.336482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 04:25:02.336482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:25:02.336482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 629/1253] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:25:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:02.345286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89888fd-6c02-4646-a528-c38e3cc7a7da None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:02.396795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:02.441023 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89888fd-6c02-4646-a528-c38e3cc7a7da None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:02.473933 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65612dd2-ddef-4611-8858-de241fd04c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:02.474527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65612dd2-ddef-4611-8858-de241fd04c69 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:02.474804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65612dd2-ddef-4611-8858-de241fd04c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:02.475099 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65612dd2-ddef-4611-8858-de241fd04c69 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:02.475812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65612dd2-ddef-4611-8858-de241fd04c69 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:02.476111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65612dd2-ddef-4611-8858-de241fd04c69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:02.477554 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65612dd2-ddef-4611-8858-de241fd04c69 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:02.494918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 625/1254] 10.222.0.50 () {56 vars in 1143 bytes} [Sat Sep 17 04:25:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:02.502167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d498eb-b62e-4d05-9bb1-a655168e23e3 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:02.598662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d498eb-b62e-4d05-9bb1-a655168e23e3 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:02.631318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae510f-bbe9-49f6-9232-62205dc82cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:02.631905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae510f-bbe9-49f6-9232-62205dc82cbc None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:02.632182 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae510f-bbe9-49f6-9232-62205dc82cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:02.632446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae510f-bbe9-49f6-9232-62205dc82cbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:02.684828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:02.696477 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae510f-bbe9-49f6-9232-62205dc82cbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:02.697955 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae510f-bbe9-49f6-9232-62205dc82cbc None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:02.794370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 630/1255] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:25:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:25:02.800847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65612dd2-ddef-4611-8858-de241fd04c69 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:02.898239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65612dd2-ddef-4611-8858-de241fd04c69 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:02.912312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:02.932685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629db27-518e-4169-94aa-6316ce63019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:02.933333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629db27-518e-4169-94aa-6316ce63019e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:02.933607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629db27-518e-4169-94aa-6316ce63019e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:02.933895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629db27-518e-4169-94aa-6316ce63019e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:02.943504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629db27-518e-4169-94aa-6316ce63019e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:02.944928 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629db27-518e-4169-94aa-6316ce63019e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e629db27-518e-4169-94aa-6316ce63019e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:25:02.959391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:02.960341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:25:02.961334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:25:02.961334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:25:02.961334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:25:02.961334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 626/1256] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:02.966180 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae510f-bbe9-49f6-9232-62205dc82cbc None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:03.054175 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:03.066131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae510f-bbe9-49f6-9232-62205dc82cbc None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:03.099233 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99046863-10b4-4e5f-bd70-abaca980b5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:03.099831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99046863-10b4-4e5f-bd70-abaca980b5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:03.100106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99046863-10b4-4e5f-bd70-abaca980b5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:03.100371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99046863-10b4-4e5f-bd70-abaca980b5f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:03.101006 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99046863-10b4-4e5f-bd70-abaca980b5f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:03.101325 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99046863-10b4-4e5f-bd70-abaca980b5f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:03.102737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99046863-10b4-4e5f-bd70-abaca980b5f8 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:03.113362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 631/1257] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:03.119092 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629db27-518e-4169-94aa-6316ce63019e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:03.219048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629db27-518e-4169-94aa-6316ce63019e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:03.252419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e4c45-7158-4d68-9a44-e335751a66fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:03.253064 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e4c45-7158-4d68-9a44-e335751a66fb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:03.253342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e4c45-7158-4d68-9a44-e335751a66fb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:03.253608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e4c45-7158-4d68-9a44-e335751a66fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:03.260267 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e4c45-7158-4d68-9a44-e335751a66fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:03.261750 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e4c45-7158-4d68-9a44-e335751a66fb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-2d7e4c45-7158-4d68-9a44-e335751a66fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:25:03.274591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:03.275443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:03.276391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:25:03.276391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:25:03.276391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:25:03.276391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:25:03.276391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:25:03.276391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:25:03.276391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:25:03.276391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:25:03.276391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 627/1258] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:03.283846 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99046863-10b4-4e5f-bd70-abaca980b5f8 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:03.410027 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99046863-10b4-4e5f-bd70-abaca980b5f8 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:03.447849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b4553-98cb-49a7-a40d-cda79c2f71ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:03.452150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b4553-98cb-49a7-a40d-cda79c2f71ed None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:03.452150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b4553-98cb-49a7-a40d-cda79c2f71ed None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:03.452150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b4553-98cb-49a7-a40d-cda79c2f71ed None admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:03.452150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b4553-98cb-49a7-a40d-cda79c2f71ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:03.452150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b4553-98cb-49a7-a40d-cda79c2f71ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:03.452150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b4553-98cb-49a7-a40d-cda79c2f71ed None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:03.464178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 632/1259] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:25:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:03.471181 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e4c45-7158-4d68-9a44-e335751a66fb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:03.499651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:03.581403 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e4c45-7158-4d68-9a44-e335751a66fb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:03.622685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392841d-445b-4f16-90c8-c44a939a1d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:03.623811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392841d-445b-4f16-90c8-c44a939a1d5b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:03.624148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392841d-445b-4f16-90c8-c44a939a1d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:03.624523 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392841d-445b-4f16-90c8-c44a939a1d5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:03.625281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392841d-445b-4f16-90c8-c44a939a1d5b None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=931a947711a2468baaeef701bbee60c3) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:03.625589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392841d-445b-4f16-90c8-c44a939a1d5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:03.627011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392841d-445b-4f16-90c8-c44a939a1d5b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:03.632355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 628/1260] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:25:03 2022] GET /identity/v3/role_assignments?user.id=931a947711a2468baaeef701bbee60c3&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:05.747699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d416a7-82f2-43fb-9572-4765a68d8d90 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:05.748262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d416a7-82f2-43fb-9572-4765a68d8d90 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:05.748262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d416a7-82f2-43fb-9572-4765a68d8d90 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:05.749623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 633/1261] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:25:05.754858 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000f4e7-0049-482c-9f9d-f0e6be8d9a53 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:05.755271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000f4e7-0049-482c-9f9d-f0e6be8d9a53 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:05.755385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000f4e7-0049-482c-9f9d-f0e6be8d9a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:05.773894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f000f4e7-0049-482c-9f9d-f0e6be8d9a53 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:25:05.775085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f000f4e7-0049-482c-9f9d-f0e6be8d9a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:25:05.839657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 629/1262] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:25:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:25:06.113345 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d416a7-82f2-43fb-9572-4765a68d8d90 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:06.124593 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:06.215883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d416a7-82f2-43fb-9572-4765a68d8d90 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:06.250696 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc17707-bd81-4e72-aef7-0323d7fbbb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:06.251321 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc17707-bd81-4e72-aef7-0323d7fbbb78 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:06.251599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc17707-bd81-4e72-aef7-0323d7fbbb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:06.251868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc17707-bd81-4e72-aef7-0323d7fbbb78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:06.261802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc17707-bd81-4e72-aef7-0323d7fbbb78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-1bc17707-bd81-4e72-aef7-0323d7fbbb78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:25:06.267161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:06.268238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:06.269261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:06.269261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:06.269261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:06.269261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:06.269261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:25:06.269261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:25:06.269261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:25:06.269261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:25:06.269261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:25:06.269261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:25:06.269261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:25:06.269261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:25:06.269261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 634/1263] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:25:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:06.274423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000f4e7-0049-482c-9f9d-f0e6be8d9a53 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:06.293561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:06.372095 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000f4e7-0049-482c-9f9d-f0e6be8d9a53 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:06.407435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ab73e-ea2f-44a7-b971-015bcbd2ebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:06.408036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ab73e-ea2f-44a7-b971-015bcbd2ebe1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:06.408309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ab73e-ea2f-44a7-b971-015bcbd2ebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:06.408574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ab73e-ea2f-44a7-b971-015bcbd2ebe1 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:06.409255 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ab73e-ea2f-44a7-b971-015bcbd2ebe1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:06.409555 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ab73e-ea2f-44a7-b971-015bcbd2ebe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:06.411014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ab73e-ea2f-44a7-b971-015bcbd2ebe1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:06.418884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 630/1264] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:25:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:06.425456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc17707-bd81-4e72-aef7-0323d7fbbb78 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:06.491037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:06.523164 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc17707-bd81-4e72-aef7-0323d7fbbb78 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:06.556673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd2e41-9f17-4e39-8dc5-ad875146d9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:06.557330 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd2e41-9f17-4e39-8dc5-ad875146d9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:06.557607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd2e41-9f17-4e39-8dc5-ad875146d9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:06.557877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd2e41-9f17-4e39-8dc5-ad875146d9a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:06.568009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd2e41-9f17-4e39-8dc5-ad875146d9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:06.569489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd2e41-9f17-4e39-8dc5-ad875146d9a5 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-64fd2e41-9f17-4e39-8dc5-ad875146d9a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:25:06.583562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:06.584626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:25:06.585674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:25:06.585674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:25:06.585674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:25:06.585674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 635/1265] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:06.590521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ab73e-ea2f-44a7-b971-015bcbd2ebe1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:06.672677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:06.692496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ab73e-ea2f-44a7-b971-015bcbd2ebe1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:06.725904 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49c998-d9bb-44a7-a318-d0721cdce0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:06.726504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49c998-d9bb-44a7-a318-d0721cdce0db None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:06.726784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49c998-d9bb-44a7-a318-d0721cdce0db None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:06.727058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49c998-d9bb-44a7-a318-d0721cdce0db None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:06.727697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49c998-d9bb-44a7-a318-d0721cdce0db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:06.728000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49c998-d9bb-44a7-a318-d0721cdce0db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:06.729414 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49c998-d9bb-44a7-a318-d0721cdce0db None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:06.742430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 631/1266] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:06.748919 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd2e41-9f17-4e39-8dc5-ad875146d9a5 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:06.853116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd2e41-9f17-4e39-8dc5-ad875146d9a5 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:06.872716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:06.887270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2f62e-1597-4693-9039-b751e5d20386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:06.887943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2f62e-1597-4693-9039-b751e5d20386 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:06.888221 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2f62e-1597-4693-9039-b751e5d20386 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:06.888523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2f62e-1597-4693-9039-b751e5d20386 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:06.896263 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2f62e-1597-4693-9039-b751e5d20386 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:06.897747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2f62e-1597-4693-9039-b751e5d20386 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-a1f2f62e-1597-4693-9039-b751e5d20386 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:25:06.908749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:06.916421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:06.917571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:06.917571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:06.917571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:25:06.917571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:25:06.917571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:25:06.917571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:25:06.917571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:25:06.917571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:25:06.917571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 04:25:06.917571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:25:06.917571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 636/1267] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:25:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:06.918290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49c998-d9bb-44a7-a318-d0721cdce0db None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:07.015154 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49c998-d9bb-44a7-a318-d0721cdce0db None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:07.048388 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8c629-2ad8-4251-a0c0-da8336bbb07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:07.048982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c629-2ad8-4251-a0c0-da8336bbb07d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:07.049281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c629-2ad8-4251-a0c0-da8336bbb07d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:07.049548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c629-2ad8-4251-a0c0-da8336bbb07d None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:07.050276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8c629-2ad8-4251-a0c0-da8336bbb07d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:07.050578 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8c629-2ad8-4251-a0c0-da8336bbb07d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:07.052001 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8c629-2ad8-4251-a0c0-da8336bbb07d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:07.061389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:07.069719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 632/1268] 10.222.0.50 () {56 vars in 1143 bytes} [Sat Sep 17 04:25:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:07.075601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2f62e-1597-4693-9039-b751e5d20386 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:07.172885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2f62e-1597-4693-9039-b751e5d20386 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:07.206004 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dda1d4-8796-44f2-b069-4dc1c650ad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:07.206625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dda1d4-8796-44f2-b069-4dc1c650ad83 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:07.206902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dda1d4-8796-44f2-b069-4dc1c650ad83 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:07.207185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dda1d4-8796-44f2-b069-4dc1c650ad83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:07.218208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dda1d4-8796-44f2-b069-4dc1c650ad83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:07.219651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dda1d4-8796-44f2-b069-4dc1c650ad83 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-93dda1d4-8796-44f2-b069-4dc1c650ad83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:25:07.234152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:07.235236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:25:07.236191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:25:07.236191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:25:07.236191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:25:07.236191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 637/1269] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:07.241119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8c629-2ad8-4251-a0c0-da8336bbb07d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:07.338247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8c629-2ad8-4251-a0c0-da8336bbb07d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:07.372449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26df6ae-e7a7-4b9e-baf0-d5e72f88788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:07.373198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26df6ae-e7a7-4b9e-baf0-d5e72f88788e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:07.373479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26df6ae-e7a7-4b9e-baf0-d5e72f88788e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:07.373753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26df6ae-e7a7-4b9e-baf0-d5e72f88788e None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:07.374398 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26df6ae-e7a7-4b9e-baf0-d5e72f88788e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:07.374705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26df6ae-e7a7-4b9e-baf0-d5e72f88788e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:07.376094 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26df6ae-e7a7-4b9e-baf0-d5e72f88788e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:07.387254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 633/1270] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:07.393113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dda1d4-8796-44f2-b069-4dc1c650ad83 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:07.424953 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:07.491044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dda1d4-8796-44f2-b069-4dc1c650ad83 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:07.523715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a392175-08f3-4594-94a6-139ec5a49580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:07.524331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a392175-08f3-4594-94a6-139ec5a49580 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:07.524604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a392175-08f3-4594-94a6-139ec5a49580 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:07.524868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a392175-08f3-4594-94a6-139ec5a49580 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:07.532199 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a392175-08f3-4594-94a6-139ec5a49580 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:07.537615 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a392175-08f3-4594-94a6-139ec5a49580 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-0a392175-08f3-4594-94a6-139ec5a49580 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:25:07.544641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:07.545798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:07.546886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:25:07.546886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:25:07.546886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:25:07.546886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:25:07.546886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:25:07.546886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:25:07.546886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:25:07.546886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:25:07.546886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 638/1271] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:25:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:07.551767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26df6ae-e7a7-4b9e-baf0-d5e72f88788e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:07.610534 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:07.649984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26df6ae-e7a7-4b9e-baf0-d5e72f88788e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:07.682284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66087994-e0ba-4201-bcac-7a57eab0083b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:07.682873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66087994-e0ba-4201-bcac-7a57eab0083b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:07.683148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66087994-e0ba-4201-bcac-7a57eab0083b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:07.683412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66087994-e0ba-4201-bcac-7a57eab0083b None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:07.684085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66087994-e0ba-4201-bcac-7a57eab0083b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:07.684383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66087994-e0ba-4201-bcac-7a57eab0083b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:07.686071 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66087994-e0ba-4201-bcac-7a57eab0083b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:07.697640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 634/1272] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:25:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:07.704362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a392175-08f3-4594-94a6-139ec5a49580 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:07.797392 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:07.806115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a392175-08f3-4594-94a6-139ec5a49580 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:07.838371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cfa25-322f-4473-b733-6b6067185fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:07.839093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cfa25-322f-4473-b733-6b6067185fe4 None admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:07.839381 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cfa25-322f-4473-b733-6b6067185fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:07.839654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cfa25-322f-4473-b733-6b6067185fe4 None admin] PATH_INFO: `/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/931a947711a2468baaeef701bbee60c3/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:07.841558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cfa25-322f-4473-b733-6b6067185fe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d50a1cd322404bd4b0fa7a8c388dc217, user_id=931a947711a2468baaeef701bbee60c3, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:07.842974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cfa25-322f-4473-b733-6b6067185fe4 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:07.990248 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 639/1273] 10.222.0.50 () {58 vars in 1439 bytes} [Sat Sep 17 04:25:07 2022] PUT /identity/v3/projects/d50a1cd322404bd4b0fa7a8c388dc217/users/931a947711a2468baaeef701bbee60c3/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:25:10.109284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e5723-90f8-42f9-adf9-7768ec380063 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:10.109855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e5723-90f8-42f9-adf9-7768ec380063 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:10.109855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e5723-90f8-42f9-adf9-7768ec380063 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:10.111227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 635/1274] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:25:10.116614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccae3f-ebf8-4e1f-b0fc-bcc5ebf98d5c None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:10.117057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccae3f-ebf8-4e1f-b0fc-bcc5ebf98d5c None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:10.117348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccae3f-ebf8-4e1f-b0fc-bcc5ebf98d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:10.136564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-8dccae3f-ebf8-4e1f-b0fc-bcc5ebf98d5c None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:25:10.137799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8dccae3f-ebf8-4e1f-b0fc-bcc5ebf98d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:25:10.206389 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 640/1275] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:25:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 04:25:10.473589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e5723-90f8-42f9-adf9-7768ec380063 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:10.573109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e5723-90f8-42f9-adf9-7768ec380063 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:10.590889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:10.607509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15820b-60f9-4b51-b526-2d183876fefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:10.608152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15820b-60f9-4b51-b526-2d183876fefe None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:10.608425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15820b-60f9-4b51-b526-2d183876fefe None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:10.608693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15820b-60f9-4b51-b526-2d183876fefe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:10.618368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15820b-60f9-4b51-b526-2d183876fefe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-fc15820b-60f9-4b51-b526-2d183876fefe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 04:25:10.623547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:10.624677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:10.625609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:10.625609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:10.625609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:10.625609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:10.625609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 04:25:10.625609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 04:25:10.625609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 04:25:10.625609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 04:25:10.625609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 04:25:10.625609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 04:25:10.625609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 04:25:10.625609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:25:10.625609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 636/1276] 10.222.0.50 () {56 vars in 1096 bytes} [Sat Sep 17 04:25:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:10.630906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccae3f-ebf8-4e1f-b0fc-bcc5ebf98d5c None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:10.711592 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:10.729401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccae3f-ebf8-4e1f-b0fc-bcc5ebf98d5c None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:10.761988 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c3a71-3c52-47c8-b052-9a96819db8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:10.762588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c3a71-3c52-47c8-b052-9a96819db8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:10.762862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c3a71-3c52-47c8-b052-9a96819db8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:10.763637 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c3a71-3c52-47c8-b052-9a96819db8f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:10.764576 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c3a71-3c52-47c8-b052-9a96819db8f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:10.764881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c3a71-3c52-47c8-b052-9a96819db8f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:10.766296 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c3a71-3c52-47c8-b052-9a96819db8f5 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:10.774146 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 641/1277] 10.222.0.50 () {56 vars in 1099 bytes} [Sat Sep 17 04:25:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:10.780883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15820b-60f9-4b51-b526-2d183876fefe None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:10.879915 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15820b-60f9-4b51-b526-2d183876fefe None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:10.912426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede1b53-f38a-418e-8df8-4b120fd0f336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:10.913058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede1b53-f38a-418e-8df8-4b120fd0f336 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:10.913366 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede1b53-f38a-418e-8df8-4b120fd0f336 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:10.913641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede1b53-f38a-418e-8df8-4b120fd0f336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:10.923363 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede1b53-f38a-418e-8df8-4b120fd0f336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:10.924818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede1b53-f38a-418e-8df8-4b120fd0f336 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0ede1b53-f38a-418e-8df8-4b120fd0f336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:25:10.939651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:10.940688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:25:10.941737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:25:10.941737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:25:10.941737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:25:10.941737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 637/1278] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:25:10.946505 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c3a71-3c52-47c8-b052-9a96819db8f5 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:11.045015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c3a71-3c52-47c8-b052-9a96819db8f5 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:11.078407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f3cd-2aca-44f5-b6c0-09182f27da16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:11.078993 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f3cd-2aca-44f5-b6c0-09182f27da16 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:11.079262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f3cd-2aca-44f5-b6c0-09182f27da16 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:11.079526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f3cd-2aca-44f5-b6c0-09182f27da16 None admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:11.080157 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3f3cd-2aca-44f5-b6c0-09182f27da16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:11.080452 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3f3cd-2aca-44f5-b6c0-09182f27da16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:11.081829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3f3cd-2aca-44f5-b6c0-09182f27da16 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:11.093148 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 642/1279] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:11.098907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede1b53-f38a-418e-8df8-4b120fd0f336 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:11.130431 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:11.197508 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede1b53-f38a-418e-8df8-4b120fd0f336 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:11.229201 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87129b6c-da20-4f67-9be0-240cf789ebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:11.229814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87129b6c-da20-4f67-9be0-240cf789ebf2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:11.230084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87129b6c-da20-4f67-9be0-240cf789ebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:11.230347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87129b6c-da20-4f67-9be0-240cf789ebf2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:11.238015 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87129b6c-da20-4f67-9be0-240cf789ebf2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:11.239435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87129b6c-da20-4f67-9be0-240cf789ebf2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-87129b6c-da20-4f67-9be0-240cf789ebf2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 04:25:11.251250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:11.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:11.253283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:11.253283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:11.253283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 04:25:11.253283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 04:25:11.253283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 04:25:11.253283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 04:25:11.253283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 04:25:11.253283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 04:25:11.253283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 04:25:11.253283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:25:11.254241 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 638/1280] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:25:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:11.258201 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f3cd-2aca-44f5-b6c0-09182f27da16 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:11.266041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:11.356154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f3cd-2aca-44f5-b6c0-09182f27da16 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:11.390449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05f9e1-c47c-442f-9875-6e7e793e8402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:11.391040 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05f9e1-c47c-442f-9875-6e7e793e8402 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:11.391313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05f9e1-c47c-442f-9875-6e7e793e8402 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:11.391580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05f9e1-c47c-442f-9875-6e7e793e8402 None admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:11.392290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05f9e1-c47c-442f-9875-6e7e793e8402 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:11.392590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05f9e1-c47c-442f-9875-6e7e793e8402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:11.394035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05f9e1-c47c-442f-9875-6e7e793e8402 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:11.410939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 643/1281] 10.222.0.50 () {56 vars in 1143 bytes} [Sat Sep 17 04:25:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:25:11.416769 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87129b6c-da20-4f67-9be0-240cf789ebf2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:11.507137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:11.516801 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87129b6c-da20-4f67-9be0-240cf789ebf2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:11.549771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b50bef-91b2-4bac-aefc-704f72f698c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:11.550373 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50bef-91b2-4bac-aefc-704f72f698c6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:11.550652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50bef-91b2-4bac-aefc-704f72f698c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:11.550943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50bef-91b2-4bac-aefc-704f72f698c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:11.618530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b50bef-91b2-4bac-aefc-704f72f698c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:11.619945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b50bef-91b2-4bac-aefc-704f72f698c6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:11.706474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:11.717088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 639/1282] 10.222.0.50 () {58 vars in 1282 bytes} [Sat Sep 17 04:25:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 04:25:11.723026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05f9e1-c47c-442f-9875-6e7e793e8402 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:11.782389 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:11.819528 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05f9e1-c47c-442f-9875-6e7e793e8402 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:11.852054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c029fe4-41db-4a27-b7ca-523c1a9cea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:11.852664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c029fe4-41db-4a27-b7ca-523c1a9cea0e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:11.852934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c029fe4-41db-4a27-b7ca-523c1a9cea0e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:11.853225 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c029fe4-41db-4a27-b7ca-523c1a9cea0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:11.863407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c029fe4-41db-4a27-b7ca-523c1a9cea0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:11.864830 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c029fe4-41db-4a27-b7ca-523c1a9cea0e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-9c029fe4-41db-4a27-b7ca-523c1a9cea0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 04:25:11.879141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:11.880268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 04:25:11.881214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 04:25:11.881214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 04:25:11.881214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:25:11.881214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 644/1283] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 04:25:11.885877 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b50bef-91b2-4bac-aefc-704f72f698c6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:11.983326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b50bef-91b2-4bac-aefc-704f72f698c6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:12.017490 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e60a08-e402-4edb-8226-33c9ca49ecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:12.018086 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60a08-e402-4edb-8226-33c9ca49ecad None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:12.018362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60a08-e402-4edb-8226-33c9ca49ecad None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:12.018628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60a08-e402-4edb-8226-33c9ca49ecad None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:12.019263 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e60a08-e402-4edb-8226-33c9ca49ecad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:12.019563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e60a08-e402-4edb-8226-33c9ca49ecad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:12.020932 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e60a08-e402-4edb-8226-33c9ca49ecad None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:12.032335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 640/1284] 10.222.0.50 () {56 vars in 1109 bytes} [Sat Sep 17 04:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:25:12.038196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c029fe4-41db-4a27-b7ca-523c1a9cea0e None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:12.140450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c029fe4-41db-4a27-b7ca-523c1a9cea0e None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:12.154612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:12.174151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d42d92-a5dc-4df3-8898-f679ab6e6c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:12.174772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d42d92-a5dc-4df3-8898-f679ab6e6c67 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:12.175046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d42d92-a5dc-4df3-8898-f679ab6e6c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:12.181497 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d42d92-a5dc-4df3-8898-f679ab6e6c67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:12.181676 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d42d92-a5dc-4df3-8898-f679ab6e6c67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:12.183098 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d42d92-a5dc-4df3-8898-f679ab6e6c67 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application [None req-18d42d92-a5dc-4df3-8898-f679ab6e6c67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 04:25:12.193912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:12.194957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:12.196075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 04:25:12.196075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 04:25:12.196075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 04:25:12.196075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 04:25:12.196075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 04:25:12.196075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 04:25:12.196075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 04:25:12.196075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: ERROR keystone.server.flask.application Sep 17 04:25:12.196075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 645/1285] 10.222.0.50 () {56 vars in 1111 bytes} [Sat Sep 17 04:25:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:12.201732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e60a08-e402-4edb-8226-33c9ca49ecad None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:12.250646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:12.303319 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e60a08-e402-4edb-8226-33c9ca49ecad None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:12.336753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733d573-8cfb-450e-ba0a-5d15cb160b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:12.337387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733d573-8cfb-450e-ba0a-5d15cb160b65 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:12.341982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733d573-8cfb-450e-ba0a-5d15cb160b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:12.341982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733d573-8cfb-450e-ba0a-5d15cb160b65 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:12.341982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733d573-8cfb-450e-ba0a-5d15cb160b65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:12.341982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733d573-8cfb-450e-ba0a-5d15cb160b65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:12.341982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733d573-8cfb-450e-ba0a-5d15cb160b65 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:12.352733 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 641/1286] 10.222.0.50 () {56 vars in 1148 bytes} [Sat Sep 17 04:25:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:12.358791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d42d92-a5dc-4df3-8898-f679ab6e6c67 None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:12.456875 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d42d92-a5dc-4df3-8898-f679ab6e6c67 None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:12.488661 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279291dc-e173-4753-8af5-c5ad6ed747f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:12.489279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279291dc-e173-4753-8af5-c5ad6ed747f2 None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:12.489552 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279291dc-e173-4753-8af5-c5ad6ed747f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:12.489823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279291dc-e173-4753-8af5-c5ad6ed747f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:12.490533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279291dc-e173-4753-8af5-c5ad6ed747f2 None admin] RBAC: Adding query filter params (role.id=d31c9bcceec14f299f8c48936cf25f63, scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217, user.id=931a947711a2468baaeef701bbee60c3) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:12.490829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279291dc-e173-4753-8af5-c5ad6ed747f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:12.492236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279291dc-e173-4753-8af5-c5ad6ed747f2 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:12.498805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 646/1287] 10.222.0.50 () {56 vars in 1374 bytes} [Sat Sep 17 04:25:12 2022] GET /identity/v3/role_assignments?user.id=931a947711a2468baaeef701bbee60c3&scope.project.id=d50a1cd322404bd4b0fa7a8c388dc217&role.id=d31c9bcceec14f299f8c48936cf25f63 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:14.675493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa77c8-23fd-4655-a0c3-1482527bbb30 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:14.676054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa77c8-23fd-4655-a0c3-1482527bbb30 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:14.676054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa77c8-23fd-4655-a0c3-1482527bbb30 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:14.677463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 642/1288] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:25:14.682921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad3b5-db7d-42b5-90c3-ab383240c490 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:14.683338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad3b5-db7d-42b5-90c3-ab383240c490 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:14.683477 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad3b5-db7d-42b5-90c3-ab383240c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:14.701460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-f89ad3b5-db7d-42b5-90c3-ab383240c490 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:25:14.702623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f89ad3b5-db7d-42b5-90c3-ab383240c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:25:14.731149 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:14.768055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 647/1289] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:25:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:25:15.040084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa77c8-23fd-4655-a0c3-1482527bbb30 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:15.140406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa77c8-23fd-4655-a0c3-1482527bbb30 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:15.151122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:15.174682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594905d8-1651-4de4-bc6c-260cf8915a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:15.175308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594905d8-1651-4de4-bc6c-260cf8915a88 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:15.175585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594905d8-1651-4de4-bc6c-260cf8915a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:15.175854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594905d8-1651-4de4-bc6c-260cf8915a88 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:15.176464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594905d8-1651-4de4-bc6c-260cf8915a88 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:15.177867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594905d8-1651-4de4-bc6c-260cf8915a88 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-594905d8-1651-4de4-bc6c-260cf8915a88 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:15.187231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:15.188444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:25:15.189340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 643/1290] 10.222.0.50 () {56 vars in 1117 bytes} [Sat Sep 17 04:25:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:15.194538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ad3b5-db7d-42b5-90c3-ab383240c490 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:15.291500 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ad3b5-db7d-42b5-90c3-ab383240c490 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:15.324120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383f6bf-8962-498a-9706-d6af4dbb383f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:15.324831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f6bf-8962-498a-9706-d6af4dbb383f None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:15.325136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f6bf-8962-498a-9706-d6af4dbb383f None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:15.329613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f6bf-8962-498a-9706-d6af4dbb383f None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:15.329613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383f6bf-8962-498a-9706-d6af4dbb383f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:15.329613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383f6bf-8962-498a-9706-d6af4dbb383f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:15.329613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383f6bf-8962-498a-9706-d6af4dbb383f None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:15.332858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 648/1291] 10.222.0.50 () {56 vars in 1116 bytes} [Sat Sep 17 04:25:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:15.338723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594905d8-1651-4de4-bc6c-260cf8915a88 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:15.436859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594905d8-1651-4de4-bc6c-260cf8915a88 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:15.470278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e3cba-3c8c-4d3a-9ee8-06fcf63b48ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:15.470873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e3cba-3c8c-4d3a-9ee8-06fcf63b48ce None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:15.471152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e3cba-3c8c-4d3a-9ee8-06fcf63b48ce None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:15.471424 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e3cba-3c8c-4d3a-9ee8-06fcf63b48ce None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:15.472053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e3cba-3c8c-4d3a-9ee8-06fcf63b48ce None admin] RBAC: Adding query filter params (type=placement) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:15.472355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e3cba-3c8c-4d3a-9ee8-06fcf63b48ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:15.473749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e3cba-3c8c-4d3a-9ee8-06fcf63b48ce None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:15.478060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 644/1292] 10.222.0.50 () {56 vars in 1116 bytes} [Sat Sep 17 04:25:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:17.608530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be53fc8-8109-4a5c-bdbd-f90183532afb None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:17.609077 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be53fc8-8109-4a5c-bdbd-f90183532afb None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:17.609195 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be53fc8-8109-4a5c-bdbd-f90183532afb None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:17.610472 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 649/1293] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:25:17.616047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6880b-72ca-45ac-bbaa-a0e63ad726cc None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:17.616418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6880b-72ca-45ac-bbaa-a0e63ad726cc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:17.616593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6880b-72ca-45ac-bbaa-a0e63ad726cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:17.635288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1ed6880b-72ca-45ac-bbaa-a0e63ad726cc None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:25:17.636453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1ed6880b-72ca-45ac-bbaa-a0e63ad726cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:25:17.665511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:17.702167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 645/1294] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:25:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:25:17.969316 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be53fc8-8109-4a5c-bdbd-f90183532afb None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:18.005384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:18.072705 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be53fc8-8109-4a5c-bdbd-f90183532afb None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:18.105739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ec1b4-e427-4450-b86f-1a8599301fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:18.106326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ec1b4-e427-4450-b86f-1a8599301fe5 None admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:18.106599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ec1b4-e427-4450-b86f-1a8599301fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:18.107389 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ec1b4-e427-4450-b86f-1a8599301fe5 None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:18.108116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ec1b4-e427-4450-b86f-1a8599301fe5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:18.109508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ec1b4-e427-4450-b86f-1a8599301fe5 None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:18.210258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 650/1295] 10.222.0.50 () {60 vars in 1141 bytes} [Sat Sep 17 04:25:17 2022] POST /identity/v3/services => generated 246 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:25:20.376520 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5f0b-50e3-49c4-a00d-4c163ef848b9 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:20.377137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5f0b-50e3-49c4-a00d-4c163ef848b9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:20.377137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5f0b-50e3-49c4-a00d-4c163ef848b9 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:20.378438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 646/1296] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:25:20.383640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986534a-9aac-4848-b7c8-58651d173319 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:20.384037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986534a-9aac-4848-b7c8-58651d173319 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:20.384171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986534a-9aac-4848-b7c8-58651d173319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:20.402191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2986534a-9aac-4848-b7c8-58651d173319 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:25:20.403444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2986534a-9aac-4848-b7c8-58651d173319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:25:20.473954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 651/1297] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:25:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:25:20.746221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b5f0b-50e3-49c4-a00d-4c163ef848b9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:20.843898 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b5f0b-50e3-49c4-a00d-4c163ef848b9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:20.877742 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cef82d-38fd-4e38-bc9a-4f1c66334f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:20.878352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cef82d-38fd-4e38-bc9a-4f1c66334f6d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:20.878621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cef82d-38fd-4e38-bc9a-4f1c66334f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:20.878884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cef82d-38fd-4e38-bc9a-4f1c66334f6d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:20.879453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cef82d-38fd-4e38-bc9a-4f1c66334f6d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:20.880801 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cef82d-38fd-4e38-bc9a-4f1c66334f6d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-49cef82d-38fd-4e38-bc9a-4f1c66334f6d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:20.889301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:20.890483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:25:20.891346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 647/1298] 10.222.0.50 () {56 vars in 1117 bytes} [Sat Sep 17 04:25:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:20.896618 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986534a-9aac-4848-b7c8-58651d173319 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:20.915023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:20.993468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986534a-9aac-4848-b7c8-58651d173319 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:21.026052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d14254-8e53-4de2-a21a-5a5245efe67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:21.026585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d14254-8e53-4de2-a21a-5a5245efe67e None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:21.026855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d14254-8e53-4de2-a21a-5a5245efe67e None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:21.027122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d14254-8e53-4de2-a21a-5a5245efe67e None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:21.027741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d14254-8e53-4de2-a21a-5a5245efe67e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:21.028039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d14254-8e53-4de2-a21a-5a5245efe67e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:21.029990 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d14254-8e53-4de2-a21a-5a5245efe67e None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:21.034961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 652/1299] 10.222.0.50 () {56 vars in 1116 bytes} [Sat Sep 17 04:25:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:21.041120 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cef82d-38fd-4e38-bc9a-4f1c66334f6d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:21.074013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:21.146918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cef82d-38fd-4e38-bc9a-4f1c66334f6d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:21.182561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015a8aa-a761-40bb-b609-1aa347948885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:21.183185 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015a8aa-a761-40bb-b609-1aa347948885 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:21.183448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015a8aa-a761-40bb-b609-1aa347948885 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:21.183719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015a8aa-a761-40bb-b609-1aa347948885 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:21.184417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015a8aa-a761-40bb-b609-1aa347948885 None admin] RBAC: Adding query filter params (interface=public, service_id=e20256d71a584ac291f0cd764074adfe, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:21.185285 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015a8aa-a761-40bb-b609-1aa347948885 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:21.186652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015a8aa-a761-40bb-b609-1aa347948885 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:21.191647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 648/1300] 10.222.0.50 () {56 vars in 1251 bytes} [Sat Sep 17 04:25:21 2022] GET /identity/v3/endpoints?service_id=e20256d71a584ac291f0cd764074adfe&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:21.197377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d14254-8e53-4de2-a21a-5a5245efe67e None admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:21.277340 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:21.296047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d14254-8e53-4de2-a21a-5a5245efe67e None admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:21.330393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580e73b-9412-4560-9635-521eada1bdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:21.330990 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580e73b-9412-4560-9635-521eada1bdaf None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:21.331266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580e73b-9412-4560-9635-521eada1bdaf None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:21.331536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580e73b-9412-4560-9635-521eada1bdaf None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:21.332133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580e73b-9412-4560-9635-521eada1bdaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:21.333558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580e73b-9412-4560-9635-521eada1bdaf None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:21.340259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 653/1301] 10.222.0.50 () {56 vars in 1087 bytes} [Sat Sep 17 04:25:21 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:25:23.556566 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752ae1e-24ee-4a38-aa2c-817b9973eef3 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:23.557209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752ae1e-24ee-4a38-aa2c-817b9973eef3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:23.557209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752ae1e-24ee-4a38-aa2c-817b9973eef3 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:23.558496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 649/1302] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:25:23.564096 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3cac0-48fb-4224-a4dc-9146730416e8 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:23.564518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3cac0-48fb-4224-a4dc-9146730416e8 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:23.564669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3cac0-48fb-4224-a4dc-9146730416e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:23.583172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-6bb3cac0-48fb-4224-a4dc-9146730416e8 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:25:23.584340 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6bb3cac0-48fb-4224-a4dc-9146730416e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:25:23.651062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 654/1303] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:25:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 04:25:23.927575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752ae1e-24ee-4a38-aa2c-817b9973eef3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:24.022616 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:24.029120 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752ae1e-24ee-4a38-aa2c-817b9973eef3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:24.061806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b6930-c6d6-45db-b960-db571cf0d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:24.062420 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b6930-c6d6-45db-b960-db571cf0d59b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:24.062691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b6930-c6d6-45db-b960-db571cf0d59b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:24.062954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b6930-c6d6-45db-b960-db571cf0d59b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:24.063531 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b6930-c6d6-45db-b960-db571cf0d59b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:24.064875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b6930-c6d6-45db-b960-db571cf0d59b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-375b6930-c6d6-45db-b960-db571cf0d59b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 04:25:24.073352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 04:25:24.074535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 17 04:25:24.075788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 650/1304] 10.222.0.50 () {56 vars in 1117 bytes} [Sat Sep 17 04:25:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 04:25:24.080559 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3cac0-48fb-4224-a4dc-9146730416e8 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:24.156436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:24.179836 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3cac0-48fb-4224-a4dc-9146730416e8 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:24.213602 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22054a-addc-4eca-810b-2aea134940cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:24.214200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22054a-addc-4eca-810b-2aea134940cc None admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:24.214482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22054a-addc-4eca-810b-2aea134940cc None admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:24.214756 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22054a-addc-4eca-810b-2aea134940cc None admin] PATH_INFO: `/v3/services` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:24.215409 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22054a-addc-4eca-810b-2aea134940cc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:25:24.216168 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22054a-addc-4eca-810b-2aea134940cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:24.217571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22054a-addc-4eca-810b-2aea134940cc None admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:24.222546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 655/1305] 10.222.0.50 () {56 vars in 1116 bytes} [Sat Sep 17 04:25:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:25:24.228453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b6930-c6d6-45db-b960-db571cf0d59b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:25:24.332090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b6930-c6d6-45db-b960-db571cf0d59b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:25:24.364859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d20a5-a370-42d9-b6b9-0c247f73c510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:25:24.365489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d20a5-a370-42d9-b6b9-0c247f73c510 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:25:24.365766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d20a5-a370-42d9-b6b9-0c247f73c510 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:25:24.366037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d20a5-a370-42d9-b6b9-0c247f73c510 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:25:24.366702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d20a5-a370-42d9-b6b9-0c247f73c510 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:25:24.368053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d20a5-a370-42d9-b6b9-0c247f73c510 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:25:24.491232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 651/1306] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:25:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:25:34.257043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=30 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:25:34.487073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:31:49.715458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc634ce-7a05-4c78-a15b-1da591819a28 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:31:49.715918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc634ce-7a05-4c78-a15b-1da591819a28 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:31:49.715918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc634ce-7a05-4c78-a15b-1da591819a28 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:31:49.722777 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd33d70-8f7c-49bf-bbba-bf5bea15825e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:31:49.723196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd33d70-8f7c-49bf-bbba-bf5bea15825e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:31:49.723303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd33d70-8f7c-49bf-bbba-bf5bea15825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:31:49.726439 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 656/1307] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:31:49 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:31:49.801409 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-abd33d70-8f7c-49bf-bbba-bf5bea15825e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:31:49.802613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-abd33d70-8f7c-49bf-bbba-bf5bea15825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:31:49.921540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 652/1308] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:31:50.211648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f264a-f8f1-49bb-b456-fc32bc7d1ccf None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:31:50.212167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f264a-f8f1-49bb-b456-fc32bc7d1ccf None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:31:50.212546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f264a-f8f1-49bb-b456-fc32bc7d1ccf None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:31:50.214294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 657/1309] 10.222.0.50 () {54 vars in 963 bytes} [Sat Sep 17 04:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:31:50.220975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a4da-128f-4673-a8b6-440f90acb986 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:31:50.221297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a4da-128f-4673-a8b6-440f90acb986 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:31:50.221564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a4da-128f-4673-a8b6-440f90acb986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:31:50.308962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e989a4da-128f-4673-a8b6-440f90acb986 None None] MFA Rules not processed for user `6469c8860be943168b67ea7fa28bf19d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:31:50.310313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e989a4da-128f-4673-a8b6-440f90acb986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:31:50.332156 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:31:50.391997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 653/1310] 10.222.0.50 () {58 vars in 1060 bytes} [Sat Sep 17 04:31:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:31:50.401715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f264a-f8f1-49bb-b456-fc32bc7d1ccf None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:31:50.403614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8b1f264a-f8f1-49bb-b456-fc32bc7d1ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:31:50.526672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f264a-f8f1-49bb-b456-fc32bc7d1ccf None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:31:50.608887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab1ce2-3079-4e28-ad41-f451b5fad00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:31:50.609433 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1ce2-3079-4e28-ad41-f451b5fad00f service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:31:50.609708 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1ce2-3079-4e28-ad41-f451b5fad00f service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:31:50.609977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1ce2-3079-4e28-ad41-f451b5fad00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:31:50.611546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f6ab1ce2-3079-4e28-ad41-f451b5fad00f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:31:50.669501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:31:50.726096 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab1ce2-3079-4e28-ad41-f451b5fad00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:31:50.727539 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab1ce2-3079-4e28-ad41-f451b5fad00f service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:31:50.747771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 658/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:31:53.205626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820aeea-fdf8-4b03-9b74-33af3decee3e None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:31:53.206122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820aeea-fdf8-4b03-9b74-33af3decee3e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:31:53.206211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820aeea-fdf8-4b03-9b74-33af3decee3e None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:31:53.207498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 654/1312] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:31:53.213286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a8864-c37c-4799-b590-d056d2d88057 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:31:53.213737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a8864-c37c-4799-b590-d056d2d88057 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:31:53.213834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a8864-c37c-4799-b590-d056d2d88057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:31:53.294393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-b33a8864-c37c-4799-b590-d056d2d88057 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:31:53.295583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b33a8864-c37c-4799-b590-d056d2d88057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:31:53.389729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 659/1313] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:31:53.675558 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820aeea-fdf8-4b03-9b74-33af3decee3e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:31:53.677152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3820aeea-fdf8-4b03-9b74-33af3decee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:31:53.781999 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820aeea-fdf8-4b03-9b74-33af3decee3e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:31:53.853569 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:31:53.855735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84597805-dbc9-43dc-8f02-4031d304cf2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:31:53.856321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597805-dbc9-43dc-8f02-4031d304cf2d service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:31:53.856596 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597805-dbc9-43dc-8f02-4031d304cf2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:31:53.856862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597805-dbc9-43dc-8f02-4031d304cf2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:31:53.858484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-84597805-dbc9-43dc-8f02-4031d304cf2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:31:53.967826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84597805-dbc9-43dc-8f02-4031d304cf2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:31:53.969545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84597805-dbc9-43dc-8f02-4031d304cf2d service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:31:53.987771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 655/1314] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:31:56.779954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db1d08-4467-4936-8c02-92f4feb51a72 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:31:56.780496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db1d08-4467-4936-8c02-92f4feb51a72 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:31:56.780496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db1d08-4467-4936-8c02-92f4feb51a72 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:31:56.781953 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 660/1315] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:31:56.787557 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8af41-7ec1-41eb-b574-07fa8d19eba2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:31:56.787984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8af41-7ec1-41eb-b574-07fa8d19eba2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:31:56.788181 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8af41-7ec1-41eb-b574-07fa8d19eba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:31:56.856976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5dd8af41-7ec1-41eb-b574-07fa8d19eba2 None None] MFA Rules not processed for user `c10bdf610c574721a52a78348cf248de`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:31:56.858193 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5dd8af41-7ec1-41eb-b574-07fa8d19eba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:31:56.909653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:31:56.953003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 656/1316] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:31:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:31:57.238775 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db1d08-4467-4936-8c02-92f4feb51a72 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:31:57.240346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-02db1d08-4467-4936-8c02-92f4feb51a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:31:57.249971 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:31:57.341881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db1d08-4467-4936-8c02-92f4feb51a72 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:31:57.416554 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531f640-6dc1-4239-8cb1-a6f061855ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:31:57.417118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531f640-6dc1-4239-8cb1-a6f061855ddd service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:31:57.417394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531f640-6dc1-4239-8cb1-a6f061855ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:31:57.417664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531f640-6dc1-4239-8cb1-a6f061855ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:31:57.419303 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-e531f640-6dc1-4239-8cb1-a6f061855ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:31:57.481675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:31:57.527758 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531f640-6dc1-4239-8cb1-a6f061855ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:31:57.529239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531f640-6dc1-4239-8cb1-a6f061855ddd service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:31:57.547367 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 661/1317] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:31:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:32:00.471700 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2a308-7c2e-4d8b-a654-7e98e4f00867 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:00.472209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2a308-7c2e-4d8b-a654-7e98e4f00867 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:00.472209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2a308-7c2e-4d8b-a654-7e98e4f00867 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:00.473553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 657/1318] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:00.479277 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fe1b2-2006-4450-b2ed-c72ebf3eadfc None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:00.479705 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fe1b2-2006-4450-b2ed-c72ebf3eadfc None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:00.479828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fe1b2-2006-4450-b2ed-c72ebf3eadfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:00.546321 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-4a4fe1b2-2006-4450-b2ed-c72ebf3eadfc None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:00.547508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-4a4fe1b2-2006-4450-b2ed-c72ebf3eadfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:00.640897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 662/1319] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:32:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:00.923919 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2a308-7c2e-4d8b-a654-7e98e4f00867 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:32:00.925479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c9a2a308-7c2e-4d8b-a654-7e98e4f00867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:01.026362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2a308-7c2e-4d8b-a654-7e98e4f00867 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:32:01.098815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27340275-bf77-403e-8658-36740a09ba12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:32:01.099437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27340275-bf77-403e-8658-36740a09ba12 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:01.099681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27340275-bf77-403e-8658-36740a09ba12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:01.099943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27340275-bf77-403e-8658-36740a09ba12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:01.101532 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-27340275-bf77-403e-8658-36740a09ba12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:01.108664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:01.216456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27340275-bf77-403e-8658-36740a09ba12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:32:01.218172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27340275-bf77-403e-8658-36740a09ba12 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:32:01.235470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 658/1320] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:32:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:32:04.374025 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701035a-789c-4e6a-b145-f834bafd747e None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:04.374553 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701035a-789c-4e6a-b145-f834bafd747e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:04.375337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701035a-789c-4e6a-b145-f834bafd747e None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:04.376212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 663/1321] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:04.382277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492de8e-87b7-4d04-a0f0-363ca8bafa7e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:04.382744 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492de8e-87b7-4d04-a0f0-363ca8bafa7e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:04.382837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492de8e-87b7-4d04-a0f0-363ca8bafa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:04.451213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2492de8e-87b7-4d04-a0f0-363ca8bafa7e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:04.452338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2492de8e-87b7-4d04-a0f0-363ca8bafa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:04.515477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:04.562791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 659/1322] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:04.846579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701035a-789c-4e6a-b145-f834bafd747e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:32:04.848126 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a701035a-789c-4e6a-b145-f834bafd747e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:04.869430 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:04.952588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701035a-789c-4e6a-b145-f834bafd747e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:32:05.026674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949dded-eaab-49fd-bb98-3f7c7d241a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:32:05.027280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949dded-eaab-49fd-bb98-3f7c7d241a39 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:05.027558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949dded-eaab-49fd-bb98-3f7c7d241a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:05.027828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949dded-eaab-49fd-bb98-3f7c7d241a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:05.029464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c949dded-eaab-49fd-bb98-3f7c7d241a39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:05.105628 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:05.146441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949dded-eaab-49fd-bb98-3f7c7d241a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:32:05.149037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949dded-eaab-49fd-bb98-3f7c7d241a39 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:32:05.167413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 664/1323] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:32:07.363904 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a7a0b-5d8c-45bd-aac9-53ed5d7a02a9 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:07.365179 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a7a0b-5d8c-45bd-aac9-53ed5d7a02a9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:07.365179 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a7a0b-5d8c-45bd-aac9-53ed5d7a02a9 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:07.366547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 660/1324] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:07.372104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02f09d-0728-4663-b5b8-97c71496e533 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:07.372508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02f09d-0728-4663-b5b8-97c71496e533 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:07.372654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02f09d-0728-4663-b5b8-97c71496e533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:07.446032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-9e02f09d-0728-4663-b5b8-97c71496e533 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:07.447162 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9e02f09d-0728-4663-b5b8-97c71496e533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:07.543629 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 665/1325] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:07.831231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a7a0b-5d8c-45bd-aac9-53ed5d7a02a9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:32:07.832836 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-910a7a0b-5d8c-45bd-aac9-53ed5d7a02a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:07.936197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a7a0b-5d8c-45bd-aac9-53ed5d7a02a9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:32:08.011201 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fae87-2ed6-4bbe-ac22-0a74c262a626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:32:08.011805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fae87-2ed6-4bbe-ac22-0a74c262a626 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:08.012080 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fae87-2ed6-4bbe-ac22-0a74c262a626 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:08.012342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fae87-2ed6-4bbe-ac22-0a74c262a626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:08.013956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-466fae87-2ed6-4bbe-ac22-0a74c262a626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:08.030882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:08.122790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fae87-2ed6-4bbe-ac22-0a74c262a626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:32:08.124264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fae87-2ed6-4bbe-ac22-0a74c262a626 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:32:08.141997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 661/1326] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:32:10.358650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3531197-9059-4fbc-a1ad-378f3c641f96 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:10.359218 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3531197-9059-4fbc-a1ad-378f3c641f96 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:10.359218 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3531197-9059-4fbc-a1ad-378f3c641f96 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:10.360567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 666/1327] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:10.366593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86969c6-00dc-4996-99e0-2bd0b8adcc0b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:10.367046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86969c6-00dc-4996-99e0-2bd0b8adcc0b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:10.367155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86969c6-00dc-4996-99e0-2bd0b8adcc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:10.434075 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d86969c6-00dc-4996-99e0-2bd0b8adcc0b None None] MFA Rules not processed for user `c10bdf610c574721a52a78348cf248de`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:10.435281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d86969c6-00dc-4996-99e0-2bd0b8adcc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:10.507341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:10.539729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 662/1328] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:32:10 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:10.824228 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3531197-9059-4fbc-a1ad-378f3c641f96 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:32:10.825799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b3531197-9059-4fbc-a1ad-378f3c641f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:10.860573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:10.945306 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3531197-9059-4fbc-a1ad-378f3c641f96 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:32:11.027547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbbd41-5d7d-45b8-a293-bae2e6bbe294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:32:11.028276 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbbd41-5d7d-45b8-a293-bae2e6bbe294 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:11.028553 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbbd41-5d7d-45b8-a293-bae2e6bbe294 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:11.028822 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbbd41-5d7d-45b8-a293-bae2e6bbe294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:11.030975 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-14cbbd41-5d7d-45b8-a293-bae2e6bbe294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:11.146858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:11.184546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbbd41-5d7d-45b8-a293-bae2e6bbe294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:32:11.186119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbbd41-5d7d-45b8-a293-bae2e6bbe294 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:32:11.204412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 667/1329] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:32:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:32:13.989235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5445a4e-23aa-4854-95db-871baae5b67d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:13.989800 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5445a4e-23aa-4854-95db-871baae5b67d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:13.989981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5445a4e-23aa-4854-95db-871baae5b67d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:13.991332 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 663/1330] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:13.996412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8ecc9-237e-4c90-956c-09090dfa8f77 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:13.996857 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8ecc9-237e-4c90-956c-09090dfa8f77 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:13.996960 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8ecc9-237e-4c90-956c-09090dfa8f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:14.061825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-00c8ecc9-237e-4c90-956c-09090dfa8f77 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:14.063031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-00c8ecc9-237e-4c90-956c-09090dfa8f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:14.157817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 668/1331] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:14.459727 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4be6f-5292-4c49-83bf-69419de0efff None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:14.460002 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4be6f-5292-4c49-83bf-69419de0efff None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:14.460269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4be6f-5292-4c49-83bf-69419de0efff None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:14.461648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 664/1332] 10.222.0.50 () {54 vars in 963 bytes} [Sat Sep 17 04:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:14.467829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7890-2ae2-4b31-95b6-bedb9bbe2656 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:14.468111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7890-2ae2-4b31-95b6-bedb9bbe2656 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:14.468383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7890-2ae2-4b31-95b6-bedb9bbe2656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:14.513614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:14.543756 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-208d7890-2ae2-4b31-95b6-bedb9bbe2656 None None] MFA Rules not processed for user `6469c8860be943168b67ea7fa28bf19d`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:14.545609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-208d7890-2ae2-4b31-95b6-bedb9bbe2656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:14.620251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 669/1333] 10.222.0.50 () {58 vars in 1060 bytes} [Sat Sep 17 04:32:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:14.629296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4be6f-5292-4c49-83bf-69419de0efff None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:32:14.630827 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-40a4be6f-5292-4c49-83bf-69419de0efff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:14.732703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4be6f-5292-4c49-83bf-69419de0efff None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:32:14.807894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a8b8d-aaee-44df-bec7-5b1d4aabd4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:32:14.808498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a8b8d-aaee-44df-bec7-5b1d4aabd4fa service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:14.808778 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a8b8d-aaee-44df-bec7-5b1d4aabd4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:14.809085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a8b8d-aaee-44df-bec7-5b1d4aabd4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:14.810680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8f6a8b8d-aaee-44df-bec7-5b1d4aabd4fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:14.838081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:14.922320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a8b8d-aaee-44df-bec7-5b1d4aabd4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:32:14.923818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a8b8d-aaee-44df-bec7-5b1d4aabd4fa service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:32:14.941862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 665/1334] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:32:17.358285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77216f87-e744-4745-876c-cf67a18131b0 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:17.358834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77216f87-e744-4745-876c-cf67a18131b0 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:17.358834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77216f87-e744-4745-876c-cf67a18131b0 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:17.360182 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 670/1335] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:17.365591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba486dd-0b6f-49cc-99ce-9e5930b5b66c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:17.366108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba486dd-0b6f-49cc-99ce-9e5930b5b66c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:17.366215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba486dd-0b6f-49cc-99ce-9e5930b5b66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:17.433041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-fba486dd-0b6f-49cc-99ce-9e5930b5b66c None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:17.434219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fba486dd-0b6f-49cc-99ce-9e5930b5b66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:17.508632 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:17.530734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 666/1336] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:32:17.815204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77216f87-e744-4745-876c-cf67a18131b0 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:32:17.816779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-77216f87-e744-4745-876c-cf67a18131b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:17.923329 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77216f87-e744-4745-876c-cf67a18131b0 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:32:17.952792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:17.998855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ce772-9db5-4e47-a8b7-c8f9813b0847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:32:17.999453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce772-9db5-4e47-a8b7-c8f9813b0847 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:17.999731 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce772-9db5-4e47-a8b7-c8f9813b0847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:18.000003 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce772-9db5-4e47-a8b7-c8f9813b0847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:18.001623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-872ce772-9db5-4e47-a8b7-c8f9813b0847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:18.109542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ce772-9db5-4e47-a8b7-c8f9813b0847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:32:18.110917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ce772-9db5-4e47-a8b7-c8f9813b0847 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:32:18.128631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 671/1337] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:32:21.197812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d905-72fc-4ccd-b2c2-b85e579c546a None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:21.198304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d905-72fc-4ccd-b2c2-b85e579c546a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:21.198413 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d905-72fc-4ccd-b2c2-b85e579c546a None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:21.199685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 667/1338] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:21.204942 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e8c3e-577f-4013-8bc2-8b3ef001880c None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:21.205395 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e8c3e-577f-4013-8bc2-8b3ef001880c None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:21.205520 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e8c3e-577f-4013-8bc2-8b3ef001880c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:21.273488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-1c5e8c3e-577f-4013-8bc2-8b3ef001880c None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:21.274698 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1c5e8c3e-577f-4013-8bc2-8b3ef001880c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:21.284070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:21.371339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 672/1339] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:32:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:21.657309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08d905-72fc-4ccd-b2c2-b85e579c546a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:32:21.658873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1b08d905-72fc-4ccd-b2c2-b85e579c546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:21.762702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08d905-72fc-4ccd-b2c2-b85e579c546a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:32:21.835375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d803e-f21d-4a7f-a34d-5f09eb274c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:32:21.835976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d803e-f21d-4a7f-a34d-5f09eb274c1a service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:21.836252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d803e-f21d-4a7f-a34d-5f09eb274c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:21.836519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d803e-f21d-4a7f-a34d-5f09eb274c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:21.838155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b81d803e-f21d-4a7f-a34d-5f09eb274c1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:21.874125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:21.946742 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d803e-f21d-4a7f-a34d-5f09eb274c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:32:21.948176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d803e-f21d-4a7f-a34d-5f09eb274c1a service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:32:21.966638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 668/1340] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:32:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:32:26.428336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f429b8-f303-4d70-aca9-166f402bc537 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:26.428837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f429b8-f303-4d70-aca9-166f402bc537 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:26.428928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f429b8-f303-4d70-aca9-166f402bc537 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:26.430328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 673/1341] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:26.435817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9491df6-c103-4e79-ab6e-c90fb1ca253a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:26.436266 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9491df6-c103-4e79-ab6e-c90fb1ca253a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:26.436361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9491df6-c103-4e79-ab6e-c90fb1ca253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:26.510612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b9491df6-c103-4e79-ab6e-c90fb1ca253a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:26.511807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b9491df6-c103-4e79-ab6e-c90fb1ca253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:26.604137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:26.615346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 669/1342] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:26.897784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f429b8-f303-4d70-aca9-166f402bc537 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:32:26.899298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-64f429b8-f303-4d70-aca9-166f402bc537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:27.003691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f429b8-f303-4d70-aca9-166f402bc537 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:32:27.047433 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:27.084538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe2329-a4d9-4dd2-bc83-70696822809f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:32:27.085180 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2329-a4d9-4dd2-bc83-70696822809f service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:27.085458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2329-a4d9-4dd2-bc83-70696822809f service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:27.085729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2329-a4d9-4dd2-bc83-70696822809f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:27.087343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-edfe2329-a4d9-4dd2-bc83-70696822809f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:27.198559 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe2329-a4d9-4dd2-bc83-70696822809f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:32:27.199993 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe2329-a4d9-4dd2-bc83-70696822809f service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:32:27.218494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 674/1343] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:32:30.380460 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0927a1-8d00-4630-b3b0-480d4e8180de None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:30.384440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0927a1-8d00-4630-b3b0-480d4e8180de None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:30.384440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0927a1-8d00-4630-b3b0-480d4e8180de None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:30.384440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 670/1344] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:30.388098 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc81a0a-66a9-4f4f-87f0-6544315c497b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:30.388555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc81a0a-66a9-4f4f-87f0-6544315c497b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:30.388764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc81a0a-66a9-4f4f-87f0-6544315c497b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:30.461333 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-bdc81a0a-66a9-4f4f-87f0-6544315c497b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:30.462515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-bdc81a0a-66a9-4f4f-87f0-6544315c497b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:30.482937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:30.564086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 675/1345] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:32:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:30.850713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0927a1-8d00-4630-b3b0-480d4e8180de None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:32:30.852247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0f0927a1-8d00-4630-b3b0-480d4e8180de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:30.962230 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0927a1-8d00-4630-b3b0-480d4e8180de None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:32:31.043789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb4727-7bf3-4e01-9535-0a052e7fb996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:32:31.044386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb4727-7bf3-4e01-9535-0a052e7fb996 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:31.044659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb4727-7bf3-4e01-9535-0a052e7fb996 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:31.044926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb4727-7bf3-4e01-9535-0a052e7fb996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:31.046545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-18fb4727-7bf3-4e01-9535-0a052e7fb996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:31.089869 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:31.171862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb4727-7bf3-4e01-9535-0a052e7fb996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:32:31.173543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb4727-7bf3-4e01-9535-0a052e7fb996 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:32:31.195845 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 671/1346] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:32:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:32:35.518919 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ff26b-f36f-4329-997a-00c9526bf14f None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:35.519424 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ff26b-f36f-4329-997a-00c9526bf14f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:35.519503 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ff26b-f36f-4329-997a-00c9526bf14f None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:35.523415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 676/1347] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:35.526313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9a34a-2bf9-406a-b284-d51e67aba456 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:35.526726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9a34a-2bf9-406a-b284-d51e67aba456 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:35.526863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9a34a-2bf9-406a-b284-d51e67aba456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:35.596301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d8d9a34a-2bf9-406a-b284-d51e67aba456 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:35.598311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d8d9a34a-2bf9-406a-b284-d51e67aba456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:35.696702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:35.698875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 672/1348] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:35.990041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ff26b-f36f-4329-997a-00c9526bf14f None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:32:35.991564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-4b5ff26b-f36f-4329-997a-00c9526bf14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:36.092750 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ff26b-f36f-4329-997a-00c9526bf14f None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:32:36.139978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:36.166389 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e127b-f4f1-4a3b-8066-b827b1d98c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:32:36.167000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e127b-f4f1-4a3b-8066-b827b1d98c3d service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:36.167280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e127b-f4f1-4a3b-8066-b827b1d98c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:36.167554 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e127b-f4f1-4a3b-8066-b827b1d98c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:36.169166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-834e127b-f4f1-4a3b-8066-b827b1d98c3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:36.277057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e127b-f4f1-4a3b-8066-b827b1d98c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:32:36.278427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e127b-f4f1-4a3b-8066-b827b1d98c3d service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:32:36.295771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 677/1349] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:32:41.331852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6789-8392-45c7-b033-f3a2fc25fc9f None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:41.332397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6789-8392-45c7-b033-f3a2fc25fc9f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:41.332681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6789-8392-45c7-b033-f3a2fc25fc9f None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:41.334929 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 673/1350] 10.222.0.50 () {54 vars in 921 bytes} [Sat Sep 17 04:32:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:41.339950 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c87a4-0703-46cf-8a69-1aadec6605d8 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:41.340676 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c87a4-0703-46cf-8a69-1aadec6605d8 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:41.340782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c87a4-0703-46cf-8a69-1aadec6605d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:41.438596 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ee2c87a4-0703-46cf-8a69-1aadec6605d8 None None] MFA Rules not processed for user `931a947711a2468baaeef701bbee60c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:41.440055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ee2c87a4-0703-46cf-8a69-1aadec6605d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:41.460487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:41.606755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 678/1351] 10.222.0.50 () {58 vars in 1018 bytes} [Sat Sep 17 04:32:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:32:45.761139 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fa4fa-25e7-4089-b9d3-37f7161edf8e None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:45.761994 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fa4fa-25e7-4089-b9d3-37f7161edf8e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:45.762467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fa4fa-25e7-4089-b9d3-37f7161edf8e None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:45.764001 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 674/1352] 10.222.0.50 () {54 vars in 921 bytes} [Sat Sep 17 04:32:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:45.768880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a5e0-b95e-4d5a-9004-ece3dd14ad70 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:45.769731 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a5e0-b95e-4d5a-9004-ece3dd14ad70 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:45.770079 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a5e0-b95e-4d5a-9004-ece3dd14ad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:45.850093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-7418a5e0-b95e-4d5a-9004-ece3dd14ad70 None None] MFA Rules not processed for user `931a947711a2468baaeef701bbee60c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:45.851301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7418a5e0-b95e-4d5a-9004-ece3dd14ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:45.929645 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:45.970743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 679/1353] 10.222.0.50 () {58 vars in 1018 bytes} [Sat Sep 17 04:32:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:47.439995 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1144d-f160-415d-a31a-4afff7ca7348 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:47.440514 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1144d-f160-415d-a31a-4afff7ca7348 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:47.440514 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1144d-f160-415d-a31a-4afff7ca7348 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:47.441994 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 675/1354] 10.222.0.50 () {54 vars in 921 bytes} [Sat Sep 17 04:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:47.446993 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b385b7-d7f0-4fb6-8460-281fc48befc5 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:47.447449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b385b7-d7f0-4fb6-8460-281fc48befc5 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:47.447543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b385b7-d7f0-4fb6-8460-281fc48befc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:47.525853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-f5b385b7-d7f0-4fb6-8460-281fc48befc5 None None] MFA Rules not processed for user `931a947711a2468baaeef701bbee60c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:47.527072 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f5b385b7-d7f0-4fb6-8460-281fc48befc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:47.634674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 680/1355] 10.222.0.50 () {58 vars in 1018 bytes} [Sat Sep 17 04:32:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:32:51.231395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3dc6-e2cd-46b3-a792-7078fa35b6b5 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:51.231960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3dc6-e2cd-46b3-a792-7078fa35b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:51.231960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3dc6-e2cd-46b3-a792-7078fa35b6b5 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:51.233508 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 676/1356] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:51.239314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc66ac2-512b-42e5-b872-e540c052182d None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:51.239812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc66ac2-512b-42e5-b872-e540c052182d None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:51.239914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc66ac2-512b-42e5-b872-e540c052182d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:51.280066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:51.316320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ecc66ac2-512b-42e5-b872-e540c052182d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:51.318565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ecc66ac2-512b-42e5-b872-e540c052182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:51.423421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 681/1357] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:51.727411 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d36777-555e-4282-8cf2-bdc84cd04f2f None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:51.727891 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d36777-555e-4282-8cf2-bdc84cd04f2f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:51.728936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d36777-555e-4282-8cf2-bdc84cd04f2f None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:51.731110 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 677/1358] 10.222.0.50 () {54 vars in 965 bytes} [Sat Sep 17 04:32:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:51.741258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f96cb-b103-457b-a34b-d6bcd9468095 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:51.743147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f96cb-b103-457b-a34b-d6bcd9468095 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:51.743147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f96cb-b103-457b-a34b-d6bcd9468095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:51.829010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-6e1f96cb-b103-457b-a34b-d6bcd9468095 None None] MFA Rules not processed for user `eb70408fecfe41e0b2ea9a53c7ae0823`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:51.830467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6e1f96cb-b103-457b-a34b-d6bcd9468095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:51.883556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:51.952904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 682/1359] 10.222.0.50 () {58 vars in 1062 bytes} [Sat Sep 17 04:32:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:32:51.961297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d36777-555e-4282-8cf2-bdc84cd04f2f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:32:51.963052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-03d36777-555e-4282-8cf2-bdc84cd04f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:52.118956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d36777-555e-4282-8cf2-bdc84cd04f2f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:32:52.205233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:52.252369 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7bb97-6613-4fdd-98fb-eff841eb7858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:32:52.253218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7bb97-6613-4fdd-98fb-eff841eb7858 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:52.253694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7bb97-6613-4fdd-98fb-eff841eb7858 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:52.254251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7bb97-6613-4fdd-98fb-eff841eb7858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:52.256174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3cc7bb97-6613-4fdd-98fb-eff841eb7858 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:52.357447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7bb97-6613-4fdd-98fb-eff841eb7858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:32:52.359344 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7bb97-6613-4fdd-98fb-eff841eb7858 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:32:52.382404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 678/1360] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:32:54.791204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f3f6-b94c-4d6f-8fd1-16b006c786b6 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:54.795599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f3f6-b94c-4d6f-8fd1-16b006c786b6 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:54.797030 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f3f6-b94c-4d6f-8fd1-16b006c786b6 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:54.811803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 683/1361] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:32:54 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:54.817165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c13ec-bd04-4bd7-befb-f86403695877 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:54.817764 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c13ec-bd04-4bd7-befb-f86403695877 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:54.818032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c13ec-bd04-4bd7-befb-f86403695877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:54.906291 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b08c13ec-bd04-4bd7-befb-f86403695877 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:54.907734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b08c13ec-bd04-4bd7-befb-f86403695877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:54.950849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:55.017040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 679/1362] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:55.306293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773f3f6-b94c-4d6f-8fd1-16b006c786b6 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:32:55.307775 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1773f3f6-b94c-4d6f-8fd1-16b006c786b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:55.491995 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773f3f6-b94c-4d6f-8fd1-16b006c786b6 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:32:55.503853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:55.643393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0832fdf-8904-4189-b002-2caf61271620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:32:55.644124 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0832fdf-8904-4189-b002-2caf61271620 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:55.644465 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0832fdf-8904-4189-b002-2caf61271620 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:55.644742 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0832fdf-8904-4189-b002-2caf61271620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:55.646380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d0832fdf-8904-4189-b002-2caf61271620 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:55.739781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0832fdf-8904-4189-b002-2caf61271620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:32:55.741477 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0832fdf-8904-4189-b002-2caf61271620 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:32:55.759382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 684/1363] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:32:58.428205 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b345d3-e6b4-4f3d-8107-6c6f5b711d46 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:58.429201 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b345d3-e6b4-4f3d-8107-6c6f5b711d46 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:58.429483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b345d3-e6b4-4f3d-8107-6c6f5b711d46 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:58.431020 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 680/1364] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:32:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:58.436976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07037566-e7d0-4fbb-b459-12b14ce168c8 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:58.437485 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07037566-e7d0-4fbb-b459-12b14ce168c8 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:58.437566 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07037566-e7d0-4fbb-b459-12b14ce168c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:58.455306 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:58.511464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-07037566-e7d0-4fbb-b459-12b14ce168c8 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:58.513055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-07037566-e7d0-4fbb-b459-12b14ce168c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:58.629910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 685/1365] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:58.933050 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07edfd-2380-4023-b743-a86d789a9675 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:58.933470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07edfd-2380-4023-b743-a86d789a9675 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:58.933839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07edfd-2380-4023-b743-a86d789a9675 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:58.935620 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 681/1366] 10.222.0.50 () {54 vars in 965 bytes} [Sat Sep 17 04:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:32:58.942712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b61ca-8cce-464a-9ddc-5f87dc4c6fcf None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:58.946053 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b61ca-8cce-464a-9ddc-5f87dc4c6fcf None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:58.946053 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b61ca-8cce-464a-9ddc-5f87dc4c6fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:59.030800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-459b61ca-8cce-464a-9ddc-5f87dc4c6fcf None None] MFA Rules not processed for user `eb70408fecfe41e0b2ea9a53c7ae0823`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:59.032019 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-459b61ca-8cce-464a-9ddc-5f87dc4c6fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:59.070064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:59.165169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 686/1367] 10.222.0.50 () {58 vars in 1062 bytes} [Sat Sep 17 04:32:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:32:59.173365 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07edfd-2380-4023-b743-a86d789a9675 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:32:59.174921 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ee07edfd-2380-4023-b743-a86d789a9675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:59.332771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07edfd-2380-4023-b743-a86d789a9675 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:32:59.357976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:59.458785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691171f-bb75-4c68-a9e1-7d5487ce7cdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:32:59.460181 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691171f-bb75-4c68-a9e1-7d5487ce7cdb service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:59.460783 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691171f-bb75-4c68-a9e1-7d5487ce7cdb service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:59.461323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691171f-bb75-4c68-a9e1-7d5487ce7cdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:59.463202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b691171f-bb75-4c68-a9e1-7d5487ce7cdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:59.476299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb851b3a-e841-40d8-a054-e8ba3c9f5fa6 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:59.476825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb851b3a-e841-40d8-a054-e8ba3c9f5fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:59.476825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb851b3a-e841-40d8-a054-e8ba3c9f5fa6 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:59.478216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 687/1368] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:32:59.483063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067cbae-8ab2-4604-aabe-02c1cfa5b7ab None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:32:59.483347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067cbae-8ab2-4604-aabe-02c1cfa5b7ab None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:32:59.483620 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067cbae-8ab2-4604-aabe-02c1cfa5b7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:32:59.564930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691171f-bb75-4c68-a9e1-7d5487ce7cdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:32:59.565900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691171f-bb75-4c68-a9e1-7d5487ce7cdb service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:32:59.568086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-d067cbae-8ab2-4604-aabe-02c1cfa5b7ab None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:32:59.569392 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d067cbae-8ab2-4604-aabe-02c1cfa5b7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:32:59.585404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 682/1369] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:32:59.676859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:32:59.684073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 688/1370] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:33:00.022052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced3dda-e0dc-48d2-bf7b-0b72f44a855e None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:00.022340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced3dda-e0dc-48d2-bf7b-0b72f44a855e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:00.022615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced3dda-e0dc-48d2-bf7b-0b72f44a855e None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:00.024115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 683/1371] 10.222.0.50 () {54 vars in 964 bytes} [Sat Sep 17 04:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:00.028905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7194b4-4bc1-4cdf-86dd-b8f9949361cd None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:00.029150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7194b4-4bc1-4cdf-86dd-b8f9949361cd None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:00.029428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7194b4-4bc1-4cdf-86dd-b8f9949361cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:00.110069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-0f7194b4-4bc1-4cdf-86dd-b8f9949361cd None None] MFA Rules not processed for user `60f50529feb44143b0627131d9aab8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:00.111305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-0f7194b4-4bc1-4cdf-86dd-b8f9949361cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:00.196185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 689/1372] 10.222.0.50 () {58 vars in 1061 bytes} [Sat Sep 17 04:33:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:00.203656 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced3dda-e0dc-48d2-bf7b-0b72f44a855e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:00.206136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fced3dda-e0dc-48d2-bf7b-0b72f44a855e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:00.236397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:00.316039 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced3dda-e0dc-48d2-bf7b-0b72f44a855e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:00.394533 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f4e46-6d02-41d8-92f2-a40b49503c34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:00.395303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f4e46-6d02-41d8-92f2-a40b49503c34 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:00.395678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f4e46-6d02-41d8-92f2-a40b49503c34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:00.396050 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f4e46-6d02-41d8-92f2-a40b49503c34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:00.397790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ac8f4e46-6d02-41d8-92f2-a40b49503c34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:00.488296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:00.520275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f4e46-6d02-41d8-92f2-a40b49503c34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:00.521744 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f4e46-6d02-41d8-92f2-a40b49503c34 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:00.541829 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 684/1373] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:33:01.994637 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee560aa-c08e-40e7-aaf6-4722723248f9 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:01.995127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee560aa-c08e-40e7-aaf6-4722723248f9 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:01.995244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee560aa-c08e-40e7-aaf6-4722723248f9 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:01.996499 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 690/1374] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:02.002046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720f95c-9139-4fea-b962-ba0742723971 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:02.002490 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720f95c-9139-4fea-b962-ba0742723971 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:02.002585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720f95c-9139-4fea-b962-ba0742723971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:02.068257 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9720f95c-9139-4fea-b962-ba0742723971 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:02.069515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9720f95c-9139-4fea-b962-ba0742723971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:02.170798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 685/1375] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:02.461108 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee560aa-c08e-40e7-aaf6-4722723248f9 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:02.462614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9ee560aa-c08e-40e7-aaf6-4722723248f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:02.552440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:02.618456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee560aa-c08e-40e7-aaf6-4722723248f9 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:02.743564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6de22-3f9b-4229-84f4-09eede00eac8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:02.744156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6de22-3f9b-4229-84f4-09eede00eac8 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:02.744431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6de22-3f9b-4229-84f4-09eede00eac8 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:02.744699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6de22-3f9b-4229-84f4-09eede00eac8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:02.746386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-75e6de22-3f9b-4229-84f4-09eede00eac8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:02.797630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:02.841996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6de22-3f9b-4229-84f4-09eede00eac8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:02.843126 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6de22-3f9b-4229-84f4-09eede00eac8 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:02.863119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 691/1376] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:05.205630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bec56-d6b4-4926-85e3-916fff84cc2f None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:05.206142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bec56-d6b4-4926-85e3-916fff84cc2f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:05.206142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bec56-d6b4-4926-85e3-916fff84cc2f None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:05.207505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 686/1377] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:05.212697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a09a4b-d127-4a25-98f0-a5d1da6de6a5 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:05.213128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a09a4b-d127-4a25-98f0-a5d1da6de6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:05.213308 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a09a4b-d127-4a25-98f0-a5d1da6de6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:05.280878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-a7a09a4b-d127-4a25-98f0-a5d1da6de6a5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:05.282720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a7a09a4b-d127-4a25-98f0-a5d1da6de6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:05.390409 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 692/1378] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:05.687647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bec56-d6b4-4926-85e3-916fff84cc2f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:05.690761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-148bec56-d6b4-4926-85e3-916fff84cc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:05.745954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:05.884139 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bec56-d6b4-4926-85e3-916fff84cc2f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:06.008138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:06.013525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7093ad-9ede-45c5-889c-79f4661c9993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:06.014278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7093ad-9ede-45c5-889c-79f4661c9993 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:06.014657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7093ad-9ede-45c5-889c-79f4661c9993 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:06.015031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7093ad-9ede-45c5-889c-79f4661c9993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:06.017981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ff7093ad-9ede-45c5-889c-79f4661c9993 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:06.116594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7093ad-9ede-45c5-889c-79f4661c9993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:06.118405 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7093ad-9ede-45c5-889c-79f4661c9993 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:06.138734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 687/1379] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:08.522967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfdfc9-6df4-4005-b879-3abbe0316702 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:08.523632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfdfc9-6df4-4005-b879-3abbe0316702 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:08.523632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfdfc9-6df4-4005-b879-3abbe0316702 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:08.524763 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 693/1380] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:33:08.530652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb377225-d518-4882-8974-8f0f4e2d13ba None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:08.531091 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb377225-d518-4882-8974-8f0f4e2d13ba None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:08.531357 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb377225-d518-4882-8974-8f0f4e2d13ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:08.606589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bb377225-d518-4882-8974-8f0f4e2d13ba None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:08.607882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bb377225-d518-4882-8974-8f0f4e2d13ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:08.679041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:08.723420 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 688/1381] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:09.096015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfdfc9-6df4-4005-b879-3abbe0316702 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:09.097616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ddcfdfc9-6df4-4005-b879-3abbe0316702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:09.128036 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:09.252851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfdfc9-6df4-4005-b879-3abbe0316702 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:09.353948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:09.374590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa2fb2-1316-45f2-9bca-c9812a379167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:09.375226 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa2fb2-1316-45f2-9bca-c9812a379167 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:09.376307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa2fb2-1316-45f2-9bca-c9812a379167 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:09.376608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa2fb2-1316-45f2-9bca-c9812a379167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:09.378673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-32aa2fb2-1316-45f2-9bca-c9812a379167 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:09.476362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa2fb2-1316-45f2-9bca-c9812a379167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:09.478479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa2fb2-1316-45f2-9bca-c9812a379167 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:09.501933 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 694/1382] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:11.929530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520d36c-9c67-4982-905b-4daee1a5e77c None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:11.930346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520d36c-9c67-4982-905b-4daee1a5e77c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:11.930346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520d36c-9c67-4982-905b-4daee1a5e77c None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:11.931493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 689/1383] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:11.936920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3366e23-0e5e-477a-ba38-ea21e90d5cff None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:11.937430 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3366e23-0e5e-477a-ba38-ea21e90d5cff None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:11.937550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3366e23-0e5e-477a-ba38-ea21e90d5cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:12.004408 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-b3366e23-0e5e-477a-ba38-ea21e90d5cff None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:12.005743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b3366e23-0e5e-477a-ba38-ea21e90d5cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:12.069323 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:12.110784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 695/1384] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:33:12.415741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520d36c-9c67-4982-905b-4daee1a5e77c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:12.417386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3520d36c-9c67-4982-905b-4daee1a5e77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:12.570209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520d36c-9c67-4982-905b-4daee1a5e77c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:12.624687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:12.688609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70de842-fc07-49cd-8e91-4aa93485b296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:12.689157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de842-fc07-49cd-8e91-4aa93485b296 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:12.689452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de842-fc07-49cd-8e91-4aa93485b296 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:12.689700 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de842-fc07-49cd-8e91-4aa93485b296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:12.691290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e70de842-fc07-49cd-8e91-4aa93485b296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:12.800704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70de842-fc07-49cd-8e91-4aa93485b296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:12.802358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70de842-fc07-49cd-8e91-4aa93485b296 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:12.820210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 690/1385] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:15.196144 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03e76-d445-4225-b7ec-9ef24a97ba86 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:15.196688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03e76-d445-4225-b7ec-9ef24a97ba86 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:15.196688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03e76-d445-4225-b7ec-9ef24a97ba86 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:15.198116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 696/1386] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:15.203958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42f470-c48f-4ad9-88a2-c09b611fc29e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:15.204407 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42f470-c48f-4ad9-88a2-c09b611fc29e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:15.204613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42f470-c48f-4ad9-88a2-c09b611fc29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:15.272084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bd42f470-c48f-4ad9-88a2-c09b611fc29e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:15.273297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bd42f470-c48f-4ad9-88a2-c09b611fc29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:15.283188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:15.371946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 691/1387] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:15.672615 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b03e76-d445-4225-b7ec-9ef24a97ba86 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:15.674148 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-32b03e76-d445-4225-b7ec-9ef24a97ba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:15.819437 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b03e76-d445-4225-b7ec-9ef24a97ba86 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:15.864950 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:15.931223 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af9ce0-453f-4c55-89bb-fc60871dd04a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:15.931739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af9ce0-453f-4c55-89bb-fc60871dd04a service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:15.932011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af9ce0-453f-4c55-89bb-fc60871dd04a service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:15.932279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af9ce0-453f-4c55-89bb-fc60871dd04a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:15.933880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-73af9ce0-453f-4c55-89bb-fc60871dd04a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:16.033440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af9ce0-453f-4c55-89bb-fc60871dd04a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:16.035128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af9ce0-453f-4c55-89bb-fc60871dd04a service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:16.054120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 697/1388] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:16.096469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ac7d-84c5-4449-a2fa-43d7fe24547b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:16.096788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ac7d-84c5-4449-a2fa-43d7fe24547b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:16.097101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ac7d-84c5-4449-a2fa-43d7fe24547b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:16.098471 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 692/1389] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:16.103557 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed39bb-fe17-4965-b684-afc3c330ff69 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:16.103837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed39bb-fe17-4965-b684-afc3c330ff69 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:16.104110 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed39bb-fe17-4965-b684-afc3c330ff69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:16.168028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:16.170786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c4ed39bb-fe17-4965-b684-afc3c330ff69 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:16.172624 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c4ed39bb-fe17-4965-b684-afc3c330ff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:16.270287 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 698/1390] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:16.569991 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ca244-ca97-4801-a242-cf6e03b392e0 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:16.570455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ca244-ca97-4801-a242-cf6e03b392e0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:16.570560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ca244-ca97-4801-a242-cf6e03b392e0 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:16.571870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 693/1391] 10.222.0.50 () {54 vars in 962 bytes} [Sat Sep 17 04:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:16.577214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30731afa-c300-4bc2-83f8-ea03b621f068 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:16.577499 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30731afa-c300-4bc2-83f8-ea03b621f068 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:16.577768 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30731afa-c300-4bc2-83f8-ea03b621f068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:16.653562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-30731afa-c300-4bc2-83f8-ea03b621f068 None None] MFA Rules not processed for user `81ba9aba795f423a8ffabe419b64507a`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:16.654749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-30731afa-c300-4bc2-83f8-ea03b621f068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:16.726434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:16.732150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 699/1392] 10.222.0.50 () {58 vars in 1059 bytes} [Sat Sep 17 04:33:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:16.744299 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ca244-ca97-4801-a242-cf6e03b392e0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:16.745858 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c89ca244-ca97-4801-a242-cf6e03b392e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:16.856425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ca244-ca97-4801-a242-cf6e03b392e0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:16.895077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:16.932569 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81405a44-1b37-47c1-a8c0-d7678b5dc1cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ba9aba795f423a8ffabe419b64507a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:16.933398 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405a44-1b37-47c1-a8c0-d7678b5dc1cd service glance] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:16.933940 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405a44-1b37-47c1-a8c0-d7678b5dc1cd service glance] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:16.934736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405a44-1b37-47c1-a8c0-d7678b5dc1cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:16.936371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-81405a44-1b37-47c1-a8c0-d7678b5dc1cd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:17.045575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81405a44-1b37-47c1-a8c0-d7678b5dc1cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:17.047073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81405a44-1b37-47c1-a8c0-d7678b5dc1cd service glance] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:17.066006 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 694/1393] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:17.995028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55094a33-a5b4-4514-a56c-eb6a3614ccc4 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:17.996621 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55094a33-a5b4-4514-a56c-eb6a3614ccc4 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:17.996621 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55094a33-a5b4-4514-a56c-eb6a3614ccc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:18.064574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-55094a33-a5b4-4514-a56c-eb6a3614ccc4 None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:18.065805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-55094a33-a5b4-4514-a56c-eb6a3614ccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:18.163932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 700/1394] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:33:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:18.212326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2710d6e-df7e-4b41-99e1-1adac0ac85d2 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:18.213077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2710d6e-df7e-4b41-99e1-1adac0ac85d2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:18.213220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2710d6e-df7e-4b41-99e1-1adac0ac85d2 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:18.214617 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 695/1395] 10.222.0.50 () {54 vars in 943 bytes} [Sat Sep 17 04:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:18.221892 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76230b5-668e-419a-922b-f29075f8dfa9 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:18.222180 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76230b5-668e-419a-922b-f29075f8dfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:18.222459 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76230b5-668e-419a-922b-f29075f8dfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:18.299064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c76230b5-668e-419a-922b-f29075f8dfa9 None None] MFA Rules not processed for user `c653cb8c86534dc2b963f39f5e1d3e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:18.300275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c76230b5-668e-419a-922b-f29075f8dfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:18.332710 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:18.413587 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 701/1396] 10.222.0.50 () {58 vars in 1040 bytes} [Sat Sep 17 04:33:18 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:18.423870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2710d6e-df7e-4b41-99e1-1adac0ac85d2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:18.425380 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e2710d6e-df7e-4b41-99e1-1adac0ac85d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:18.428763 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e053fb-d50c-47cb-ad23-99ae51464088 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:18.429081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e053fb-d50c-47cb-ad23-99ae51464088 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:18.429356 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e053fb-d50c-47cb-ad23-99ae51464088 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:18.430851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 702/1397] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:33:18.435881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd63fb3-58c1-4f6f-b018-31f409dbef96 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:18.436168 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd63fb3-58c1-4f6f-b018-31f409dbef96 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:18.436443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd63fb3-58c1-4f6f-b018-31f409dbef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:18.498377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:18.504578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-5cd63fb3-58c1-4f6f-b018-31f409dbef96 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:18.505923 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5cd63fb3-58c1-4f6f-b018-31f409dbef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:18.575361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2710d6e-df7e-4b41-99e1-1adac0ac85d2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:18.606288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:18.610310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 703/1398] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:33:18.681735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70601620-3c9b-4a39-89d6-34cc0e3a9311 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:18.682260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70601620-3c9b-4a39-89d6-34cc0e3a9311 service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:18.682535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70601620-3c9b-4a39-89d6-34cc0e3a9311 service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:18.682822 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70601620-3c9b-4a39-89d6-34cc0e3a9311 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:18.684444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-70601620-3c9b-4a39-89d6-34cc0e3a9311 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:18.737507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:18.770070 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70601620-3c9b-4a39-89d6-34cc0e3a9311 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:18.771686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70601620-3c9b-4a39-89d6-34cc0e3a9311 service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:18.779754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 696/1399] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:33:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 04:33:18.901620 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd63fb3-58c1-4f6f-b018-31f409dbef96 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:18.902823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5cd63fb3-58c1-4f6f-b018-31f409dbef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:19.019241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd63fb3-58c1-4f6f-b018-31f409dbef96 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:19.130088 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:19.136662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690e1a1-88c1-4651-9a05-d8a3559d8332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:19.137327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690e1a1-88c1-4651-9a05-d8a3559d8332 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:19.137604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690e1a1-88c1-4651-9a05-d8a3559d8332 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:19.137876 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690e1a1-88c1-4651-9a05-d8a3559d8332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:19.139578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c690e1a1-88c1-4651-9a05-d8a3559d8332 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:19.231405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690e1a1-88c1-4651-9a05-d8a3559d8332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:19.233012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690e1a1-88c1-4651-9a05-d8a3559d8332 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:19.251541 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 704/1400] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:21.647190 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e53d25-faab-4e18-bed8-b8132b3ab0bc None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:21.647803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e53d25-faab-4e18-bed8-b8132b3ab0bc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:21.647803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e53d25-faab-4e18-bed8-b8132b3ab0bc None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:21.649254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 697/1401] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:21.654458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a69c-b3db-4b2d-bc63-c61d2f80220b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:21.655002 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a69c-b3db-4b2d-bc63-c61d2f80220b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:21.655193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a69c-b3db-4b2d-bc63-c61d2f80220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:21.746459 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-b1b5a69c-b3db-4b2d-bc63-c61d2f80220b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:21.747724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b1b5a69c-b3db-4b2d-bc63-c61d2f80220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:21.824125 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:21.871264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 705/1402] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:33:22.216526 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e53d25-faab-4e18-bed8-b8132b3ab0bc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:22.218704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-52e53d25-faab-4e18-bed8-b8132b3ab0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:22.394259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e53d25-faab-4e18-bed8-b8132b3ab0bc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:22.446990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:22.522317 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8ecb8-5632-48e7-bffe-2fd0df0122cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:22.522927 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8ecb8-5632-48e7-bffe-2fd0df0122cb service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:22.523206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8ecb8-5632-48e7-bffe-2fd0df0122cb service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:22.523474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8ecb8-5632-48e7-bffe-2fd0df0122cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:22.525112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0be8ecb8-5632-48e7-bffe-2fd0df0122cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:22.628926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8ecb8-5632-48e7-bffe-2fd0df0122cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:22.630641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8ecb8-5632-48e7-bffe-2fd0df0122cb service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:22.651222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 698/1403] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:25.075066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cfd5-ef69-4ea1-9ded-eb2d7a34306a None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:25.075644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cfd5-ef69-4ea1-9ded-eb2d7a34306a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:25.075644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cfd5-ef69-4ea1-9ded-eb2d7a34306a None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:25.077114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 706/1404] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:25.082769 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb444bf1-1f01-4867-8aaf-02bfa22d3925 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:25.083221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb444bf1-1f01-4867-8aaf-02bfa22d3925 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:25.083320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb444bf1-1f01-4867-8aaf-02bfa22d3925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:25.152636 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bb444bf1-1f01-4867-8aaf-02bfa22d3925 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:25.153791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bb444bf1-1f01-4867-8aaf-02bfa22d3925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:25.156010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:25.285020 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 699/1405] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:25.563516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205cfd5-ef69-4ea1-9ded-eb2d7a34306a None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:25.570077 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1205cfd5-ef69-4ea1-9ded-eb2d7a34306a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:25.746969 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205cfd5-ef69-4ea1-9ded-eb2d7a34306a None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:25.805307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:25.873376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2414b4-867f-4a60-a998-17efe3d62583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:25.874024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2414b4-867f-4a60-a998-17efe3d62583 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:25.874376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2414b4-867f-4a60-a998-17efe3d62583 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:25.874642 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2414b4-867f-4a60-a998-17efe3d62583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:25.879276 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1f2414b4-867f-4a60-a998-17efe3d62583 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:25.976760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2414b4-867f-4a60-a998-17efe3d62583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:25.978433 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2414b4-867f-4a60-a998-17efe3d62583 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:25.997902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 707/1406] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:28.367689 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba479-cbcf-4a51-8ea3-ef467fc10618 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:28.368260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba479-cbcf-4a51-8ea3-ef467fc10618 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:28.368260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba479-cbcf-4a51-8ea3-ef467fc10618 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:28.369800 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 700/1407] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:28.376288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7ad98-7a41-4888-a93a-7522349b84f6 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:28.377050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7ad98-7a41-4888-a93a-7522349b84f6 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:28.377050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7ad98-7a41-4888-a93a-7522349b84f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:28.450063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-23a7ad98-7a41-4888-a93a-7522349b84f6 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:28.451420 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-23a7ad98-7a41-4888-a93a-7522349b84f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:28.459533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:28.566450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 708/1408] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:33:28.864200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ba479-cbcf-4a51-8ea3-ef467fc10618 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:28.865776 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a10ba479-cbcf-4a51-8ea3-ef467fc10618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:29.021043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:29.038492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ba479-cbcf-4a51-8ea3-ef467fc10618 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:29.171763 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df6085-74a7-4f6d-9797-824d60b25c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:29.172520 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df6085-74a7-4f6d-9797-824d60b25c5a service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:29.172856 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df6085-74a7-4f6d-9797-824d60b25c5a service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:29.173222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df6085-74a7-4f6d-9797-824d60b25c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:29.174883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f1df6085-74a7-4f6d-9797-824d60b25c5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:29.277405 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df6085-74a7-4f6d-9797-824d60b25c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:29.279034 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df6085-74a7-4f6d-9797-824d60b25c5a service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:29.284710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:29.304223 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 701/1409] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:38.564143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=40 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:39.322332 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:43.050347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce66f-7266-45b6-ba19-d54d0dd25bd2 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:43.050888 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce66f-7266-45b6-ba19-d54d0dd25bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:43.050888 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce66f-7266-45b6-ba19-d54d0dd25bd2 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:43.052223 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 709/1410] 10.222.0.50 () {54 vars in 918 bytes} [Sat Sep 17 04:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:43.058002 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbdf89-d28c-4ada-8f62-607960434526 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:43.058435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbdf89-d28c-4ada-8f62-607960434526 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:43.058542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbdf89-d28c-4ada-8f62-607960434526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:43.134121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d2bbdf89-d28c-4ada-8f62-607960434526 None None] MFA Rules not processed for user `931a947711a2468baaeef701bbee60c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:43.135317 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d2bbdf89-d28c-4ada-8f62-607960434526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:43.242110 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 702/1411] 10.222.0.50 () {58 vars in 1015 bytes} [Sat Sep 17 04:33:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:33:43.256467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91762aa0-78b3-449b-a2d5-192d9a89f704 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:43.256749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91762aa0-78b3-449b-a2d5-192d9a89f704 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:43.257045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91762aa0-78b3-449b-a2d5-192d9a89f704 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:43.258380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 710/1412] 10.222.0.50 () {54 vars in 918 bytes} [Sat Sep 17 04:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:43.262891 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835f41b-1009-4717-89fa-26b70c1cdaeb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:43.263176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835f41b-1009-4717-89fa-26b70c1cdaeb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:43.263497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835f41b-1009-4717-89fa-26b70c1cdaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:43.337113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:43.340114 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7835f41b-1009-4717-89fa-26b70c1cdaeb None None] MFA Rules not processed for user `eb70408fecfe41e0b2ea9a53c7ae0823`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:43.341353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7835f41b-1009-4717-89fa-26b70c1cdaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:43.457594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 703/1413] 10.222.0.50 () {58 vars in 1015 bytes} [Sat Sep 17 04:33:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:46.032266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ad9b7-9482-487f-ab3b-fd374a4398ff None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:46.032835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ad9b7-9482-487f-ab3b-fd374a4398ff None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:46.032835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ad9b7-9482-487f-ab3b-fd374a4398ff None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:46.034189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:46.039339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80494-ca9e-4f99-9c3b-4f8a1696086a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:46.039737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80494-ca9e-4f99-9c3b-4f8a1696086a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:46.039889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80494-ca9e-4f99-9c3b-4f8a1696086a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:46.105722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-57d80494-ca9e-4f99-9c3b-4f8a1696086a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:46.107010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-57d80494-ca9e-4f99-9c3b-4f8a1696086a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:46.161666 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:46.205215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:46.498369 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ad9b7-9482-487f-ab3b-fd374a4398ff None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:46.500214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7f9ad9b7-9482-487f-ab3b-fd374a4398ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:46.648965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ad9b7-9482-487f-ab3b-fd374a4398ff None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:46.721837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:46.761252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980c482-0a15-475b-88e4-ac87efe1dc17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:46.761855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980c482-0a15-475b-88e4-ac87efe1dc17 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:46.762131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980c482-0a15-475b-88e4-ac87efe1dc17 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:46.762399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980c482-0a15-475b-88e4-ac87efe1dc17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:46.764028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5980c482-0a15-475b-88e4-ac87efe1dc17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:46.852459 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980c482-0a15-475b-88e4-ac87efe1dc17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:46.854082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980c482-0a15-475b-88e4-ac87efe1dc17 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:46.871881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 712/1416] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:48.013857 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af6f48-3786-430e-8f15-6e789db75f96 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:48.014269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af6f48-3786-430e-8f15-6e789db75f96 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:48.014422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af6f48-3786-430e-8f15-6e789db75f96 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:48.015806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 04:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:48.021923 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eaf6b-afe7-4f68-82aa-5b9e8926bbe3 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:48.022363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eaf6b-afe7-4f68-82aa-5b9e8926bbe3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:48.022477 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eaf6b-afe7-4f68-82aa-5b9e8926bbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:48.097870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-eb2eaf6b-afe7-4f68-82aa-5b9e8926bbe3 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:48.099132 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-eb2eaf6b-afe7-4f68-82aa-5b9e8926bbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:48.126251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:48.204596 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 04:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:48.355824 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af6f48-3786-430e-8f15-6e789db75f96 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:48.358001 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a8af6f48-3786-430e-8f15-6e789db75f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:48.504305 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af6f48-3786-430e-8f15-6e789db75f96 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:48.548727 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:48.623531 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf3991-5003-4508-ad0d-85d372637406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:48.628283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf3991-5003-4508-ad0d-85d372637406 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:48.628283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf3991-5003-4508-ad0d-85d372637406 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:48.628283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf3991-5003-4508-ad0d-85d372637406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:48.628283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0abf3991-5003-4508-ad0d-85d372637406 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:48.715722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf3991-5003-4508-ad0d-85d372637406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:48.717944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf3991-5003-4508-ad0d-85d372637406 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:48.735607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 706/1419] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:49.878218 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacf919-6213-4b6b-a2a7-66cf4fa0bf53 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:49.878783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacf919-6213-4b6b-a2a7-66cf4fa0bf53 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:49.878783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacf919-6213-4b6b-a2a7-66cf4fa0bf53 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:49.880134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 04:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:49.886408 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4f78b-44a4-457d-b0b6-9698e4ea8af3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:49.886826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4f78b-44a4-457d-b0b6-9698e4ea8af3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:49.886946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4f78b-44a4-457d-b0b6-9698e4ea8af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:49.941091 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:49.962922 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f9d4f78b-44a4-457d-b0b6-9698e4ea8af3 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:49.964181 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f9d4f78b-44a4-457d-b0b6-9698e4ea8af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:50.061102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 04:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:33:50.214119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacf919-6213-4b6b-a2a7-66cf4fa0bf53 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:50.215998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-cdacf919-6213-4b6b-a2a7-66cf4fa0bf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:50.360796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacf919-6213-4b6b-a2a7-66cf4fa0bf53 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:50.373349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:50.472198 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54514793-4399-42a2-9f82-a768f0c0c966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:50.472724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54514793-4399-42a2-9f82-a768f0c0c966 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:50.473017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54514793-4399-42a2-9f82-a768f0c0c966 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:50.473295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54514793-4399-42a2-9f82-a768f0c0c966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:50.474879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-54514793-4399-42a2-9f82-a768f0c0c966 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:50.563180 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54514793-4399-42a2-9f82-a768f0c0c966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:50.564778 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54514793-4399-42a2-9f82-a768f0c0c966 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:50.582605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 715/1422] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:33:51.698157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74952750-edb3-42ac-9405-cf636a5bab9d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:51.698691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74952750-edb3-42ac-9405-cf636a5bab9d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:51.698691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74952750-edb3-42ac-9405-cf636a5bab9d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:51.699981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 04:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:51.706515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54472073-d97b-42c0-b32e-6856e9692582 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:51.706946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54472073-d97b-42c0-b32e-6856e9692582 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:51.707070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54472073-d97b-42c0-b32e-6856e9692582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:51.727149 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:51.784112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-54472073-d97b-42c0-b32e-6856e9692582 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:51.785353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-54472073-d97b-42c0-b32e-6856e9692582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:51.881123 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 04:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:52.029874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74952750-edb3-42ac-9405-cf636a5bab9d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:52.031445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-74952750-edb3-42ac-9405-cf636a5bab9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:52.139260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:52.176317 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74952750-edb3-42ac-9405-cf636a5bab9d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:52.286724 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca1ebe-33ed-469f-882e-8049f4ae395f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:52.287251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca1ebe-33ed-469f-882e-8049f4ae395f service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:52.287528 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca1ebe-33ed-469f-882e-8049f4ae395f service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:52.287800 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca1ebe-33ed-469f-882e-8049f4ae395f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:52.289418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b8ca1ebe-33ed-469f-882e-8049f4ae395f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:52.365606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:52.378740 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca1ebe-33ed-469f-882e-8049f4ae395f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:52.380399 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca1ebe-33ed-469f-882e-8049f4ae395f service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:52.398815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 709/1425] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:53.519543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2af8-b65a-4975-9baa-fa2d2e41ea28 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:53.520117 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2af8-b65a-4975-9baa-fa2d2e41ea28 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:53.520117 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2af8-b65a-4975-9baa-fa2d2e41ea28 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:53.521434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 04:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:53.527965 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46caa5b-a5ca-4833-9e0b-eef225495c9e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:53.528753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46caa5b-a5ca-4833-9e0b-eef225495c9e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:53.528753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46caa5b-a5ca-4833-9e0b-eef225495c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:53.604340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f46caa5b-a5ca-4833-9e0b-eef225495c9e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:53.605560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f46caa5b-a5ca-4833-9e0b-eef225495c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:53.702305 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 04:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:53.852460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df2af8-b65a-4975-9baa-fa2d2e41ea28 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:53.854023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d8df2af8-b65a-4975-9baa-fa2d2e41ea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:53.941248 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:54.002704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df2af8-b65a-4975-9baa-fa2d2e41ea28 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:54.113039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b6a83-438b-415b-846d-70efe36eef2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:54.113571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b6a83-438b-415b-846d-70efe36eef2e service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:54.113847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b6a83-438b-415b-846d-70efe36eef2e service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:54.114113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b6a83-438b-415b-846d-70efe36eef2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:54.115701 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-189b6a83-438b-415b-846d-70efe36eef2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:54.165522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:54.207305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b6a83-438b-415b-846d-70efe36eef2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:54.209008 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b6a83-438b-415b-846d-70efe36eef2e service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:54.227548 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 718/1428] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:55.328791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12370203-0d92-4573-9c4f-1b8e2c40423b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:55.329418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12370203-0d92-4573-9c4f-1b8e2c40423b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:55.329418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12370203-0d92-4573-9c4f-1b8e2c40423b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:55.330745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 04:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:55.337407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d059a-f144-4880-b15a-5f1ae9ae71ad None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:55.337829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d059a-f144-4880-b15a-5f1ae9ae71ad None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:55.337943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d059a-f144-4880-b15a-5f1ae9ae71ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:55.414196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-e15d059a-f144-4880-b15a-5f1ae9ae71ad None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:55.415389 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-e15d059a-f144-4880-b15a-5f1ae9ae71ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:55.510195 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 04:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:55.658227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12370203-0d92-4573-9c4f-1b8e2c40423b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:55.659672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-12370203-0d92-4573-9c4f-1b8e2c40423b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:55.709709 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:55.808247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12370203-0d92-4573-9c4f-1b8e2c40423b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:55.920262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15442157-150b-4f47-a5e8-5e933d02f70e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:55.920788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15442157-150b-4f47-a5e8-5e933d02f70e service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:55.921101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15442157-150b-4f47-a5e8-5e933d02f70e service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:55.921369 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15442157-150b-4f47-a5e8-5e933d02f70e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:55.922952 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-15442157-150b-4f47-a5e8-5e933d02f70e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:55.929998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:56.011840 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15442157-150b-4f47-a5e8-5e933d02f70e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:56.013490 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15442157-150b-4f47-a5e8-5e933d02f70e service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:56.031585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 712/1431] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:57.129327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06701308-737d-423f-8a2e-8de633de6dcd None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:57.129882 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06701308-737d-423f-8a2e-8de633de6dcd None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:57.129882 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06701308-737d-423f-8a2e-8de633de6dcd None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:57.131220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 04:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:57.137498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cecfc-bd7e-49d6-93a3-89b81dcb2ed2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:57.137961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cecfc-bd7e-49d6-93a3-89b81dcb2ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:57.138145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cecfc-bd7e-49d6-93a3-89b81dcb2ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:57.213539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-825cecfc-bd7e-49d6-93a3-89b81dcb2ed2 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:57.214661 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-825cecfc-bd7e-49d6-93a3-89b81dcb2ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:57.282204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:57.312000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 04:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:33:57.462217 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06701308-737d-423f-8a2e-8de633de6dcd None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:57.463803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-06701308-737d-423f-8a2e-8de633de6dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:57.481929 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:57.610000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06701308-737d-423f-8a2e-8de633de6dcd None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:57.694788 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:57.721163 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dd819-3f91-484f-84fc-0a430fbfe0b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:57.721712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd819-3f91-484f-84fc-0a430fbfe0b7 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:57.721986 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd819-3f91-484f-84fc-0a430fbfe0b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:57.722255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd819-3f91-484f-84fc-0a430fbfe0b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:57.723826 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-522dd819-3f91-484f-84fc-0a430fbfe0b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:57.810677 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dd819-3f91-484f-84fc-0a430fbfe0b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:57.812253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dd819-3f91-484f-84fc-0a430fbfe0b7 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:57.830225 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 721/1434] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:33:58.922221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893574b-d5fc-4e8f-91ff-47f9b2fd771e None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:58.922674 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893574b-d5fc-4e8f-91ff-47f9b2fd771e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:58.922795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893574b-d5fc-4e8f-91ff-47f9b2fd771e None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:58.924150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 04:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:33:58.930443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319179b4-828a-4b6f-9f2a-dfc77fcae99b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:58.930884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319179b4-828a-4b6f-9f2a-dfc77fcae99b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:58.931000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319179b4-828a-4b6f-9f2a-dfc77fcae99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:59.008036 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-319179b4-828a-4b6f-9f2a-dfc77fcae99b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:33:59.009262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-319179b4-828a-4b6f-9f2a-dfc77fcae99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:59.050843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:59.108516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 04:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:33:59.257090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893574b-d5fc-4e8f-91ff-47f9b2fd771e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:33:59.258530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d893574b-d5fc-4e8f-91ff-47f9b2fd771e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:59.402837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893574b-d5fc-4e8f-91ff-47f9b2fd771e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:33:59.457238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:33:59.516245 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822f7ed-2518-45ec-b528-6ffd5a623707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:33:59.516773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822f7ed-2518-45ec-b528-6ffd5a623707 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:33:59.517081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822f7ed-2518-45ec-b528-6ffd5a623707 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:33:59.517353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822f7ed-2518-45ec-b528-6ffd5a623707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:33:59.518990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7822f7ed-2518-45ec-b528-6ffd5a623707 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:33:59.610456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822f7ed-2518-45ec-b528-6ffd5a623707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:33:59.612052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822f7ed-2518-45ec-b528-6ffd5a623707 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:33:59.629722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 715/1437] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:34:00.719647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1483e5-aba1-48f0-b439-01427f9a170a None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:00.720225 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1483e5-aba1-48f0-b439-01427f9a170a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:00.720225 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1483e5-aba1-48f0-b439-01427f9a170a None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:00.721542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 04:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:34:00.727604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade12a4-5495-494b-82aa-c5932e07ec24 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:00.728011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade12a4-5495-494b-82aa-c5932e07ec24 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:00.728137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade12a4-5495-494b-82aa-c5932e07ec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:00.802818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4ade12a4-5495-494b-82aa-c5932e07ec24 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:00.804004 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4ade12a4-5495-494b-82aa-c5932e07ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:00.806009 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:00.900942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 04:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:34:01.052907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1483e5-aba1-48f0-b439-01427f9a170a None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:34:01.054455 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7c1483e5-aba1-48f0-b439-01427f9a170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:01.199022 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1483e5-aba1-48f0-b439-01427f9a170a None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:34:01.226557 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:01.313257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8231541-f776-4856-8ff0-0d2b543a332a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:34:01.313781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8231541-f776-4856-8ff0-0d2b543a332a service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:01.314061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8231541-f776-4856-8ff0-0d2b543a332a service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:01.314330 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8231541-f776-4856-8ff0-0d2b543a332a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:01.315939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c8231541-f776-4856-8ff0-0d2b543a332a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:01.405112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8231541-f776-4856-8ff0-0d2b543a332a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:34:01.406751 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8231541-f776-4856-8ff0-0d2b543a332a service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:34:01.424613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 724/1440] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:34:03.560534 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd84aba-61a1-4fe0-ad7c-c928e0d8a4ae None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:03.561077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd84aba-61a1-4fe0-ad7c-c928e0d8a4ae None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:03.561077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd84aba-61a1-4fe0-ad7c-c928e0d8a4ae None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:03.562397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:34:03.567688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eed9d-29e3-4d1f-b57a-2701e1d2c9de None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:03.568131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eed9d-29e3-4d1f-b57a-2701e1d2c9de None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:03.568251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eed9d-29e3-4d1f-b57a-2701e1d2c9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:03.609711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:03.634606 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-415eed9d-29e3-4d1f-b57a-2701e1d2c9de None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:03.635798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-415eed9d-29e3-4d1f-b57a-2701e1d2c9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:03.732536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:34:04.015668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd84aba-61a1-4fe0-ad7c-c928e0d8a4ae None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:34:04.017268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3dd84aba-61a1-4fe0-ad7c-c928e0d8a4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:04.121687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd84aba-61a1-4fe0-ad7c-c928e0d8a4ae None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:34:04.154436 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:04.195593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cca0e-d371-4dcd-a8f1-4a89518f678a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:34:04.196196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cca0e-d371-4dcd-a8f1-4a89518f678a service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:04.196473 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cca0e-d371-4dcd-a8f1-4a89518f678a service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:04.196740 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cca0e-d371-4dcd-a8f1-4a89518f678a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:04.198374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1d8cca0e-d371-4dcd-a8f1-4a89518f678a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:04.308846 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cca0e-d371-4dcd-a8f1-4a89518f678a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:34:04.310302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cca0e-d371-4dcd-a8f1-4a89518f678a service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:34:04.328571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 718/1443] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:34:06.710949 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e36ed-ab12-4bb4-94a7-e130de2ebb3e None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:06.711495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e36ed-ab12-4bb4-94a7-e130de2ebb3e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:06.711495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e36ed-ab12-4bb4-94a7-e130de2ebb3e None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:06.712816 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:34:06.718699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8b92f-c029-45c7-8c58-218067658722 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:06.719110 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8b92f-c029-45c7-8c58-218067658722 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:06.719241 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8b92f-c029-45c7-8c58-218067658722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:06.784977 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1af8b92f-c029-45c7-8c58-218067658722 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:06.786195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1af8b92f-c029-45c7-8c58-218067658722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:06.798640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:06.882439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:34:07.172457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e36ed-ab12-4bb4-94a7-e130de2ebb3e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:34:07.174020 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8a8e36ed-ab12-4bb4-94a7-e130de2ebb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:07.277362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e36ed-ab12-4bb4-94a7-e130de2ebb3e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:34:07.289512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:07.352630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4309e-017c-4c9c-a00b-8c144c23ae3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:34:07.353258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4309e-017c-4c9c-a00b-8c144c23ae3d service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:07.353533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4309e-017c-4c9c-a00b-8c144c23ae3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:07.353802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4309e-017c-4c9c-a00b-8c144c23ae3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:07.356063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-56a4309e-017c-4c9c-a00b-8c144c23ae3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:07.465233 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4309e-017c-4c9c-a00b-8c144c23ae3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:34:07.466722 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4309e-017c-4c9c-a00b-8c144c23ae3d service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:34:07.485379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 727/1446] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:34:09.983294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b9f20-6684-40fb-bec2-f5d037cec16c None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:09.983878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b9f20-6684-40fb-bec2-f5d037cec16c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:09.983878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b9f20-6684-40fb-bec2-f5d037cec16c None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:09.985272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:34:09.990701 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17e0d-15e0-489c-8779-b8c094eac84a None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:09.991109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17e0d-15e0-489c-8779-b8c094eac84a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:09.991245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17e0d-15e0-489c-8779-b8c094eac84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:10.038590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:10.055539 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-90a17e0d-15e0-489c-8779-b8c094eac84a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:10.056724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-90a17e0d-15e0-489c-8779-b8c094eac84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:10.153882 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:34:10.437279 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b9f20-6684-40fb-bec2-f5d037cec16c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:34:10.438802 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-513b9f20-6684-40fb-bec2-f5d037cec16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:10.543574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b9f20-6684-40fb-bec2-f5d037cec16c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:34:10.583925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:10.617314 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11799b4-83c6-4a43-8d04-b63949b67632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:34:10.617918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11799b4-83c6-4a43-8d04-b63949b67632 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:10.618194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11799b4-83c6-4a43-8d04-b63949b67632 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:10.618463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11799b4-83c6-4a43-8d04-b63949b67632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:10.620109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a11799b4-83c6-4a43-8d04-b63949b67632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:10.728548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11799b4-83c6-4a43-8d04-b63949b67632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:34:10.729963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11799b4-83c6-4a43-8d04-b63949b67632 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:34:10.748845 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 721/1449] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:34:13.031943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f562c0-8b79-436d-9fb7-550e88a6bea0 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:13.032502 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f562c0-8b79-436d-9fb7-550e88a6bea0 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:13.032502 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f562c0-8b79-436d-9fb7-550e88a6bea0 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:13.033865 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:34:13.039092 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076af604-174c-4c5e-a726-ddefe9ccabc1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:13.039497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076af604-174c-4c5e-a726-ddefe9ccabc1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:13.039629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076af604-174c-4c5e-a726-ddefe9ccabc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:13.105706 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-076af604-174c-4c5e-a726-ddefe9ccabc1 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:13.106918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-076af604-174c-4c5e-a726-ddefe9ccabc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:13.127762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:13.207629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:34:13.492950 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f562c0-8b79-436d-9fb7-550e88a6bea0 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:34:13.494507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c6f562c0-8b79-436d-9fb7-550e88a6bea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:13.597887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f562c0-8b79-436d-9fb7-550e88a6bea0 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:34:13.618253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:13.669942 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da718c2b-fbb8-4905-aad8-081240705ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:34:13.670540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da718c2b-fbb8-4905-aad8-081240705ffd service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:13.670813 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da718c2b-fbb8-4905-aad8-081240705ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:13.671077 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da718c2b-fbb8-4905-aad8-081240705ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:13.672650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-da718c2b-fbb8-4905-aad8-081240705ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:13.779087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da718c2b-fbb8-4905-aad8-081240705ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:34:13.780435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da718c2b-fbb8-4905-aad8-081240705ffd service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:34:13.798468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 730/1452] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:34:16.004450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d9d6-b77c-41a3-8508-8484dea17427 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:16.005007 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d9d6-b77c-41a3-8508-8484dea17427 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:16.005007 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d9d6-b77c-41a3-8508-8484dea17427 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:16.006382 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:34:16.012402 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bd845-566b-4c99-8b09-b8b901d01e71 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:16.012849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bd845-566b-4c99-8b09-b8b901d01e71 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:16.012945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bd845-566b-4c99-8b09-b8b901d01e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:16.075790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:16.078493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-e12bd845-566b-4c99-8b09-b8b901d01e71 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:16.079682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-e12bd845-566b-4c99-8b09-b8b901d01e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:16.176917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:34:16.460302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4d9d6-b77c-41a3-8508-8484dea17427 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:34:16.468316 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-67c4d9d6-b77c-41a3-8508-8484dea17427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:16.566285 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4d9d6-b77c-41a3-8508-8484dea17427 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:34:16.617070 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:16.641997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84a262-e65b-4cf0-a694-47a233155ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:34:16.642602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84a262-e65b-4cf0-a694-47a233155ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:16.642880 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84a262-e65b-4cf0-a694-47a233155ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:16.643150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84a262-e65b-4cf0-a694-47a233155ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:16.644769 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2b84a262-e65b-4cf0-a694-47a233155ea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:16.754214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84a262-e65b-4cf0-a694-47a233155ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:34:16.755676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84a262-e65b-4cf0-a694-47a233155ea6 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:34:16.773587 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 724/1455] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:34:19.017921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b60e3-d4bd-424d-9f30-ec1513088ae3 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:19.018466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b60e3-d4bd-424d-9f30-ec1513088ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:19.018466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b60e3-d4bd-424d-9f30-ec1513088ae3 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:19.019811 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:34:19.025150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057169f-c605-440f-9a51-24c210fc84de None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:19.025586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057169f-c605-440f-9a51-24c210fc84de None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:19.025687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057169f-c605-440f-9a51-24c210fc84de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:19.091342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6057169f-c605-440f-9a51-24c210fc84de None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:19.092537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6057169f-c605-440f-9a51-24c210fc84de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:19.121905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:19.190828 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:34:19.478637 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b60e3-d4bd-424d-9f30-ec1513088ae3 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:34:19.481122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b13b60e3-d4bd-424d-9f30-ec1513088ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:19.591882 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b60e3-d4bd-424d-9f30-ec1513088ae3 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:34:19.620758 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:19.782499 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860631d-dd3c-4333-b6d4-04d8b1ce9dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:34:19.783002 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860631d-dd3c-4333-b6d4-04d8b1ce9dae service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:19.783273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860631d-dd3c-4333-b6d4-04d8b1ce9dae service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:19.783558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860631d-dd3c-4333-b6d4-04d8b1ce9dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:19.785128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6860631d-dd3c-4333-b6d4-04d8b1ce9dae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:19.893527 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860631d-dd3c-4333-b6d4-04d8b1ce9dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:34:19.894953 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860631d-dd3c-4333-b6d4-04d8b1ce9dae service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:34:19.912685 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 733/1458] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:34:22.117863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda6505-5294-433d-a866-d8dd5599a72b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:22.118453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda6505-5294-433d-a866-d8dd5599a72b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:22.118453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda6505-5294-433d-a866-d8dd5599a72b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:22.119815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:34:22.125126 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e3ac6-9865-4239-b8f3-927b1220bfd2 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:22.125532 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e3ac6-9865-4239-b8f3-927b1220bfd2 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:22.125668 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e3ac6-9865-4239-b8f3-927b1220bfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:22.192049 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-319e3ac6-9865-4239-b8f3-927b1220bfd2 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:22.193261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-319e3ac6-9865-4239-b8f3-927b1220bfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:22.201504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:22.287642 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:34:22.573804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda6505-5294-433d-a866-d8dd5599a72b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:34:22.575319 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5bda6505-5294-433d-a866-d8dd5599a72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:22.678070 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda6505-5294-433d-a866-d8dd5599a72b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:34:22.733980 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:22.751189 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cb742-69a4-44d7-978f-a9e45c38bd01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:34:22.751787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cb742-69a4-44d7-978f-a9e45c38bd01 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:22.752056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cb742-69a4-44d7-978f-a9e45c38bd01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:22.752316 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cb742-69a4-44d7-978f-a9e45c38bd01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:22.753914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5e6cb742-69a4-44d7-978f-a9e45c38bd01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:22.859661 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cb742-69a4-44d7-978f-a9e45c38bd01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:34:22.861041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cb742-69a4-44d7-978f-a9e45c38bd01 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:34:22.878800 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 727/1461] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:34:25.079526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2967aa-35ca-460a-b565-88951b7cd799 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:25.080151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2967aa-35ca-460a-b565-88951b7cd799 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:25.080151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2967aa-35ca-460a-b565-88951b7cd799 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:25.081407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:34:25.086840 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6affd20-2160-4256-a72d-d8cb6c6cbb25 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:25.087243 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6affd20-2160-4256-a72d-d8cb6c6cbb25 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:25.087387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6affd20-2160-4256-a72d-d8cb6c6cbb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:25.152572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f6affd20-2160-4256-a72d-d8cb6c6cbb25 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:25.153807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f6affd20-2160-4256-a72d-d8cb6c6cbb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:25.193438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:25.251431 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:34:25.535195 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2967aa-35ca-460a-b565-88951b7cd799 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:34:25.536772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8b2967aa-35ca-460a-b565-88951b7cd799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:25.640918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2967aa-35ca-460a-b565-88951b7cd799 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:34:25.679331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:25.721484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c358968-9802-4945-b48f-458a4ad8fe6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:34:25.722086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c358968-9802-4945-b48f-458a4ad8fe6e service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:25.722366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c358968-9802-4945-b48f-458a4ad8fe6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:25.722633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c358968-9802-4945-b48f-458a4ad8fe6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:25.724339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7c358968-9802-4945-b48f-458a4ad8fe6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:25.828832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c358968-9802-4945-b48f-458a4ad8fe6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:34:25.830384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c358968-9802-4945-b48f-458a4ad8fe6e service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:34:25.848702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 736/1464] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:34:28.063422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d2f20-84a5-440d-ae3d-89b820ac3b37 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:28.063988 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d2f20-84a5-440d-ae3d-89b820ac3b37 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:28.063988 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d2f20-84a5-440d-ae3d-89b820ac3b37 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:28.065385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:34:28.070738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549ed4a-d112-4e7c-8265-fde6fdcc0572 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:28.071142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549ed4a-d112-4e7c-8265-fde6fdcc0572 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:28.071274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549ed4a-d112-4e7c-8265-fde6fdcc0572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:28.135990 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-7549ed4a-d112-4e7c-8265-fde6fdcc0572 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:28.137210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7549ed4a-d112-4e7c-8265-fde6fdcc0572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:28.154701 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:28.233865 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:34:28.515020 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d2f20-84a5-440d-ae3d-89b820ac3b37 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:34:28.516594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f05d2f20-84a5-440d-ae3d-89b820ac3b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:28.621892 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d2f20-84a5-440d-ae3d-89b820ac3b37 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:34:28.688149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:28.694416 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42382aaa-9655-4c73-b3db-2879599c2392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:34:28.695016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382aaa-9655-4c73-b3db-2879599c2392 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:28.695288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382aaa-9655-4c73-b3db-2879599c2392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:28.695549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382aaa-9655-4c73-b3db-2879599c2392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:28.697142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-42382aaa-9655-4c73-b3db-2879599c2392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:28.806641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42382aaa-9655-4c73-b3db-2879599c2392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:34:28.808568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42382aaa-9655-4c73-b3db-2879599c2392 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:34:28.827732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 730/1467] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:34:31.043635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61814c3a-4bc6-4f8f-b734-51a106e6cbc5 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:31.044159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61814c3a-4bc6-4f8f-b734-51a106e6cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:31.044159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61814c3a-4bc6-4f8f-b734-51a106e6cbc5 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:31.045563 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:34:31.050886 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86b8b-32db-4e68-a5ba-73ac32df5554 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:31.053879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86b8b-32db-4e68-a5ba-73ac32df5554 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:31.053879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86b8b-32db-4e68-a5ba-73ac32df5554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:31.117517 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5aa86b8b-32db-4e68-a5ba-73ac32df5554 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:31.118723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5aa86b8b-32db-4e68-a5ba-73ac32df5554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:31.167193 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:31.215063 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:34:31.501502 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61814c3a-4bc6-4f8f-b734-51a106e6cbc5 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:34:31.503103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-61814c3a-4bc6-4f8f-b734-51a106e6cbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:31.612766 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61814c3a-4bc6-4f8f-b734-51a106e6cbc5 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:34:31.662918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:31.688209 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071efc87-659e-4e0c-8b69-2457a031bb62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:34:31.688822 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071efc87-659e-4e0c-8b69-2457a031bb62 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:31.689137 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071efc87-659e-4e0c-8b69-2457a031bb62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:31.689411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071efc87-659e-4e0c-8b69-2457a031bb62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:31.691006 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-071efc87-659e-4e0c-8b69-2457a031bb62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:31.799152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071efc87-659e-4e0c-8b69-2457a031bb62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:34:31.800573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071efc87-659e-4e0c-8b69-2457a031bb62 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:34:31.818764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 739/1470] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:34:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:34:41.221048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=22 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:41.816566 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=66 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:51.953582 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d022cb-3d03-47e4-b797-a16a2f6faf31 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:51.954121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d022cb-3d03-47e4-b797-a16a2f6faf31 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:51.954121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d022cb-3d03-47e4-b797-a16a2f6faf31 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:51.955388 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 732/1471] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:34:51.960981 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeb3f7-e82c-488a-afba-9f132a814391 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:51.962113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeb3f7-e82c-488a-afba-9f132a814391 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:51.962113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeb3f7-e82c-488a-afba-9f132a814391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:52.027727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-65aeb3f7-e82c-488a-afba-9f132a814391 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:52.028962 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-65aeb3f7-e82c-488a-afba-9f132a814391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:52.126141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 740/1472] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:34:52.428239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9c56c-5f14-41fb-a41e-7cac47dd5e4d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:52.428518 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9c56c-5f14-41fb-a41e-7cac47dd5e4d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:52.428785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9c56c-5f14-41fb-a41e-7cac47dd5e4d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:52.430843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 733/1473] 10.222.0.50 () {54 vars in 962 bytes} [Sat Sep 17 04:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:34:52.435821 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce7177-8cc5-4b5c-9857-e8f82a29ab0a None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:52.436097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce7177-8cc5-4b5c-9857-e8f82a29ab0a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:52.436366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce7177-8cc5-4b5c-9857-e8f82a29ab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:52.511581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-81ce7177-8cc5-4b5c-9857-e8f82a29ab0a None None] MFA Rules not processed for user `81ba9aba795f423a8ffabe419b64507a`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:52.513217 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-81ce7177-8cc5-4b5c-9857-e8f82a29ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:52.533369 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:52.589320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 741/1474] 10.222.0.50 () {58 vars in 1059 bytes} [Sat Sep 17 04:34:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:34:52.596958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9c56c-5f14-41fb-a41e-7cac47dd5e4d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:34:52.598474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-77d9c56c-5f14-41fb-a41e-7cac47dd5e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:52.701409 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9c56c-5f14-41fb-a41e-7cac47dd5e4d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:34:52.777253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55d23b-ab0a-428e-aa49-68199f426771 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ba9aba795f423a8ffabe419b64507a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:34:52.777862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55d23b-ab0a-428e-aa49-68199f426771 service glance] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:52.778139 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55d23b-ab0a-428e-aa49-68199f426771 service glance] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:52.778412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55d23b-ab0a-428e-aa49-68199f426771 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:52.780016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ec55d23b-ab0a-428e-aa49-68199f426771 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:52.833878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:52.888113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55d23b-ab0a-428e-aa49-68199f426771 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:34:52.889583 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55d23b-ab0a-428e-aa49-68199f426771 service glance] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:34:52.908158 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 734/1475] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:34:55.139378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0362cf-e454-499e-99ec-becc32d41305 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:55.139973 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0362cf-e454-499e-99ec-becc32d41305 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:55.139973 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0362cf-e454-499e-99ec-becc32d41305 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:55.141285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 742/1476] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:34:55.146497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b7a5e-11e3-4077-81ad-e0c1d1684452 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:55.146915 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b7a5e-11e3-4077-81ad-e0c1d1684452 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:55.147041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b7a5e-11e3-4077-81ad-e0c1d1684452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:55.213498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2b5b7a5e-11e3-4077-81ad-e0c1d1684452 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:55.214628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2b5b7a5e-11e3-4077-81ad-e0c1d1684452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:55.311500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 735/1477] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:34:55.582855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0362cf-e454-499e-99ec-becc32d41305 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:34:55.584650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5c0362cf-e454-499e-99ec-becc32d41305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:55.708682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0362cf-e454-499e-99ec-becc32d41305 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:34:55.758015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:55.801906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a689c89-0f14-43ca-bde2-6367b85333ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:34:55.802506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a689c89-0f14-43ca-bde2-6367b85333ce admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:55.802783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a689c89-0f14-43ca-bde2-6367b85333ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:55.803051 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a689c89-0f14-43ca-bde2-6367b85333ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:55.803682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a689c89-0f14-43ca-bde2-6367b85333ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:34:55.805681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: WARNING py.warnings [None req-3a689c89-0f14-43ca-bde2-6367b85333ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:34:55.805681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: warnings.warn(msg) Sep 17 04:34:55.805681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: Sep 17 04:34:55.806809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a689c89-0f14-43ca-bde2-6367b85333ce admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:34:55.825579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 743/1478] 10.222.0.50 () {56 vars in 1108 bytes} [Sat Sep 17 04:34:55 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:34:57.986962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e53d4-5a76-4936-bcdc-659a268f5c78 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:57.987527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e53d4-5a76-4936-bcdc-659a268f5c78 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:57.987527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e53d4-5a76-4936-bcdc-659a268f5c78 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:57.988923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 736/1479] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:34:57.994660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084de43f-bf6b-4282-aa27-6d7cd31714ef None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:57.995076 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084de43f-bf6b-4282-aa27-6d7cd31714ef None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:57.995204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084de43f-bf6b-4282-aa27-6d7cd31714ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:58.060719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-084de43f-bf6b-4282-aa27-6d7cd31714ef None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:34:58.061980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-084de43f-bf6b-4282-aa27-6d7cd31714ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:58.157824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 744/1480] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:34:58.457197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e53d4-5a76-4936-bcdc-659a268f5c78 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:34:58.458776 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-469e53d4-5a76-4936-bcdc-659a268f5c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:58.469387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:58.608388 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e53d4-5a76-4936-bcdc-659a268f5c78 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:34:58.804683 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:34:58.836515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fce22-53d9-4c42-85b5-24ce05e7e45b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:34:58.837221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fce22-53d9-4c42-85b5-24ce05e7e45b service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:34:58.837492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fce22-53d9-4c42-85b5-24ce05e7e45b service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:34:58.837751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fce22-53d9-4c42-85b5-24ce05e7e45b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:34:58.839311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-581fce22-53d9-4c42-85b5-24ce05e7e45b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:34:58.928011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fce22-53d9-4c42-85b5-24ce05e7e45b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:34:58.930926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fce22-53d9-4c42-85b5-24ce05e7e45b service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:34:58.949357 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 737/1481] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:35:01.272067 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fe36c-b013-4337-b12e-864b4398fdbd None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:35:01.272596 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fe36c-b013-4337-b12e-864b4398fdbd None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:35:01.272596 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fe36c-b013-4337-b12e-864b4398fdbd None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:35:01.274512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 745/1482] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:35:01.279888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b711a4-d6a7-48da-b6f4-97335d286c19 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:35:01.280301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b711a4-d6a7-48da-b6f4-97335d286c19 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:35:01.280410 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b711a4-d6a7-48da-b6f4-97335d286c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:35:01.345469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a9b711a4-d6a7-48da-b6f4-97335d286c19 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:35:01.346678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a9b711a4-d6a7-48da-b6f4-97335d286c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:35:01.392401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:35:01.441612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 738/1483] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:35:01.727688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fe36c-b013-4337-b12e-864b4398fdbd None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:35:01.729261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-246fe36c-b013-4337-b12e-864b4398fdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:35:01.754482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:35:01.833838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fe36c-b013-4337-b12e-864b4398fdbd None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:35:01.908302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32406615-27a8-48ba-935d-b7c777e4c8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:35:01.908902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32406615-27a8-48ba-935d-b7c777e4c8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:35:01.909214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32406615-27a8-48ba-935d-b7c777e4c8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:35:01.909488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32406615-27a8-48ba-935d-b7c777e4c8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:35:01.911074 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-32406615-27a8-48ba-935d-b7c777e4c8b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:35:01.984496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:35:02.019600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32406615-27a8-48ba-935d-b7c777e4c8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:35:02.021041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32406615-27a8-48ba-935d-b7c777e4c8b2 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:35:02.038632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 746/1484] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:35:04.237034 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb299c-55d7-405c-bbf9-c9e7938040ff None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:35:04.237603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb299c-55d7-405c-bbf9-c9e7938040ff None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:35:04.237603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb299c-55d7-405c-bbf9-c9e7938040ff None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:35:04.238923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 739/1485] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:35:04.244750 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb10757-5276-4fcf-9cf8-9b9501316e89 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:35:04.245200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb10757-5276-4fcf-9cf8-9b9501316e89 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:35:04.245332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb10757-5276-4fcf-9cf8-9b9501316e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:35:04.312403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ceb10757-5276-4fcf-9cf8-9b9501316e89 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:35:04.313635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ceb10757-5276-4fcf-9cf8-9b9501316e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:35:04.408230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 747/1486] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:35:04.698374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb299c-55d7-405c-bbf9-c9e7938040ff None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:35:04.699900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-74bb299c-55d7-405c-bbf9-c9e7938040ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:35:04.802438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb299c-55d7-405c-bbf9-c9e7938040ff None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:35:04.873799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:35:04.875261 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e88b6-dc3f-4b45-b151-b5b6e4da5d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:35:04.875845 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e88b6-dc3f-4b45-b151-b5b6e4da5d3c service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:35:04.876117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e88b6-dc3f-4b45-b151-b5b6e4da5d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:35:04.876383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e88b6-dc3f-4b45-b151-b5b6e4da5d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:35:04.877981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-053e88b6-dc3f-4b45-b151-b5b6e4da5d3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:35:04.986713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e88b6-dc3f-4b45-b151-b5b6e4da5d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:35:04.988174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e88b6-dc3f-4b45-b151-b5b6e4da5d3c service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:35:05.005776 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 740/1487] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:35:07.263341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c007e-1977-43a9-9ca3-e9c14b182c15 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:35:07.263873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c007e-1977-43a9-9ca3-e9c14b182c15 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:35:07.263873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c007e-1977-43a9-9ca3-e9c14b182c15 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:35:07.265229 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 748/1488] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:35:07.270591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbd8fc-4a78-4576-aaee-ac7bc0225f8d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:35:07.271005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbd8fc-4a78-4576-aaee-ac7bc0225f8d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:35:07.271129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbd8fc-4a78-4576-aaee-ac7bc0225f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:35:07.337415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bafbd8fc-4a78-4576-aaee-ac7bc0225f8d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:35:07.338613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bafbd8fc-4a78-4576-aaee-ac7bc0225f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:35:07.390164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:35:07.441190 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 741/1489] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:35:07.734674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c007e-1977-43a9-9ca3-e9c14b182c15 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:35:07.736208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b11c007e-1977-43a9-9ca3-e9c14b182c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:35:07.772730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:35:07.839073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c007e-1977-43a9-9ca3-e9c14b182c15 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:35:07.911615 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd9901-9bb0-4fe1-a2d8-169a0886d3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:35:07.912213 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd9901-9bb0-4fe1-a2d8-169a0886d3ee service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:35:07.912482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd9901-9bb0-4fe1-a2d8-169a0886d3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:35:07.912741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd9901-9bb0-4fe1-a2d8-169a0886d3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:35:07.914459 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-acdd9901-9bb0-4fe1-a2d8-169a0886d3ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:35:07.993407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:35:08.022613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd9901-9bb0-4fe1-a2d8-169a0886d3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:35:08.024462 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd9901-9bb0-4fe1-a2d8-169a0886d3ee service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:35:08.043210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 749/1490] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:35:10.530522 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67530321-f661-4884-9322-8db4e0959127 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:35:10.531031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67530321-f661-4884-9322-8db4e0959127 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:35:10.531031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67530321-f661-4884-9322-8db4e0959127 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:35:10.532427 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 742/1491] 10.222.0.50 () {54 vars in 927 bytes} [Sat Sep 17 04:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:35:10.537672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbe320-d44e-448a-bce9-b28b00b8125c None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:35:10.538325 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbe320-d44e-448a-bce9-b28b00b8125c None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:35:10.538325 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbe320-d44e-448a-bce9-b28b00b8125c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:35:10.604678 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-a5bbe320-d44e-448a-bce9-b28b00b8125c None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:35:10.607990 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a5bbe320-d44e-448a-bce9-b28b00b8125c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:35:10.701286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 750/1492] 10.222.0.50 () {58 vars in 1024 bytes} [Sat Sep 17 04:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:35:10.992098 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67530321-f661-4884-9322-8db4e0959127 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:35:10.993637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-67530321-f661-4884-9322-8db4e0959127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:35:11.098206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67530321-f661-4884-9322-8db4e0959127 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:35:11.172482 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebde0d5-f617-42dd-b73a-f1bb36d86f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:35:11.173109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde0d5-f617-42dd-b73a-f1bb36d86f56 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:35:11.173379 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde0d5-f617-42dd-b73a-f1bb36d86f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:35:11.173639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde0d5-f617-42dd-b73a-f1bb36d86f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:35:11.175194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0ebde0d5-f617-42dd-b73a-f1bb36d86f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:35:11.183616 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:35:11.283153 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebde0d5-f617-42dd-b73a-f1bb36d86f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:35:11.284499 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebde0d5-f617-42dd-b73a-f1bb36d86f56 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:35:11.302213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 743/1493] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:35:20.699689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=82 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:35:21.299938 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=50 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:36:55.457563 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9102c1f-5451-48a4-892d-dc86e059f4df None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:55.458185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9102c1f-5451-48a4-892d-dc86e059f4df None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:55.458185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9102c1f-5451-48a4-892d-dc86e059f4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:55.538201 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c9102c1f-5451-48a4-892d-dc86e059f4df None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:36:55.540258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c9102c1f-5451-48a4-892d-dc86e059f4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:36:55.648546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 751/1494] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:36:55.656647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7789f1-ecdd-4898-b71a-52aa0f1e9481 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:55.657167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7789f1-ecdd-4898-b71a-52aa0f1e9481 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:55.657284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7789f1-ecdd-4898-b71a-52aa0f1e9481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:55.677270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2d7789f1-ecdd-4898-b71a-52aa0f1e9481 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:36:55.678458 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2d7789f1-ecdd-4898-b71a-52aa0f1e9481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:36:55.686963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 744/1495] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:36:55.692033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9102c1f-5451-48a4-892d-dc86e059f4df None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:36:55.701632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9102c1f-5451-48a4-892d-dc86e059f4df None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:36:55.706231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8890dcc-4f3a-46f0-b07a-2aecf27a74d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:36:55.707691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8890dcc-4f3a-46f0-b07a-2aecf27a74d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:55.707940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8890dcc-4f3a-46f0-b07a-2aecf27a74d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:55.708210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8890dcc-4f3a-46f0-b07a-2aecf27a74d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:55.708860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8890dcc-4f3a-46f0-b07a-2aecf27a74d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:36:55.709186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8890dcc-4f3a-46f0-b07a-2aecf27a74d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:36:55.710200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: WARNING py.warnings [None req-c8890dcc-4f3a-46f0-b07a-2aecf27a74d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:36:55.710200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: warnings.warn(msg) Sep 17 04:36:55.710200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: Sep 17 04:36:55.711145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8890dcc-4f3a-46f0-b07a-2aecf27a74d5 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:36:55.722440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 752/1496] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:36:55.730735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7789f1-ecdd-4898-b71a-52aa0f1e9481 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:36:55.739818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7789f1-ecdd-4898-b71a-52aa0f1e9481 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:36:55.744368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b656e-bf5d-44e3-ab4f-4e559354ea9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:36:55.744955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b656e-bf5d-44e3-ab4f-4e559354ea9f admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:55.745259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b656e-bf5d-44e3-ab4f-4e559354ea9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:55.745526 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b656e-bf5d-44e3-ab4f-4e559354ea9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:55.746149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b656e-bf5d-44e3-ab4f-4e559354ea9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:36:55.747878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-ac9b656e-bf5d-44e3-ab4f-4e559354ea9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:36:55.747878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: warnings.warn(msg) Sep 17 04:36:55.747878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: Sep 17 04:36:55.749083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b656e-bf5d-44e3-ab4f-4e559354ea9f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:36:55.841651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 745/1497] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:36:55 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:36:55.846008 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8890dcc-4f3a-46f0-b07a-2aecf27a74d5 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:36:55.856023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8890dcc-4f3a-46f0-b07a-2aecf27a74d5 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:36:55.907135 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:36:55.913969 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a18e34-a0a1-47d5-ae70-3327aa67042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:36:55.914583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18e34-a0a1-47d5-ae70-3327aa67042a admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:55.914867 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18e34-a0a1-47d5-ae70-3327aa67042a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:55.915132 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18e34-a0a1-47d5-ae70-3327aa67042a admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:55.915786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a18e34-a0a1-47d5-ae70-3327aa67042a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:36:55.916824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: WARNING py.warnings [None req-d2a18e34-a0a1-47d5-ae70-3327aa67042a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:36:55.916824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: warnings.warn(msg) Sep 17 04:36:55.916824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: Sep 17 04:36:55.923523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a18e34-a0a1-47d5-ae70-3327aa67042a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:36:56.007402 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 753/1498] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:36:55 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:36:56.011607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b656e-bf5d-44e3-ab4f-4e559354ea9f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:36:56.022169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b656e-bf5d-44e3-ab4f-4e559354ea9f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:36:56.026940 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79640cc-4bbc-4299-ba8c-df4f56d0f73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:36:56.027526 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79640cc-4bbc-4299-ba8c-df4f56d0f73d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:56.027802 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79640cc-4bbc-4299-ba8c-df4f56d0f73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:56.028074 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79640cc-4bbc-4299-ba8c-df4f56d0f73d admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:56.028711 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79640cc-4bbc-4299-ba8c-df4f56d0f73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:36:56.029759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-b79640cc-4bbc-4299-ba8c-df4f56d0f73d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:36:56.029759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: warnings.warn(msg) Sep 17 04:36:56.029759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: Sep 17 04:36:56.030638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79640cc-4bbc-4299-ba8c-df4f56d0f73d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:36:56.043749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 746/1499] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:36:56.047758 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a18e34-a0a1-47d5-ae70-3327aa67042a admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:36:56.058035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a18e34-a0a1-47d5-ae70-3327aa67042a admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:36:56.062606 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4cb2e-cb00-473f-b0cf-4899453880ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:36:56.063197 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4cb2e-cb00-473f-b0cf-4899453880ec admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:56.063473 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4cb2e-cb00-473f-b0cf-4899453880ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:56.063743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4cb2e-cb00-473f-b0cf-4899453880ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:56.064381 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4cb2e-cb00-473f-b0cf-4899453880ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:36:56.065456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: WARNING py.warnings [None req-12d4cb2e-cb00-473f-b0cf-4899453880ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:36:56.065456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: warnings.warn(msg) Sep 17 04:36:56.065456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: Sep 17 04:36:56.066985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4cb2e-cb00-473f-b0cf-4899453880ec admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:36:56.080294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 754/1500] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:36:56.084424 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79640cc-4bbc-4299-ba8c-df4f56d0f73d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:36:56.094187 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79640cc-4bbc-4299-ba8c-df4f56d0f73d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:36:56.098762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5a9bf-bdf2-482f-80be-58dc0cb87f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:36:56.099393 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5a9bf-bdf2-482f-80be-58dc0cb87f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:56.099667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5a9bf-bdf2-482f-80be-58dc0cb87f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:56.099935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5a9bf-bdf2-482f-80be-58dc0cb87f15 admin admin] PATH_INFO: `/v3/projects/df7c49ec9bdd4252ae2e457c9e15536e/users/731b947710d14223af0cb964d698ebe1/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:56.114469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5a9bf-bdf2-482f-80be-58dc0cb87f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7c49ec9bdd4252ae2e457c9e15536e, user_id=731b947710d14223af0cb964d698ebe1, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:36:56.115771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-1ca5a9bf-bdf2-482f-80be-58dc0cb87f15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:36:56.115771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: warnings.warn(msg) Sep 17 04:36:56.115771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: Sep 17 04:36:56.117749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5a9bf-bdf2-482f-80be-58dc0cb87f15 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:36:56.215647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 747/1501] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:36:56 2022] PUT /identity/v3/projects/df7c49ec9bdd4252ae2e457c9e15536e/users/731b947710d14223af0cb964d698ebe1/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:36:56.228532 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784432a-e348-4aaa-aa7a-b50625656bb3 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:56.228834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784432a-e348-4aaa-aa7a-b50625656bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:56.229145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784432a-e348-4aaa-aa7a-b50625656bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:56.258760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-1784432a-e348-4aaa-aa7a-b50625656bb3 None None] MFA Rules not processed for user `731b947710d14223af0cb964d698ebe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:36:56.259893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1784432a-e348-4aaa-aa7a-b50625656bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:36:56.322892 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 755/1502] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:36:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:36:56.336357 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c19a0-0f4f-400b-b0b7-6ae0f5a04a98 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:56.336641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c19a0-0f4f-400b-b0b7-6ae0f5a04a98 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:56.336917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c19a0-0f4f-400b-b0b7-6ae0f5a04a98 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:56.338291 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 748/1503] 10.222.0.50 () {54 vars in 964 bytes} [Sat Sep 17 04:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:36:56.343026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb4c7e-0c1d-4724-9e67-d0b966b48495 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:56.343312 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb4c7e-0c1d-4724-9e67-d0b966b48495 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:56.343589 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb4c7e-0c1d-4724-9e67-d0b966b48495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:56.402134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c8cb4c7e-0c1d-4724-9e67-d0b966b48495 None None] MFA Rules not processed for user `60f50529feb44143b0627131d9aab8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:36:56.403326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c8cb4c7e-0c1d-4724-9e67-d0b966b48495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:36:56.476277 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 756/1504] 10.222.0.50 () {58 vars in 1061 bytes} [Sat Sep 17 04:36:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:36:56.484018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c19a0-0f4f-400b-b0b7-6ae0f5a04a98 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:36:56.495588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c19a0-0f4f-400b-b0b7-6ae0f5a04a98 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:36:56.499209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c53eec-52be-4624-8ffd-44a5d55689d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:36:56.499808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c53eec-52be-4624-8ffd-44a5d55689d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:56.500087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c53eec-52be-4624-8ffd-44a5d55689d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:56.500358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c53eec-52be-4624-8ffd-44a5d55689d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:56.509075 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c53eec-52be-4624-8ffd-44a5d55689d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:36:56.510433 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c53eec-52be-4624-8ffd-44a5d55689d8 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:36:56.519049 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 749/1505] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:36:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:36:56.572375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a4a46-f914-4777-b1c7-04a0e65c50a3 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:56.572653 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a4a46-f914-4777-b1c7-04a0e65c50a3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:56.573197 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a4a46-f914-4777-b1c7-04a0e65c50a3 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:56.574444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 757/1506] 10.222.0.50 () {52 vars in 830 bytes} [Sat Sep 17 04:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:36:56.578102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c53eec-52be-4624-8ffd-44a5d55689d8 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:36:56.639614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c53eec-52be-4624-8ffd-44a5d55689d8 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:36:56.644161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:36:56.644765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:56.645062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:56.645335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] PATH_INFO: `/v3/users/731b947710d14223af0cb964d698ebe1` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:56.646450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=731b947710d14223af0cb964d698ebe1)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:36:56.647447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:36:56.647447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: warnings.warn(msg) Sep 17 04:36:56.647447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: Sep 17 04:36:56.648633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:36:56.833491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '731b947710d14223af0cb964d698ebe1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:36:56.849705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '731b947710d14223af0cb964d698ebe1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:36:56.872355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '731b947710d14223af0cb964d698ebe1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:36:56.876797 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:36:56.978081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '731b947710d14223af0cb964d698ebe1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:36:56.978816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '731b947710d14223af0cb964d698ebe1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:36:56.985215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 750/1507] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:36:56 2022] DELETE /identity/v3/users/731b947710d14223af0cb964d698ebe1 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:36:56.990371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8616b-4d05-45d9-b405-afe9f1d7df29 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:56.990660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8616b-4d05-45d9-b405-afe9f1d7df29 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:56.990936 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8616b-4d05-45d9-b405-afe9f1d7df29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:57.010706 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-d4c8616b-4d05-45d9-b405-afe9f1d7df29 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:36:57.011349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d4c8616b-4d05-45d9-b405-afe9f1d7df29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:36:57.021831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:36:57.072537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 758/1508] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:36:57.083447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:36:57.084910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:36:57.164011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ec840-615a-479d-a2f5-a51656ac1dee admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:36:57.167702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4d9b9-50c7-46fd-9160-dd6eaca0b48c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:36:57.168304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4d9b9-50c7-46fd-9160-dd6eaca0b48c service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:57.168579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4d9b9-50c7-46fd-9160-dd6eaca0b48c service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:57.168846 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4d9b9-50c7-46fd-9160-dd6eaca0b48c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:57.177926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4d9b9-50c7-46fd-9160-dd6eaca0b48c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:36:57.179367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4d9b9-50c7-46fd-9160-dd6eaca0b48c service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:36:57.188655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 751/1509] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:36:57.717582 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8616b-4d05-45d9-b405-afe9f1d7df29 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:36:57.719146 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d4c8616b-4d05-45d9-b405-afe9f1d7df29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:36:57.731331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8616b-4d05-45d9-b405-afe9f1d7df29 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:36:57.736152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00f48a-7c34-40b6-9329-341fbd082049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:36:57.736786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f48a-7c34-40b6-9329-341fbd082049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:36:57.737101 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f48a-7c34-40b6-9329-341fbd082049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:36:57.737381 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f48a-7c34-40b6-9329-341fbd082049 admin admin] PATH_INFO: `/v3/projects/df7c49ec9bdd4252ae2e457c9e15536e` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:36:57.739229 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00f48a-7c34-40b6-9329-341fbd082049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7c49ec9bdd4252ae2e457c9e15536e)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:36:57.740402 dv-cinder-857993-2-smb devstack@keystone.service[81614]: WARNING py.warnings [None req-ca00f48a-7c34-40b6-9329-341fbd082049 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:36:57.740402 dv-cinder-857993-2-smb devstack@keystone.service[81614]: warnings.warn(msg) Sep 17 04:36:57.740402 dv-cinder-857993-2-smb devstack@keystone.service[81614]: Sep 17 04:36:57.741660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00f48a-7c34-40b6-9329-341fbd082049 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:36:57.893248 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ca00f48a-7c34-40b6-9329-341fbd082049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7c49ec9bdd4252ae2e457c9e15536e', 'request_id': 'req-ca00f48a-7c34-40b6-9329-341fbd082049'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:36:57.910488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ca00f48a-7c34-40b6-9329-341fbd082049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7c49ec9bdd4252ae2e457c9e15536e', 'request_id': 'req-ca00f48a-7c34-40b6-9329-341fbd082049'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:36:58.001020 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ca00f48a-7c34-40b6-9329-341fbd082049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7c49ec9bdd4252ae2e457c9e15536e', 'request_id': 'req-ca00f48a-7c34-40b6-9329-341fbd082049'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:36:58.012634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ca00f48a-7c34-40b6-9329-341fbd082049 admin admin] The token cache is being invalidate because project df7c49ec9bdd4252ae2e457c9e15536e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:36:58.012918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ca00f48a-7c34-40b6-9329-341fbd082049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:36:58.013662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ca00f48a-7c34-40b6-9329-341fbd082049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:36:58.015151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 759/1510] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:36:57 2022] DELETE /identity/v3/projects/df7c49ec9bdd4252ae2e457c9e15536e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:37:07.184490 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:37:08.009461 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:38:30.406486 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfb7cb-acc3-4fad-8668-698b2ea466c9 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:30.407077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfb7cb-acc3-4fad-8668-698b2ea466c9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:30.407077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfb7cb-acc3-4fad-8668-698b2ea466c9 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:30.408372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 04:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:38:30.413311 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b75b7-df30-458f-9f7e-fe90653d5b26 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:30.413722 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b75b7-df30-458f-9f7e-fe90653d5b26 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:30.413849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b75b7-df30-458f-9f7e-fe90653d5b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:30.434088 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-159b75b7-df30-458f-9f7e-fe90653d5b26 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:38:30.435292 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-159b75b7-df30-458f-9f7e-fe90653d5b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:38:30.495048 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 04:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:38:30.650776 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfb7cb-acc3-4fad-8668-698b2ea466c9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:38:30.652483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7edfb7cb-acc3-4fad-8668-698b2ea466c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:38:30.753390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfb7cb-acc3-4fad-8668-698b2ea466c9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:38:30.758909 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f404a0-8965-451e-8148-bd2b96e8d925 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:38:30.759514 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f404a0-8965-451e-8148-bd2b96e8d925 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:30.759790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f404a0-8965-451e-8148-bd2b96e8d925 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:30.760060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f404a0-8965-451e-8148-bd2b96e8d925 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:30.768617 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f404a0-8965-451e-8148-bd2b96e8d925 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:38:30.770233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f404a0-8965-451e-8148-bd2b96e8d925 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:38:30.779385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 753/1513] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:38:31.860163 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a877329-e7cf-451f-9b75-b6034adeaf95 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:31.860699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a877329-e7cf-451f-9b75-b6034adeaf95 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:31.860822 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a877329-e7cf-451f-9b75-b6034adeaf95 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:31.862164 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 04:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:38:31.868362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e10993-a681-4324-8631-ce5c919bff86 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:31.868810 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e10993-a681-4324-8631-ce5c919bff86 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:31.868911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e10993-a681-4324-8631-ce5c919bff86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:31.888152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-48e10993-a681-4324-8631-ce5c919bff86 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:38:31.889483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-48e10993-a681-4324-8631-ce5c919bff86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:38:31.897233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 04:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:38:32.049948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a877329-e7cf-451f-9b75-b6034adeaf95 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:38:32.064236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a877329-e7cf-451f-9b75-b6034adeaf95 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:38:32.070182 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b189550-5e2d-49dd-b949-6e867a568dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:38:32.070770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b189550-5e2d-49dd-b949-6e867a568dd3 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:32.071046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b189550-5e2d-49dd-b949-6e867a568dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:32.071342 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b189550-5e2d-49dd-b949-6e867a568dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:32.081212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b189550-5e2d-49dd-b949-6e867a568dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:38:32.082813 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b189550-5e2d-49dd-b949-6e867a568dd3 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:38:32.092167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 762/1516] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:38:32.654129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae91463-9529-4a17-a76b-84f78631f088 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:32.654406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae91463-9529-4a17-a76b-84f78631f088 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:32.654699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae91463-9529-4a17-a76b-84f78631f088 None None] PATH_INFO: `/v3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:32.656116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 755/1517] 10.222.0.61 () {54 vars in 925 bytes} [Sat Sep 17 04:38:32 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:38:32.662185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8f8e6-a7ae-481b-929a-9e87183d7b6c None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:32.662472 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8f8e6-a7ae-481b-929a-9e87183d7b6c None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:32.662746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8f8e6-a7ae-481b-929a-9e87183d7b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:32.712518 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-f6a8f8e6-a7ae-481b-929a-9e87183d7b6c None None] MFA Rules not processed for user `931a947711a2468baaeef701bbee60c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:38:32.713761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f6a8f8e6-a7ae-481b-929a-9e87183d7b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:38:32.784111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 763/1518] 10.222.0.61 () {58 vars in 1015 bytes} [Sat Sep 17 04:38:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:38:36.578633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2267029-fd8b-48d6-89ae-caaca723ea4f None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:36.579145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2267029-fd8b-48d6-89ae-caaca723ea4f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:36.579259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2267029-fd8b-48d6-89ae-caaca723ea4f None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:36.580511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 756/1519] 10.222.0.50 () {54 vars in 961 bytes} [Sat Sep 17 04:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:38:36.585445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf633-79ef-41d8-9a57-c6aa2b236dc2 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:36.585883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf633-79ef-41d8-9a57-c6aa2b236dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:36.586009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf633-79ef-41d8-9a57-c6aa2b236dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:36.605945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-d2faf633-79ef-41d8-9a57-c6aa2b236dc2 None None] MFA Rules not processed for user `931a947711a2468baaeef701bbee60c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:38:36.607127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d2faf633-79ef-41d8-9a57-c6aa2b236dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:38:36.615682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 764/1520] 10.222.0.50 () {58 vars in 1058 bytes} [Sat Sep 17 04:38:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:38:36.623144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2267029-fd8b-48d6-89ae-caaca723ea4f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:38:36.636385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2267029-fd8b-48d6-89ae-caaca723ea4f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:38:36.641804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb978b1-0bc1-4fc2-91e4-3049f4d551ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931a947711a2468baaeef701bbee60c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:38:36.642386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb978b1-0bc1-4fc2-91e4-3049f4d551ad service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:36.642665 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb978b1-0bc1-4fc2-91e4-3049f4d551ad service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:36.642931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb978b1-0bc1-4fc2-91e4-3049f4d551ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:36.650933 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb978b1-0bc1-4fc2-91e4-3049f4d551ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:38:36.652497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb978b1-0bc1-4fc2-91e4-3049f4d551ad service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:38:36.662623 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 757/1521] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:38:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:38:43.609106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0392a-6ba3-4e9e-93f0-f05e397c210c None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:43.609640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0392a-6ba3-4e9e-93f0-f05e397c210c None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:43.609640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0392a-6ba3-4e9e-93f0-f05e397c210c None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:43.611010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 04:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:38:43.617340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b7583-0405-4633-a797-73c72e4d0e39 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:43.617771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b7583-0405-4633-a797-73c72e4d0e39 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:43.617865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b7583-0405-4633-a797-73c72e4d0e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:43.636983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2c4b7583-0405-4633-a797-73c72e4d0e39 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:38:43.638201 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2c4b7583-0405-4633-a797-73c72e4d0e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:38:43.646643 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 04:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:38:43.801948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0392a-6ba3-4e9e-93f0-f05e397c210c None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:38:43.816299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0392a-6ba3-4e9e-93f0-f05e397c210c None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:38:43.823331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5c8ac-f7b1-4078-b75a-6ea2a8bb7959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:38:43.823331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5c8ac-f7b1-4078-b75a-6ea2a8bb7959 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:43.823331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5c8ac-f7b1-4078-b75a-6ea2a8bb7959 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:43.823331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5c8ac-f7b1-4078-b75a-6ea2a8bb7959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:43.831721 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5c8ac-f7b1-4078-b75a-6ea2a8bb7959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:38:43.833338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5c8ac-f7b1-4078-b75a-6ea2a8bb7959 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:38:43.843151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 766/1524] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:38:44.925280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7e929-56e7-4e8f-a164-63fecc9f8ce7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:44.925859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7e929-56e7-4e8f-a164-63fecc9f8ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:44.925859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7e929-56e7-4e8f-a164-63fecc9f8ce7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:44.927188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 04:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:38:44.933601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15864423-ca97-448f-850e-6101956775a7 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:44.934153 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15864423-ca97-448f-850e-6101956775a7 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:44.934427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15864423-ca97-448f-850e-6101956775a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:44.957461 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-15864423-ca97-448f-850e-6101956775a7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:38:44.958639 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-15864423-ca97-448f-850e-6101956775a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:38:44.966329 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 04:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:38:45.119359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7e929-56e7-4e8f-a164-63fecc9f8ce7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:38:45.133404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7e929-56e7-4e8f-a164-63fecc9f8ce7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:38:45.138768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16951e3-1cf2-4e99-bc56-ccb94f33c5d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:38:45.139964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16951e3-1cf2-4e99-bc56-ccb94f33c5d6 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:45.140238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16951e3-1cf2-4e99-bc56-ccb94f33c5d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:45.140506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16951e3-1cf2-4e99-bc56-ccb94f33c5d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:45.148413 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16951e3-1cf2-4e99-bc56-ccb94f33c5d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:38:45.150030 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16951e3-1cf2-4e99-bc56-ccb94f33c5d6 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:38:45.160478 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 760/1527] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:38:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:38:49.105540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164933-9987-4092-b182-8622ba2cfa6c None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:49.106031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164933-9987-4092-b182-8622ba2cfa6c None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:49.106125 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164933-9987-4092-b182-8622ba2cfa6c None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:49.107443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:38:49.112740 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb3a8-aed4-4da2-b4c7-c59d4fece712 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:49.113212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb3a8-aed4-4da2-b4c7-c59d4fece712 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:49.113316 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb3a8-aed4-4da2-b4c7-c59d4fece712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:49.132350 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8d5bb3a8-aed4-4da2-b4c7-c59d4fece712 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:38:49.133551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8d5bb3a8-aed4-4da2-b4c7-c59d4fece712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:38:49.141930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:38:49.432289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164933-9987-4092-b182-8622ba2cfa6c None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:38:49.434041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b3164933-9987-4092-b182-8622ba2cfa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:38:49.463141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:38:49.491274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164933-9987-4092-b182-8622ba2cfa6c None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:38:49.494779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895f498-0172-4c07-8ddf-acbfdc388495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:38:49.495377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895f498-0172-4c07-8ddf-acbfdc388495 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:49.495649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895f498-0172-4c07-8ddf-acbfdc388495 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:49.495926 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895f498-0172-4c07-8ddf-acbfdc388495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:49.505573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895f498-0172-4c07-8ddf-acbfdc388495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:38:49.506994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895f498-0172-4c07-8ddf-acbfdc388495 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:38:49.516851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 769/1530] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:38:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:38:51.694269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddcc27-00d7-4216-a026-ee41c1d98e23 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:51.694837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddcc27-00d7-4216-a026-ee41c1d98e23 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:51.694933 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddcc27-00d7-4216-a026-ee41c1d98e23 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:51.696264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:38:51.702080 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd724ce-8ca2-4c57-be64-4d2fbe144a80 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:51.702489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd724ce-8ca2-4c57-be64-4d2fbe144a80 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:51.702639 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd724ce-8ca2-4c57-be64-4d2fbe144a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:51.721860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-cdd724ce-8ca2-4c57-be64-4d2fbe144a80 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:38:51.723045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-cdd724ce-8ca2-4c57-be64-4d2fbe144a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:38:51.730872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:38:52.019288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddcc27-00d7-4216-a026-ee41c1d98e23 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:38:52.030884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddcc27-00d7-4216-a026-ee41c1d98e23 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:38:52.034390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea5d8c-bb8b-444e-9bea-ce97f50bd911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:38:52.034983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea5d8c-bb8b-444e-9bea-ce97f50bd911 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:52.035261 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea5d8c-bb8b-444e-9bea-ce97f50bd911 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:52.035533 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea5d8c-bb8b-444e-9bea-ce97f50bd911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:52.044150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea5d8c-bb8b-444e-9bea-ce97f50bd911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:38:52.045799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea5d8c-bb8b-444e-9bea-ce97f50bd911 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:38:52.054977 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 763/1533] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:38:55.738773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab723a59-776b-4fb5-a076-751ed78b4a39 None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:55.739339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab723a59-776b-4fb5-a076-751ed78b4a39 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:55.739339 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab723a59-776b-4fb5-a076-751ed78b4a39 None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:55.740646 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:38:55.746037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43af69-5872-487f-aa69-fadb94424398 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:55.746434 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43af69-5872-487f-aa69-fadb94424398 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:55.746587 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43af69-5872-487f-aa69-fadb94424398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:55.766339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2d43af69-5872-487f-aa69-fadb94424398 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:38:55.775193 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2d43af69-5872-487f-aa69-fadb94424398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:38:55.775425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:38:56.086772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab723a59-776b-4fb5-a076-751ed78b4a39 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:38:56.088431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ab723a59-776b-4fb5-a076-751ed78b4a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:38:56.145531 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab723a59-776b-4fb5-a076-751ed78b4a39 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:38:56.149047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387037f-3961-41c9-bb25-dc44717f1bd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:38:56.149649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387037f-3961-41c9-bb25-dc44717f1bd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:56.149921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387037f-3961-41c9-bb25-dc44717f1bd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:56.150192 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387037f-3961-41c9-bb25-dc44717f1bd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:56.159299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387037f-3961-41c9-bb25-dc44717f1bd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:38:56.160734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387037f-3961-41c9-bb25-dc44717f1bd5 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:38:56.170120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 772/1536] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:38:58.289777 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971a238-6569-4823-894c-95760301fc9b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:58.290309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971a238-6569-4823-894c-95760301fc9b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:58.290309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971a238-6569-4823-894c-95760301fc9b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:58.291660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 04:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:38:58.297376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0705e26-7d12-4f4f-8836-c39b71fbbf5f None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:58.297784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0705e26-7d12-4f4f-8836-c39b71fbbf5f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:58.297924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0705e26-7d12-4f4f-8836-c39b71fbbf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:58.318231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-a0705e26-7d12-4f4f-8836-c39b71fbbf5f None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:38:58.319423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a0705e26-7d12-4f4f-8836-c39b71fbbf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:38:58.328337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 04:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:38:58.631917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971a238-6569-4823-894c-95760301fc9b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:38:58.633599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5971a238-6569-4823-894c-95760301fc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:38:58.641149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=77 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:38:58.646871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971a238-6569-4823-894c-95760301fc9b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:38:58.650352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec701c-2150-4e3b-bdad-eb8a058f31b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:38:58.652704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec701c-2150-4e3b-bdad-eb8a058f31b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:38:58.652704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec701c-2150-4e3b-bdad-eb8a058f31b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:38:58.652704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec701c-2150-4e3b-bdad-eb8a058f31b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:38:58.660113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec701c-2150-4e3b-bdad-eb8a058f31b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:38:58.661663 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec701c-2150-4e3b-bdad-eb8a058f31b6 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:38:58.672423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 766/1539] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:39:08.313093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=47 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:39:08.671135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:24.729819 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863baf62-f2c0-44b8-9966-72767a733158 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:24.730428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863baf62-f2c0-44b8-9966-72767a733158 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:24.730428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863baf62-f2c0-44b8-9966-72767a733158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:24.755449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-863baf62-f2c0-44b8-9966-72767a733158 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:24.756655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-863baf62-f2c0-44b8-9966-72767a733158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:24.770316 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 774/1540] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:24.779247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f76b6f-aab1-442e-a239-2964a296b708 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:24.779810 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f76b6f-aab1-442e-a239-2964a296b708 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:24.779810 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f76b6f-aab1-442e-a239-2964a296b708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:24.810134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-05f76b6f-aab1-442e-a239-2964a296b708 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:24.811359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-05f76b6f-aab1-442e-a239-2964a296b708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:24.819840 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 767/1541] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:24.824983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863baf62-f2c0-44b8-9966-72767a733158 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:24.835221 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863baf62-f2c0-44b8-9966-72767a733158 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:24.843207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e112c-aa24-49be-ad6e-7b1f54eaa1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:24.844057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e112c-aa24-49be-ad6e-7b1f54eaa1fa admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:24.844338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e112c-aa24-49be-ad6e-7b1f54eaa1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:24.844613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e112c-aa24-49be-ad6e-7b1f54eaa1fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:24.845291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e112c-aa24-49be-ad6e-7b1f54eaa1fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:40:24.845590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e112c-aa24-49be-ad6e-7b1f54eaa1fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:24.847188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e112c-aa24-49be-ad6e-7b1f54eaa1fa admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:24.865070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 775/1542] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:40:24.873635 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f76b6f-aab1-442e-a239-2964a296b708 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:24.883664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f76b6f-aab1-442e-a239-2964a296b708 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:24.891787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8812f-8370-4556-ac35-6a3ccf18d26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:24.892404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8812f-8370-4556-ac35-6a3ccf18d26e admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:24.892680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8812f-8370-4556-ac35-6a3ccf18d26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:24.892947 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8812f-8370-4556-ac35-6a3ccf18d26e admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:24.893634 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8812f-8370-4556-ac35-6a3ccf18d26e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:24.895533 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8812f-8370-4556-ac35-6a3ccf18d26e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:25.045158 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 768/1543] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:24 2022] POST /identity/v3/projects => generated 405 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:25.049304 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e112c-aa24-49be-ad6e-7b1f54eaa1fa admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:25.060737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e112c-aa24-49be-ad6e-7b1f54eaa1fa admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:25.138746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592482d-5370-42a8-ac55-89d165956497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:25.139363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592482d-5370-42a8-ac55-89d165956497 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.139644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592482d-5370-42a8-ac55-89d165956497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.139914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592482d-5370-42a8-ac55-89d165956497 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.140565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592482d-5370-42a8-ac55-89d165956497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:25.142660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592482d-5370-42a8-ac55-89d165956497 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:25.238484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 776/1544] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:25 2022] POST /identity/v3/users => generated 303 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:25.242800 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8812f-8370-4556-ac35-6a3ccf18d26e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:25.254412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8812f-8370-4556-ac35-6a3ccf18d26e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:25.262948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22ed1b-bac0-463c-b9bb-85d7e3ed7b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:25.263590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22ed1b-bac0-463c-b9bb-85d7e3ed7b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.263867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22ed1b-bac0-463c-b9bb-85d7e3ed7b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.264133 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22ed1b-bac0-463c-b9bb-85d7e3ed7b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.264788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22ed1b-bac0-463c-b9bb-85d7e3ed7b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:25.266523 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22ed1b-bac0-463c-b9bb-85d7e3ed7b9e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:25.279865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 769/1545] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:25.284526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592482d-5370-42a8-ac55-89d165956497 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:25.297333 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592482d-5370-42a8-ac55-89d165956497 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:25.307064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd661ba-9a6d-45f5-8952-2e33d14d31f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:25.307759 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd661ba-9a6d-45f5-8952-2e33d14d31f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.308045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd661ba-9a6d-45f5-8952-2e33d14d31f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.308319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd661ba-9a6d-45f5-8952-2e33d14d31f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.309436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd661ba-9a6d-45f5-8952-2e33d14d31f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:25.311155 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd661ba-9a6d-45f5-8952-2e33d14d31f0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:25.324529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 777/1546] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:25.330144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22ed1b-bac0-463c-b9bb-85d7e3ed7b9e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:25.346737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22ed1b-bac0-463c-b9bb-85d7e3ed7b9e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:25.348934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ce33c-b596-4cb4-a0bd-42605542e0b1 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.349245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ce33c-b596-4cb4-a0bd-42605542e0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.349514 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ce33c-b596-4cb4-a0bd-42605542e0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.365790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb93e1d-e822-4bfd-beff-f9ac5f521258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:25.366489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb93e1d-e822-4bfd-beff-f9ac5f521258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.366768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb93e1d-e822-4bfd-beff-f9ac5f521258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.367043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb93e1d-e822-4bfd-beff-f9ac5f521258 admin admin] PATH_INFO: `/v3/projects/ef26a92a70ec4a12bbd5850f9a96bf2c/users/6a106403967a4deeaadca448af72e6a7/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.406772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ff6ce33c-b596-4cb4-a0bd-42605542e0b1 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:25.408029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ff6ce33c-b596-4cb4-a0bd-42605542e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:25.417639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb93e1d-e822-4bfd-beff-f9ac5f521258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef26a92a70ec4a12bbd5850f9a96bf2c, user_id=6a106403967a4deeaadca448af72e6a7, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:25.420416 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb93e1d-e822-4bfd-beff-f9ac5f521258 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:25.430697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 778/1547] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:25.441412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047e759-7ac4-4979-bd9e-60d02b457b83 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.441710 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047e759-7ac4-4979-bd9e-60d02b457b83 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.441965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047e759-7ac4-4979-bd9e-60d02b457b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.474094 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-1047e759-7ac4-4979-bd9e-60d02b457b83 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:25.475318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1047e759-7ac4-4979-bd9e-60d02b457b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:25.491232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 779/1548] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:40:25.498942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 770/1549] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:25 2022] PUT /identity/v3/projects/ef26a92a70ec4a12bbd5850f9a96bf2c/users/6a106403967a4deeaadca448af72e6a7/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:25.503788 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047e759-7ac4-4979-bd9e-60d02b457b83 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:25.509724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047e759-7ac4-4979-bd9e-60d02b457b83 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:25.517692 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae23f0-77f8-4ea1-8386-d9d0aa68c5d9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.518026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae23f0-77f8-4ea1-8386-d9d0aa68c5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.518233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae23f0-77f8-4ea1-8386-d9d0aa68c5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.581310 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-37ae23f0-77f8-4ea1-8386-d9d0aa68c5d9 None None] MFA Rules not processed for user `6a106403967a4deeaadca448af72e6a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:25.582478 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-37ae23f0-77f8-4ea1-8386-d9d0aa68c5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:25.674095 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcf537-f03f-4c80-887e-7ccdf2315c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:25.674730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcf537-f03f-4c80-887e-7ccdf2315c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.675009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcf537-f03f-4c80-887e-7ccdf2315c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.675280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcf537-f03f-4c80-887e-7ccdf2315c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.675927 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcf537-f03f-4c80-887e-7ccdf2315c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:40:25.676231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcf537-f03f-4c80-887e-7ccdf2315c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:25.677865 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcf537-f03f-4c80-887e-7ccdf2315c08 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:25.703478 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 780/1550] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:40:25.705371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e48ff3-0839-4ce0-a5f6-e60b5ff9a79b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.705891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e48ff3-0839-4ce0-a5f6-e60b5ff9a79b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.706407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e48ff3-0839-4ce0-a5f6-e60b5ff9a79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.736946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-d7e48ff3-0839-4ce0-a5f6-e60b5ff9a79b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:25.740035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d7e48ff3-0839-4ce0-a5f6-e60b5ff9a79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:25.743483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 771/1551] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:40:25.745021 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812514b-6aae-492e-8a71-e0bd5003848d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.747082 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812514b-6aae-492e-8a71-e0bd5003848d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.748075 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812514b-6aae-492e-8a71-e0bd5003848d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.763603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 781/1552] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:25.764782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e48ff3-0839-4ce0-a5f6-e60b5ff9a79b None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:25.782483 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e48ff3-0839-4ce0-a5f6-e60b5ff9a79b None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:25.785041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7812514b-6aae-492e-8a71-e0bd5003848d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:25.786243 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7812514b-6aae-492e-8a71-e0bd5003848d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:25.787656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df98e0-d936-4fe6-827b-890416533952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:25.788264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df98e0-d936-4fe6-827b-890416533952 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.788542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df98e0-d936-4fe6-827b-890416533952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.788809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df98e0-d936-4fe6-827b-890416533952 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.789471 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df98e0-d936-4fe6-827b-890416533952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:25.791086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: WARNING py.warnings [None req-16df98e0-d936-4fe6-827b-890416533952 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:40:25.791086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: warnings.warn(msg) Sep 17 04:40:25.791086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: Sep 17 04:40:25.792278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df98e0-d936-4fe6-827b-890416533952 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:25.797132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 772/1553] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:25.797132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483809ea-615e-4c0e-905b-363df09bbdac None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.797132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483809ea-615e-4c0e-905b-363df09bbdac None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.797132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483809ea-615e-4c0e-905b-363df09bbdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.818214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-483809ea-615e-4c0e-905b-363df09bbdac None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:25.819549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-483809ea-615e-4c0e-905b-363df09bbdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:25.827648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 773/1554] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:25.828445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483809ea-615e-4c0e-905b-363df09bbdac None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:25.838998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483809ea-615e-4c0e-905b-363df09bbdac None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:25.843493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c807979-4045-4ccb-8c3b-45daa3ca1a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:25.844078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807979-4045-4ccb-8c3b-45daa3ca1a13 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.844353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807979-4045-4ccb-8c3b-45daa3ca1a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.844623 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807979-4045-4ccb-8c3b-45daa3ca1a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.845279 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c807979-4045-4ccb-8c3b-45daa3ca1a13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:25.847168 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c807979-4045-4ccb-8c3b-45daa3ca1a13 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:25.916502 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 782/1555] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:25 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:25.917868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1076b-e0f0-4b84-9583-dd9d76b643c7 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.918139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1076b-e0f0-4b84-9583-dd9d76b643c7 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.918457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1076b-e0f0-4b84-9583-dd9d76b643c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.937719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-d4b1076b-e0f0-4b84-9583-dd9d76b643c7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:25.938935 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d4b1076b-e0f0-4b84-9583-dd9d76b643c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:25.944581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:25.950979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 774/1556] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:25 2022] POST /identity/v3/projects => generated 405 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:25.955614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35714a7-3c9a-4b11-8a64-c89b76aa3612 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:25.955614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35714a7-3c9a-4b11-8a64-c89b76aa3612 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:25.955614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35714a7-3c9a-4b11-8a64-c89b76aa3612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:25.972946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a35714a7-3c9a-4b11-8a64-c89b76aa3612 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:25.974174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a35714a7-3c9a-4b11-8a64-c89b76aa3612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:25.999742 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 783/1557] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:26.001155 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d550d-02af-43d0-bd4e-a61c91cf3d55 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.001445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d550d-02af-43d0-bd4e-a61c91cf3d55 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.001718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d550d-02af-43d0-bd4e-a61c91cf3d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.020718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:26.021617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-4b9d550d-02af-43d0-bd4e-a61c91cf3d55 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:26.022807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-4b9d550d-02af-43d0-bd4e-a61c91cf3d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:26.035429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 775/1558] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:26.036733 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10385b6a-5e56-426f-93ab-c86bb6a0233d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.037036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10385b6a-5e56-426f-93ab-c86bb6a0233d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.037323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10385b6a-5e56-426f-93ab-c86bb6a0233d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.058048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-10385b6a-5e56-426f-93ab-c86bb6a0233d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:26.059505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-10385b6a-5e56-426f-93ab-c86bb6a0233d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:26.067196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 776/1559] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:26.072075 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7429035-ec5c-42e0-88e7-eaa059806488 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.072358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7429035-ec5c-42e0-88e7-eaa059806488 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.072630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7429035-ec5c-42e0-88e7-eaa059806488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.085247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 784/1560] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:26.086571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddb0dc-004c-492e-aef5-d71459adca32 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.086868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddb0dc-004c-492e-aef5-d71459adca32 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.087158 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddb0dc-004c-492e-aef5-d71459adca32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.092525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e7429035-ec5c-42e0-88e7-eaa059806488 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:26.093928 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e7429035-ec5c-42e0-88e7-eaa059806488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:26.102229 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 777/1561] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:26.103692 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7429035-ec5c-42e0-88e7-eaa059806488 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.108169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c7ddb0dc-004c-492e-aef5-d71459adca32 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:26.109382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c7ddb0dc-004c-492e-aef5-d71459adca32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:26.114330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7429035-ec5c-42e0-88e7-eaa059806488 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.117615 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 785/1562] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:26.118373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddb0dc-004c-492e-aef5-d71459adca32 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.122964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b133c1-5366-41ff-8b3b-46bc56c7153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.123565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b133c1-5366-41ff-8b3b-46bc56c7153c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.123841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b133c1-5366-41ff-8b3b-46bc56c7153c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.124106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b133c1-5366-41ff-8b3b-46bc56c7153c admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.124731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b133c1-5366-41ff-8b3b-46bc56c7153c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.125771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-b5b133c1-5366-41ff-8b3b-46bc56c7153c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:40:26.125771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: warnings.warn(msg) Sep 17 04:40:26.125771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: Sep 17 04:40:26.126972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b133c1-5366-41ff-8b3b-46bc56c7153c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.128405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddb0dc-004c-492e-aef5-d71459adca32 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.133073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e921fc6-0168-42fb-ab10-a69d715d50b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.133655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921fc6-0168-42fb-ab10-a69d715d50b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.133983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921fc6-0168-42fb-ab10-a69d715d50b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.134247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921fc6-0168-42fb-ab10-a69d715d50b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.134899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e921fc6-0168-42fb-ab10-a69d715d50b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.137058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e921fc6-0168-42fb-ab10-a69d715d50b9 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.230916 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 778/1563] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:26.231738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b133c1-5366-41ff-8b3b-46bc56c7153c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.243002 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b133c1-5366-41ff-8b3b-46bc56c7153c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.248804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be469dc8-ba97-405c-873d-0ca19496d078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.249439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be469dc8-ba97-405c-873d-0ca19496d078 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.249740 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be469dc8-ba97-405c-873d-0ca19496d078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.250008 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be469dc8-ba97-405c-873d-0ca19496d078 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.250793 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be469dc8-ba97-405c-873d-0ca19496d078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:40:26.251096 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be469dc8-ba97-405c-873d-0ca19496d078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-be469dc8-ba97-405c-873d-0ca19496d078 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:40:26.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: warnings.warn(msg) Sep 17 04:40:26.252239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: Sep 17 04:40:26.253116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 786/1564] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/users => generated 309 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:26.258546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be469dc8-ba97-405c-873d-0ca19496d078 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.258661 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2f61c-44f3-4c30-bde8-6ef20af68fd1 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.258661 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2f61c-44f3-4c30-bde8-6ef20af68fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.258661 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2f61c-44f3-4c30-bde8-6ef20af68fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.266823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 779/1565] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:40:26.267654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be469dc8-ba97-405c-873d-0ca19496d078 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.276064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-9cc2f61c-44f3-4c30-bde8-6ef20af68fd1 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:26.277299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9cc2f61c-44f3-4c30-bde8-6ef20af68fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:26.278639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be469dc8-ba97-405c-873d-0ca19496d078 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.283269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c1238-69d9-4785-8b32-bb1edda24554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.283856 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c1238-69d9-4785-8b32-bb1edda24554 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.284133 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c1238-69d9-4785-8b32-bb1edda24554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.284404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c1238-69d9-4785-8b32-bb1edda24554 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.285083 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 787/1566] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:26.285203 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c1238-69d9-4785-8b32-bb1edda24554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:40:26.285398 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c1238-69d9-4785-8b32-bb1edda24554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.286258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a907e2-5248-44fb-8217-afc767245d70 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.286534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a907e2-5248-44fb-8217-afc767245d70 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.286804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a907e2-5248-44fb-8217-afc767245d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.286983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c1238-69d9-4785-8b32-bb1edda24554 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.299576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 780/1567] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:40:26.300796 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a764-d718-4a3a-9b52-297a7e050e2b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.301114 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a764-d718-4a3a-9b52-297a7e050e2b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.301389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a764-d718-4a3a-9b52-297a7e050e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.307545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-55a907e2-5248-44fb-8217-afc767245d70 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:26.309123 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-55a907e2-5248-44fb-8217-afc767245d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:26.316902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 788/1568] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:26.317694 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a907e2-5248-44fb-8217-afc767245d70 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.320591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-43e8a764-d718-4a3a-9b52-297a7e050e2b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:26.321604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-43e8a764-d718-4a3a-9b52-297a7e050e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:26.326995 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a907e2-5248-44fb-8217-afc767245d70 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.329465 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 781/1569] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:26.330858 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a764-d718-4a3a-9b52-297a7e050e2b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.331649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db0d15-8fff-4adc-930e-7f20f0063710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.332232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db0d15-8fff-4adc-930e-7f20f0063710 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.332508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db0d15-8fff-4adc-930e-7f20f0063710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.332772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db0d15-8fff-4adc-930e-7f20f0063710 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.333436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db0d15-8fff-4adc-930e-7f20f0063710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:40:26.333733 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db0d15-8fff-4adc-930e-7f20f0063710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.335313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db0d15-8fff-4adc-930e-7f20f0063710 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.341345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a764-d718-4a3a-9b52-297a7e050e2b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.347294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8f51d-1fd0-41ac-be49-1a970fc772cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.347817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8f51d-1fd0-41ac-be49-1a970fc772cf admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.347939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 789/1570] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:40:26.348092 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8f51d-1fd0-41ac-be49-1a970fc772cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.348361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8f51d-1fd0-41ac-be49-1a970fc772cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.348607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db0d15-8fff-4adc-930e-7f20f0063710 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.349100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8f51d-1fd0-41ac-be49-1a970fc772cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.350628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8f51d-1fd0-41ac-be49-1a970fc772cf admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.358948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db0d15-8fff-4adc-930e-7f20f0063710 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.362212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 782/1571] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:26.362933 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8f51d-1fd0-41ac-be49-1a970fc772cf admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.366105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cbc56-42a8-467d-8c26-29f2308944b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.366698 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cbc56-42a8-467d-8c26-29f2308944b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.366973 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cbc56-42a8-467d-8c26-29f2308944b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.367241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cbc56-42a8-467d-8c26-29f2308944b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.367890 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cbc56-42a8-467d-8c26-29f2308944b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.369694 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cbc56-42a8-467d-8c26-29f2308944b7 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.373932 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8f51d-1fd0-41ac-be49-1a970fc772cf admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.378493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36c782-b224-49b9-9186-e4dfd1b7ead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.379060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36c782-b224-49b9-9186-e4dfd1b7ead0 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.379334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36c782-b224-49b9-9186-e4dfd1b7ead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.379601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36c782-b224-49b9-9186-e4dfd1b7ead0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.380063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 790/1572] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:26.380218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36c782-b224-49b9-9186-e4dfd1b7ead0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.381874 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cbc56-42a8-467d-8c26-29f2308944b7 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.382119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36c782-b224-49b9-9186-e4dfd1b7ead0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.391850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cbc56-42a8-467d-8c26-29f2308944b7 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.396409 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36d7c6-0bf7-4064-95f0-a7701fb330e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.397009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36d7c6-0bf7-4064-95f0-a7701fb330e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.397292 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36d7c6-0bf7-4064-95f0-a7701fb330e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.397558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36d7c6-0bf7-4064-95f0-a7701fb330e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.398182 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36d7c6-0bf7-4064-95f0-a7701fb330e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:40:26.398480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36d7c6-0bf7-4064-95f0-a7701fb330e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.401301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36d7c6-0bf7-4064-95f0-a7701fb330e5 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.412777 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 791/1573] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:40:26.413652 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36d7c6-0bf7-4064-95f0-a7701fb330e5 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.425465 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36d7c6-0bf7-4064-95f0-a7701fb330e5 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.430087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60639b8-8217-48d3-b56b-99b94a6ea619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.430652 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60639b8-8217-48d3-b56b-99b94a6ea619 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.430958 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60639b8-8217-48d3-b56b-99b94a6ea619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.431388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60639b8-8217-48d3-b56b-99b94a6ea619 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.432002 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60639b8-8217-48d3-b56b-99b94a6ea619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.434207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60639b8-8217-48d3-b56b-99b94a6ea619 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.483100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 783/1574] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:26.484032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36c782-b224-49b9-9186-e4dfd1b7ead0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.500871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 792/1575] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:26.500871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60639b8-8217-48d3-b56b-99b94a6ea619 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.520130 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:26.548023 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36c782-b224-49b9-9186-e4dfd1b7ead0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.569258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60639b8-8217-48d3-b56b-99b94a6ea619 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.574224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb1805-0cac-462f-9de7-9c35d5cd576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.574832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb1805-0cac-462f-9de7-9c35d5cd576b admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.575110 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb1805-0cac-462f-9de7-9c35d5cd576b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.575380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb1805-0cac-462f-9de7-9c35d5cd576b admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.576013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb1805-0cac-462f-9de7-9c35d5cd576b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:40:26.576314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb1805-0cac-462f-9de7-9c35d5cd576b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.577985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb1805-0cac-462f-9de7-9c35d5cd576b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.590259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 793/1576] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:40:26.591200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb1805-0cac-462f-9de7-9c35d5cd576b admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.601203 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb1805-0cac-462f-9de7-9c35d5cd576b admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.606222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce847d-dec1-4c38-b4cd-173a333dff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.606813 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce847d-dec1-4c38-b4cd-173a333dff7f admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.607087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce847d-dec1-4c38-b4cd-173a333dff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.607355 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce847d-dec1-4c38-b4cd-173a333dff7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.608486 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980c6d1-727c-4df0-b753-9e6f9fd4a853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.608893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce847d-dec1-4c38-b4cd-173a333dff7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.609144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980c6d1-727c-4df0-b753-9e6f9fd4a853 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.609453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980c6d1-727c-4df0-b753-9e6f9fd4a853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.609724 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980c6d1-727c-4df0-b753-9e6f9fd4a853 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.610366 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980c6d1-727c-4df0-b753-9e6f9fd4a853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:40:26.610672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980c6d1-727c-4df0-b753-9e6f9fd4a853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.610852 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce847d-dec1-4c38-b4cd-173a333dff7f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.612289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980c6d1-727c-4df0-b753-9e6f9fd4a853 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.614902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:26.625857 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 784/1577] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:40:26.625857 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980c6d1-727c-4df0-b753-9e6f9fd4a853 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.641341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980c6d1-727c-4df0-b753-9e6f9fd4a853 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.646149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf3755-0e6f-4ec0-9d1d-85403d7be84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.646770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf3755-0e6f-4ec0-9d1d-85403d7be84e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.647044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf3755-0e6f-4ec0-9d1d-85403d7be84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.647312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf3755-0e6f-4ec0-9d1d-85403d7be84e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.648028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf3755-0e6f-4ec0-9d1d-85403d7be84e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.649744 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf3755-0e6f-4ec0-9d1d-85403d7be84e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.660391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 785/1578] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:26.664971 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf3755-0e6f-4ec0-9d1d-85403d7be84e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.671477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf3755-0e6f-4ec0-9d1d-85403d7be84e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.676061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab5b7c-c4d9-4419-951f-cc360fe702cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.676679 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab5b7c-c4d9-4419-951f-cc360fe702cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.676955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab5b7c-c4d9-4419-951f-cc360fe702cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.677268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab5b7c-c4d9-4419-951f-cc360fe702cd admin admin] PATH_INFO: `/v3/projects/e5b0a7e2110a44b6873443b6337d3c14/users/bfee9d0a5b464af28714de4a9cd7504d/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.692756 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab5b7c-c4d9-4419-951f-cc360fe702cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b0a7e2110a44b6873443b6337d3c14, user_id=bfee9d0a5b464af28714de4a9cd7504d, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.695430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab5b7c-c4d9-4419-951f-cc360fe702cd admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.728699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 794/1579] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/projects => generated 389 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:26.729708 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce847d-dec1-4c38-b4cd-173a333dff7f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.789687 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce847d-dec1-4c38-b4cd-173a333dff7f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.794958 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb026f4f-4d08-4f63-9896-d7037325477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.795551 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb026f4f-4d08-4f63-9896-d7037325477b admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.795826 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb026f4f-4d08-4f63-9896-d7037325477b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.796094 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb026f4f-4d08-4f63-9896-d7037325477b admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.796716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb026f4f-4d08-4f63-9896-d7037325477b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.798720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb026f4f-4d08-4f63-9896-d7037325477b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.813566 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 786/1580] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:26 2022] PUT /identity/v3/projects/e5b0a7e2110a44b6873443b6337d3c14/users/bfee9d0a5b464af28714de4a9cd7504d/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:26.814176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab5b7c-c4d9-4419-951f-cc360fe702cd admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.874575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab5b7c-c4d9-4419-951f-cc360fe702cd admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.879148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71beab8a-8f84-4509-b934-9c8bd1722c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.879747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beab8a-8f84-4509-b934-9c8bd1722c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.890198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beab8a-8f84-4509-b934-9c8bd1722c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.890198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beab8a-8f84-4509-b934-9c8bd1722c5b admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.890198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71beab8a-8f84-4509-b934-9c8bd1722c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.890579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 795/1581] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:26.890682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71beab8a-8f84-4509-b934-9c8bd1722c5b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.890777 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb026f4f-4d08-4f63-9896-d7037325477b admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:26.948378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb026f4f-4d08-4f63-9896-d7037325477b admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:26.952906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d032b-d7cc-4556-bd83-cb7083767ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:26.953645 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d032b-d7cc-4556-bd83-cb7083767ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:26.953922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d032b-d7cc-4556-bd83-cb7083767ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:26.954192 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d032b-d7cc-4556-bd83-cb7083767ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:26.954812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d032b-d7cc-4556-bd83-cb7083767ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:26.956712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d032b-d7cc-4556-bd83-cb7083767ca8 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:26.989451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 787/1582] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:26.990260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71beab8a-8f84-4509-b934-9c8bd1722c5b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.000690 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71beab8a-8f84-4509-b934-9c8bd1722c5b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.005609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3728e57-9b6c-480e-bacf-37e8528c4ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.006188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3728e57-9b6c-480e-bacf-37e8528c4ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.006462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3728e57-9b6c-480e-bacf-37e8528c4ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.006729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3728e57-9b6c-480e-bacf-37e8528c4ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.007345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3728e57-9b6c-480e-bacf-37e8528c4ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.009332 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3728e57-9b6c-480e-bacf-37e8528c4ea5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.069516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 796/1583] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:27.070467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d032b-d7cc-4556-bd83-cb7083767ca8 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.075420 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:27.080789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d032b-d7cc-4556-bd83-cb7083767ca8 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.085404 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643adce-123f-4f04-bdd9-41b709598d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.085975 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643adce-123f-4f04-bdd9-41b709598d80 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.086251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643adce-123f-4f04-bdd9-41b709598d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.086521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643adce-123f-4f04-bdd9-41b709598d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.087682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643adce-123f-4f04-bdd9-41b709598d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.089828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643adce-123f-4f04-bdd9-41b709598d80 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.112232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 788/1584] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:26 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:27.113055 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3728e57-9b6c-480e-bacf-37e8528c4ea5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.168567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 797/1585] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:27 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:27.169898 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643adce-123f-4f04-bdd9-41b709598d80 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.177385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3728e57-9b6c-480e-bacf-37e8528c4ea5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.209968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:27.233407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643adce-123f-4f04-bdd9-41b709598d80 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.234336 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fa9c6-52ec-4f14-99b9-c6ace09fe2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.234992 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fa9c6-52ec-4f14-99b9-c6ace09fe2ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.235304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fa9c6-52ec-4f14-99b9-c6ace09fe2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.235579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fa9c6-52ec-4f14-99b9-c6ace09fe2ab admin admin] PATH_INFO: `/v3/projects/9ab08ceadcea48d5984d92b129bc7775/users/f29dce2bfd7a4553900e92acf531dd68/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.238158 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210e119-dc26-4064-a799-22e60b8115aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.238771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210e119-dc26-4064-a799-22e60b8115aa admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.239269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210e119-dc26-4064-a799-22e60b8115aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.239792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210e119-dc26-4064-a799-22e60b8115aa admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.240759 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210e119-dc26-4064-a799-22e60b8115aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.242727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210e119-dc26-4064-a799-22e60b8115aa admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.250997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fa9c6-52ec-4f14-99b9-c6ace09fe2ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab08ceadcea48d5984d92b129bc7775, user_id=f29dce2bfd7a4553900e92acf531dd68, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.257174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fa9c6-52ec-4f14-99b9-c6ace09fe2ab admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.375983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 798/1586] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:27 2022] POST /identity/v3/users => generated 295 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:27.375983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210e119-dc26-4064-a799-22e60b8115aa admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.384069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210e119-dc26-4064-a799-22e60b8115aa admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.388688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610095f-d4c4-4162-a9f7-ff82fe35c935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.389293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610095f-d4c4-4162-a9f7-ff82fe35c935 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.389571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610095f-d4c4-4162-a9f7-ff82fe35c935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.389842 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610095f-d4c4-4162-a9f7-ff82fe35c935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.390470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610095f-d4c4-4162-a9f7-ff82fe35c935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.392064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610095f-d4c4-4162-a9f7-ff82fe35c935 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.401044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 789/1587] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:27 2022] PUT /identity/v3/projects/9ab08ceadcea48d5984d92b129bc7775/users/f29dce2bfd7a4553900e92acf531dd68/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:27.409573 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fa9c6-52ec-4f14-99b9-c6ace09fe2ab admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.409720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 799/1588] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:27.409720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610095f-d4c4-4162-a9f7-ff82fe35c935 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.413643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610095f-d4c4-4162-a9f7-ff82fe35c935 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.471040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fa9c6-52ec-4f14-99b9-c6ace09fe2ab admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.472245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d0dbc-ddfd-445f-91f0-0d5ea5eb7340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.472853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d0dbc-ddfd-445f-91f0-0d5ea5eb7340 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.473159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d0dbc-ddfd-445f-91f0-0d5ea5eb7340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.473430 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d0dbc-ddfd-445f-91f0-0d5ea5eb7340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.474060 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d0dbc-ddfd-445f-91f0-0d5ea5eb7340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.475650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d0dbc-ddfd-445f-91f0-0d5ea5eb7340 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.475855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f796b-4a7d-44e3-8978-03f5b761dd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.476456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f796b-4a7d-44e3-8978-03f5b761dd47 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.476741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f796b-4a7d-44e3-8978-03f5b761dd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.477100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f796b-4a7d-44e3-8978-03f5b761dd47 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.477759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f796b-4a7d-44e3-8978-03f5b761dd47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.479653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f796b-4a7d-44e3-8978-03f5b761dd47 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.488320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 800/1589] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:27.489370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d0dbc-ddfd-445f-91f0-0d5ea5eb7340 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.499321 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d0dbc-ddfd-445f-91f0-0d5ea5eb7340 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.503947 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749f761-1f52-40fb-9c83-e2ceb2f22f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.504525 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749f761-1f52-40fb-9c83-e2ceb2f22f1c admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.504798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749f761-1f52-40fb-9c83-e2ceb2f22f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.505097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749f761-1f52-40fb-9c83-e2ceb2f22f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.505727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749f761-1f52-40fb-9c83-e2ceb2f22f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.507307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749f761-1f52-40fb-9c83-e2ceb2f22f1c admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.519044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 801/1590] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:27.519793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749f761-1f52-40fb-9c83-e2ceb2f22f1c admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.529513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749f761-1f52-40fb-9c83-e2ceb2f22f1c admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.534049 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59c0d5-6532-45bc-b066-6899272c47d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.534597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59c0d5-6532-45bc-b066-6899272c47d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.534870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59c0d5-6532-45bc-b066-6899272c47d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.535139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59c0d5-6532-45bc-b066-6899272c47d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.535740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59c0d5-6532-45bc-b066-6899272c47d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.537609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59c0d5-6532-45bc-b066-6899272c47d0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.566368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 790/1591] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:27 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:27.567183 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f796b-4a7d-44e3-8978-03f5b761dd47 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.577294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f796b-4a7d-44e3-8978-03f5b761dd47 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.581866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bb88c-3d62-4398-a78d-4c30860c47c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.582433 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bb88c-3d62-4398-a78d-4c30860c47c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.582710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bb88c-3d62-4398-a78d-4c30860c47c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.582976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bb88c-3d62-4398-a78d-4c30860c47c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.583586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bb88c-3d62-4398-a78d-4c30860c47c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.585557 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bb88c-3d62-4398-a78d-4c30860c47c8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.656289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 802/1592] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:27 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:27.656289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59c0d5-6532-45bc-b066-6899272c47d0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.664282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59c0d5-6532-45bc-b066-6899272c47d0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.669121 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b8e93-fed7-4e91-9e53-4f762476c878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.669709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b8e93-fed7-4e91-9e53-4f762476c878 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.669987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b8e93-fed7-4e91-9e53-4f762476c878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.670258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b8e93-fed7-4e91-9e53-4f762476c878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.670893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b8e93-fed7-4e91-9e53-4f762476c878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.672510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b8e93-fed7-4e91-9e53-4f762476c878 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.682596 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 803/1593] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:27.684131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedec6cb-19b1-493e-8d85-dfb060d3dbc4 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.684414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedec6cb-19b1-493e-8d85-dfb060d3dbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.684692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedec6cb-19b1-493e-8d85-dfb060d3dbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.693604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 791/1594] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:27 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:27.694594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bb88c-3d62-4398-a78d-4c30860c47c8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.705695 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-fedec6cb-19b1-493e-8d85-dfb060d3dbc4 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:27.706122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bb88c-3d62-4398-a78d-4c30860c47c8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.706928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-fedec6cb-19b1-493e-8d85-dfb060d3dbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:27.710840 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960077c-d242-48d5-a950-909206abfa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.711498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960077c-d242-48d5-a950-909206abfa73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.711774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960077c-d242-48d5-a950-909206abfa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.712737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960077c-d242-48d5-a950-909206abfa73 admin admin] PATH_INFO: `/v3/projects/e5b0a7e2110a44b6873443b6337d3c14/users/bfee9d0a5b464af28714de4a9cd7504d/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.714848 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960077c-d242-48d5-a950-909206abfa73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b0a7e2110a44b6873443b6337d3c14, user_id=bfee9d0a5b464af28714de4a9cd7504d, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.715460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 804/1595] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:27.716343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedec6cb-19b1-493e-8d85-dfb060d3dbc4 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.717525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960077c-d242-48d5-a950-909206abfa73 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.726556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedec6cb-19b1-493e-8d85-dfb060d3dbc4 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.729953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 792/1596] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:27 2022] PUT /identity/v3/projects/e5b0a7e2110a44b6873443b6337d3c14/users/bfee9d0a5b464af28714de4a9cd7504d/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:27.730624 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960077c-d242-48d5-a950-909206abfa73 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.732250 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:27.784550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db20cae-bcfc-484c-8285-f1810819fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.785189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db20cae-bcfc-484c-8285-f1810819fd3b admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.785493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db20cae-bcfc-484c-8285-f1810819fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.785762 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db20cae-bcfc-484c-8285-f1810819fd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.786396 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db20cae-bcfc-484c-8285-f1810819fd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.788125 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db20cae-bcfc-484c-8285-f1810819fd3b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.798400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 805/1597] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:27.799218 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db20cae-bcfc-484c-8285-f1810819fd3b admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.803218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960077c-d242-48d5-a950-909206abfa73 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.808962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f535f6-6e45-4f36-a399-e60fc048ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.809584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f535f6-6e45-4f36-a399-e60fc048ba91 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.809716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db20cae-bcfc-484c-8285-f1810819fd3b admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.809857 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f535f6-6e45-4f36-a399-e60fc048ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.810124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f535f6-6e45-4f36-a399-e60fc048ba91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.810759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f535f6-6e45-4f36-a399-e60fc048ba91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.812347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f535f6-6e45-4f36-a399-e60fc048ba91 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.814278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369a1f9-aa4a-488c-9ce4-a883c2e41621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.814871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a1f9-aa4a-488c-9ce4-a883c2e41621 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.815151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a1f9-aa4a-488c-9ce4-a883c2e41621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.815427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a1f9-aa4a-488c-9ce4-a883c2e41621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.816063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369a1f9-aa4a-488c-9ce4-a883c2e41621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.817694 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369a1f9-aa4a-488c-9ce4-a883c2e41621 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.822900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 793/1598] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:27.823608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f535f6-6e45-4f36-a399-e60fc048ba91 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.829111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 806/1599] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:27.830135 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369a1f9-aa4a-488c-9ce4-a883c2e41621 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.836641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f535f6-6e45-4f36-a399-e60fc048ba91 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.839850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369a1f9-aa4a-488c-9ce4-a883c2e41621 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.841470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836624b6-e9e2-4f71-9623-42c46394e40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.842217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836624b6-e9e2-4f71-9623-42c46394e40e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.842494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836624b6-e9e2-4f71-9623-42c46394e40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.842758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836624b6-e9e2-4f71-9623-42c46394e40e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.843385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836624b6-e9e2-4f71-9623-42c46394e40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.844470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fa774-9010-4b69-9074-8b6c691687a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.844956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836624b6-e9e2-4f71-9623-42c46394e40e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.845149 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fa774-9010-4b69-9074-8b6c691687a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.845447 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fa774-9010-4b69-9074-8b6c691687a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.845956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fa774-9010-4b69-9074-8b6c691687a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.847708 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fa774-9010-4b69-9074-8b6c691687a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.849326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fa774-9010-4b69-9074-8b6c691687a6 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.855144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 794/1600] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:27.855934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836624b6-e9e2-4f71-9623-42c46394e40e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.860618 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:27.861052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 807/1601] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:27.861860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fa774-9010-4b69-9074-8b6c691687a6 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.866564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836624b6-e9e2-4f71-9623-42c46394e40e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.871994 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20a5b4-555b-417e-b580-acc79e4761a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.873843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20a5b4-555b-417e-b580-acc79e4761a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.873843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20a5b4-555b-417e-b580-acc79e4761a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.873843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20a5b4-555b-417e-b580-acc79e4761a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.874231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20a5b4-555b-417e-b580-acc79e4761a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.875809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20a5b4-555b-417e-b580-acc79e4761a4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.887181 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 795/1602] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:27.888537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07003570-f674-4147-9cb7-818d98f01364 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.888821 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07003570-f674-4147-9cb7-818d98f01364 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.889157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07003570-f674-4147-9cb7-818d98f01364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.916824 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-07003570-f674-4147-9cb7-818d98f01364 None None] MFA Rules not processed for user `bfee9d0a5b464af28714de4a9cd7504d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:27.918014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-07003570-f674-4147-9cb7-818d98f01364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:27.919818 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fa774-9010-4b69-9074-8b6c691687a6 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.923552 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f8365-e7c9-4431-8c5e-90b6e0e6b5c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.924162 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f8365-e7c9-4431-8c5e-90b6e0e6b5c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.924437 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f8365-e7c9-4431-8c5e-90b6e0e6b5c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.924727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f8365-e7c9-4431-8c5e-90b6e0e6b5c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.934935 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f8365-e7c9-4431-8c5e-90b6e0e6b5c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.936357 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f8365-e7c9-4431-8c5e-90b6e0e6b5c9 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.945854 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 808/1603] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:27.947473 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f8365-e7c9-4431-8c5e-90b6e0e6b5c9 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:27.957224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f8365-e7c9-4431-8c5e-90b6e0e6b5c9 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:27.963245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdb553-ee5d-4eb3-bc22-8f1bd1908f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:27.963908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdb553-ee5d-4eb3-bc22-8f1bd1908f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:27.964526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdb553-ee5d-4eb3-bc22-8f1bd1908f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:27.964836 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdb553-ee5d-4eb3-bc22-8f1bd1908f7f admin admin] PATH_INFO: `/v3/projects/7695f8f817e74e14926fd522e17dac0f/users/cd6794d95e994d2e955fdd1d3e95d476/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:27.980163 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdb553-ee5d-4eb3-bc22-8f1bd1908f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7695f8f817e74e14926fd522e17dac0f, user_id=cd6794d95e994d2e955fdd1d3e95d476, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:27.989262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: WARNING py.warnings [None req-8cbdb553-ee5d-4eb3-bc22-8f1bd1908f7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:40:27.989262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: warnings.warn(msg) Sep 17 04:40:27.989262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: Sep 17 04:40:27.989262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdb553-ee5d-4eb3-bc22-8f1bd1908f7f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:27.989735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 796/1604] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:27 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:27.990125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07003570-f674-4147-9cb7-818d98f01364 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:28.000278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07003570-f674-4147-9cb7-818d98f01364 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:28.004927 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e45d4-6376-4a3e-8637-f39362791666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:28.005812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e45d4-6376-4a3e-8637-f39362791666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:28.006087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e45d4-6376-4a3e-8637-f39362791666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:28.006357 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e45d4-6376-4a3e-8637-f39362791666 admin admin] PATH_INFO: `/v3/projects/d7114c6162164a3d983522844cb34903/users/03bc9d741ab74302a72c634447cdf74f/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:28.021553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e45d4-6376-4a3e-8637-f39362791666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7114c6162164a3d983522844cb34903, user_id=03bc9d741ab74302a72c634447cdf74f, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:28.024488 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e45d4-6376-4a3e-8637-f39362791666 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:28.064713 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 809/1605] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:27 2022] PUT /identity/v3/projects/7695f8f817e74e14926fd522e17dac0f/users/cd6794d95e994d2e955fdd1d3e95d476/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:28.069885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdb553-ee5d-4eb3-bc22-8f1bd1908f7f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:28.127831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 797/1606] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:27 2022] PUT /identity/v3/projects/d7114c6162164a3d983522844cb34903/users/03bc9d741ab74302a72c634447cdf74f/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:28.129033 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e45d4-6376-4a3e-8637-f39362791666 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:28.137474 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdb553-ee5d-4eb3-bc22-8f1bd1908f7f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:28.138011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:28.192404 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a36613-2ea1-4a63-b2f1-13d9bedbb9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:28.192944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a36613-2ea1-4a63-b2f1-13d9bedbb9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:28.193251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a36613-2ea1-4a63-b2f1-13d9bedbb9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:28.193605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a36613-2ea1-4a63-b2f1-13d9bedbb9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:28.194299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a36613-2ea1-4a63-b2f1-13d9bedbb9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:28.195889 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a36613-2ea1-4a63-b2f1-13d9bedbb9a0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:28.198140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e45d4-6376-4a3e-8637-f39362791666 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:28.202548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef002c9-2dad-4577-9374-ffc5e50dd699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:28.203179 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef002c9-2dad-4577-9374-ffc5e50dd699 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:28.203515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef002c9-2dad-4577-9374-ffc5e50dd699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:28.203729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef002c9-2dad-4577-9374-ffc5e50dd699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:28.204365 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef002c9-2dad-4577-9374-ffc5e50dd699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:28.206119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 810/1607] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:28.207437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef002c9-2dad-4577-9374-ffc5e50dd699 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:28.207556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a36613-2ea1-4a63-b2f1-13d9bedbb9a0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:28.216233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 798/1608] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:28.216885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef002c9-2dad-4577-9374-ffc5e50dd699 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:28.220534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a36613-2ea1-4a63-b2f1-13d9bedbb9a0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:28.226472 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef002c9-2dad-4577-9374-ffc5e50dd699 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:28.231924 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026b7de-6404-4f80-b943-9229b8d15674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:28.232526 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026b7de-6404-4f80-b943-9229b8d15674 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:28.232807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026b7de-6404-4f80-b943-9229b8d15674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:28.233111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026b7de-6404-4f80-b943-9229b8d15674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:28.233647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bde2a-113d-4a6a-8856-cc9027bdc338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:28.233799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026b7de-6404-4f80-b943-9229b8d15674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:28.234366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bde2a-113d-4a6a-8856-cc9027bdc338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:28.234640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bde2a-113d-4a6a-8856-cc9027bdc338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:28.234911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bde2a-113d-4a6a-8856-cc9027bdc338 admin admin] PATH_INFO: `/v3/projects/97a5a5fe7ded4421b43e435975a4dc3c/users/811bb431ddbb42638f909ebf6d921536/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:28.235414 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026b7de-6404-4f80-b943-9229b8d15674 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:28.251644 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 799/1609] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:28.251644 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026b7de-6404-4f80-b943-9229b8d15674 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:28.253654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bde2a-113d-4a6a-8856-cc9027bdc338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a5a5fe7ded4421b43e435975a4dc3c, user_id=811bb431ddbb42638f909ebf6d921536, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:28.256530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bde2a-113d-4a6a-8856-cc9027bdc338 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:28.297585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:28.312888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026b7de-6404-4f80-b943-9229b8d15674 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:28.316609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0bd11-0837-4884-982f-f6a90deac231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:28.317261 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0bd11-0837-4884-982f-f6a90deac231 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:28.317543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0bd11-0837-4884-982f-f6a90deac231 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:28.317815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0bd11-0837-4884-982f-f6a90deac231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:28.350357 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 811/1610] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:28 2022] PUT /identity/v3/projects/97a5a5fe7ded4421b43e435975a4dc3c/users/811bb431ddbb42638f909ebf6d921536/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:28.351629 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5bff7-ab1b-480f-bd0f-dc172b72d13c None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:28.351920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5bff7-ab1b-480f-bd0f-dc172b72d13c None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:28.352324 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5bff7-ab1b-480f-bd0f-dc172b72d13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:28.381278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0bd11-0837-4884-982f-f6a90deac231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:28.381490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-eac5bff7-ab1b-480f-bd0f-dc172b72d13c None None] MFA Rules not processed for user `cd6794d95e994d2e955fdd1d3e95d476`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:28.382504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-eac5bff7-ab1b-480f-bd0f-dc172b72d13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:28.382823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0bd11-0837-4884-982f-f6a90deac231 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:28.392356 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 800/1611] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:28 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:28.394043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70264ac4-af87-491b-a6bc-55588d613e91 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:28.394373 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70264ac4-af87-491b-a6bc-55588d613e91 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:28.394652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70264ac4-af87-491b-a6bc-55588d613e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:28.425194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-70264ac4-af87-491b-a6bc-55588d613e91 None None] MFA Rules not processed for user `03bc9d741ab74302a72c634447cdf74f`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:28.426406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-70264ac4-af87-491b-a6bc-55588d613e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:28.460351 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 812/1612] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:28.461556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5bff7-ab1b-480f-bd0f-dc172b72d13c None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:28.518443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 801/1613] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:28.518443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70264ac4-af87-491b-a6bc-55588d613e91 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:28.590947 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5bff7-ab1b-480f-bd0f-dc172b72d13c None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:28.603243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7831f-a276-4e10-8eb2-7f2c18c20f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:28.607027 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7831f-a276-4e10-8eb2-7f2c18c20f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:28.607558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7831f-a276-4e10-8eb2-7f2c18c20f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:28.608496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7831f-a276-4e10-8eb2-7f2c18c20f86 admin admin] PATH_INFO: `/v3/projects/c90e000b02b3401ab9ae0b51510a4094/users/c70f2ce21e9b49ffb3564873e09397e0/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:28.616036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70264ac4-af87-491b-a6bc-55588d613e91 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:28.621253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134a2bf-4661-4ec6-ba22-7972c5564138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:28.622029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134a2bf-4661-4ec6-ba22-7972c5564138 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:28.622306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134a2bf-4661-4ec6-ba22-7972c5564138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:28.622582 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134a2bf-4661-4ec6-ba22-7972c5564138 admin admin] PATH_INFO: `/v3/projects/50c72c710b484460bd336a758347403c/users/ba60ba93ba064960b34c6c6c77e94e94/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:28.638792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7831f-a276-4e10-8eb2-7f2c18c20f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c90e000b02b3401ab9ae0b51510a4094, user_id=c70f2ce21e9b49ffb3564873e09397e0, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:28.640533 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134a2bf-4661-4ec6-ba22-7972c5564138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c72c710b484460bd336a758347403c, user_id=ba60ba93ba064960b34c6c6c77e94e94, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:28.641703 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7831f-a276-4e10-8eb2-7f2c18c20f86 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:28.643499 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134a2bf-4661-4ec6-ba22-7972c5564138 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:28.644103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:28.746137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:28.757559 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 802/1614] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:28 2022] PUT /identity/v3/projects/50c72c710b484460bd336a758347403c/users/ba60ba93ba064960b34c6c6c77e94e94/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:28.757787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 813/1615] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:28 2022] PUT /identity/v3/projects/c90e000b02b3401ab9ae0b51510a4094/users/c70f2ce21e9b49ffb3564873e09397e0/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:28.757787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9ebf5-f412-43a3-ae3b-a49a41ba3931 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:28.757787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9ebf5-f412-43a3-ae3b-a49a41ba3931 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:28.757787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9ebf5-f412-43a3-ae3b-a49a41ba3931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:28.758119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134a2bf-4661-4ec6-ba22-7972c5564138 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:28.777950 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-b6f9ebf5-f412-43a3-ae3b-a49a41ba3931 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:28.779242 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b6f9ebf5-f412-43a3-ae3b-a49a41ba3931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:28.831736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134a2bf-4661-4ec6-ba22-7972c5564138 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:28.848930 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 814/1616] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:28.848930 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9ebf5-f412-43a3-ae3b-a49a41ba3931 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:28.863608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9ebf5-f412-43a3-ae3b-a49a41ba3931 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:28.869408 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab47ee-38d1-46d6-b471-e7b0b4190c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:28.870024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab47ee-38d1-46d6-b471-e7b0b4190c86 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:28.870304 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab47ee-38d1-46d6-b471-e7b0b4190c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:28.870576 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab47ee-38d1-46d6-b471-e7b0b4190c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:28.871212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab47ee-38d1-46d6-b471-e7b0b4190c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:28.873174 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab47ee-38d1-46d6-b471-e7b0b4190c86 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:28.892932 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ece6e-92d9-4836-996c-bbd93d1cb43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:28.893627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ece6e-92d9-4836-996c-bbd93d1cb43e admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:28.893908 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ece6e-92d9-4836-996c-bbd93d1cb43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:28.894173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ece6e-92d9-4836-996c-bbd93d1cb43e admin admin] PATH_INFO: `/v3/projects/c47f0d04da5a4dada0af5e26f3365c98/users/da324489014b4ed7adb3529702cd5e78/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:28.910191 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ece6e-92d9-4836-996c-bbd93d1cb43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47f0d04da5a4dada0af5e26f3365c98, user_id=da324489014b4ed7adb3529702cd5e78, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:28.912830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ece6e-92d9-4836-996c-bbd93d1cb43e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:28.973536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 815/1617] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:28 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:28.974298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab47ee-38d1-46d6-b471-e7b0b4190c86 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:29.007445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 803/1618] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:28 2022] PUT /identity/v3/projects/c47f0d04da5a4dada0af5e26f3365c98/users/da324489014b4ed7adb3529702cd5e78/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:29.009330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ece6e-92d9-4836-996c-bbd93d1cb43e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:29.037859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab47ee-38d1-46d6-b471-e7b0b4190c86 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:29.083530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ece6e-92d9-4836-996c-bbd93d1cb43e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:29.090563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8826b-5f2a-4b36-8f19-bd4223b0e138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:29.091205 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8826b-5f2a-4b36-8f19-bd4223b0e138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.091551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8826b-5f2a-4b36-8f19-bd4223b0e138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.091824 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8826b-5f2a-4b36-8f19-bd4223b0e138 admin admin] PATH_INFO: `/v3/users/6a106403967a4deeaadca448af72e6a7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.093074 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8826b-5f2a-4b36-8f19-bd4223b0e138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a106403967a4deeaadca448af72e6a7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:29.095040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8826b-5f2a-4b36-8f19-bd4223b0e138 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:29.096417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b1bc8-2e5d-45bf-9ab7-00d2ebb8b83e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:29.097097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b1bc8-2e5d-45bf-9ab7-00d2ebb8b83e service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.097377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b1bc8-2e5d-45bf-9ab7-00d2ebb8b83e service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.097936 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b1bc8-2e5d-45bf-9ab7-00d2ebb8b83e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.139593 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:29.155014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b1bc8-2e5d-45bf-9ab7-00d2ebb8b83e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:29.156374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b1bc8-2e5d-45bf-9ab7-00d2ebb8b83e service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:29.165870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 816/1619] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:29.167117 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b416f8-c34f-4eef-8d96-7b0bf210cd67 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.167401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b416f8-c34f-4eef-8d96-7b0bf210cd67 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.167673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b416f8-c34f-4eef-8d96-7b0bf210cd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.186630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-21b416f8-c34f-4eef-8d96-7b0bf210cd67 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:29.187817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-21b416f8-c34f-4eef-8d96-7b0bf210cd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:29.195584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 817/1620] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:29.197301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de0088-7729-4c6b-bb60-5d3d7e205f1e None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.199387 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de0088-7729-4c6b-bb60-5d3d7e205f1e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.199387 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de0088-7729-4c6b-bb60-5d3d7e205f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.230872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c0de0088-7729-4c6b-bb60-5d3d7e205f1e None None] MFA Rules not processed for user `ba60ba93ba064960b34c6c6c77e94e94`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:29.230872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c0de0088-7729-4c6b-bb60-5d3d7e205f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:29.281837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:29.311364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 818/1621] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:29.311672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de0088-7729-4c6b-bb60-5d3d7e205f1e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:29.324326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35e8826b-5f2a-4b36-8f19-bd4223b0e138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a106403967a4deeaadca448af72e6a7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:29.348104 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35e8826b-5f2a-4b36-8f19-bd4223b0e138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a106403967a4deeaadca448af72e6a7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:29.373833 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35e8826b-5f2a-4b36-8f19-bd4223b0e138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a106403967a4deeaadca448af72e6a7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:29.397128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de0088-7729-4c6b-bb60-5d3d7e205f1e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:29.401655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e491c5-9e34-4ac1-b9a5-64bf08e9becf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:29.402266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e491c5-9e34-4ac1-b9a5-64bf08e9becf service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.402543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e491c5-9e34-4ac1-b9a5-64bf08e9becf service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.402816 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e491c5-9e34-4ac1-b9a5-64bf08e9becf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.413962 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e491c5-9e34-4ac1-b9a5-64bf08e9becf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:29.415466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e491c5-9e34-4ac1-b9a5-64bf08e9becf service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:29.426362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 819/1622] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:29.427262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e491c5-9e34-4ac1-b9a5-64bf08e9becf service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:29.436283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35e8826b-5f2a-4b36-8f19-bd4223b0e138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a106403967a4deeaadca448af72e6a7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:29.437557 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35e8826b-5f2a-4b36-8f19-bd4223b0e138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a106403967a4deeaadca448af72e6a7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:29.444588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 804/1623] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:40:29 2022] DELETE /identity/v3/users/6a106403967a4deeaadca448af72e6a7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:29.448958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f06ee5-6638-46b0-b797-fdda0f4f5032 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.451217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f06ee5-6638-46b0-b797-fdda0f4f5032 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.451524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f06ee5-6638-46b0-b797-fdda0f4f5032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.452574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e491c5-9e34-4ac1-b9a5-64bf08e9becf service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:29.478207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-59f06ee5-6638-46b0-b797-fdda0f4f5032 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:29.479712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-59f06ee5-6638-46b0-b797-fdda0f4f5032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:29.535344 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c28546-9b1d-4a77-91f2-cae0c0ff645e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:29.536040 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c28546-9b1d-4a77-91f2-cae0c0ff645e admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.536317 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c28546-9b1d-4a77-91f2-cae0c0ff645e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.536626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c28546-9b1d-4a77-91f2-cae0c0ff645e admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.537396 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c28546-9b1d-4a77-91f2-cae0c0ff645e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:29.541155 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c28546-9b1d-4a77-91f2-cae0c0ff645e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:29.566401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 805/1624] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:29.566401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f06ee5-6638-46b0-b797-fdda0f4f5032 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:29.566401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-59f06ee5-6638-46b0-b797-fdda0f4f5032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:29.625344 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f06ee5-6638-46b0-b797-fdda0f4f5032 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:29.629342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b2b4f-53b9-4c2a-9c29-2432b479825b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:29.635341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b2b4f-53b9-4c2a-9c29-2432b479825b service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.635341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b2b4f-53b9-4c2a-9c29-2432b479825b service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.635341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b2b4f-53b9-4c2a-9c29-2432b479825b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.635341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8b4b2b4f-53b9-4c2a-9c29-2432b479825b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:29.646304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b2b4f-53b9-4c2a-9c29-2432b479825b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:29.647885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b2b4f-53b9-4c2a-9c29-2432b479825b service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:29.663960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 806/1625] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:29.663960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6049f3-244d-4a71-b747-d2e7690fcbc9 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.663960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6049f3-244d-4a71-b747-d2e7690fcbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.663960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6049f3-244d-4a71-b747-d2e7690fcbc9 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.670428 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 807/1626] 10.222.0.50 () {54 vars in 965 bytes} [Sat Sep 17 04:40:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:40:29.671814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff402d87-701f-4460-be2f-52139c2735b4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.672169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff402d87-701f-4460-be2f-52139c2735b4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.672515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff402d87-701f-4460-be2f-52139c2735b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.706252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ff402d87-701f-4460-be2f-52139c2735b4 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:29.709065 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ff402d87-701f-4460-be2f-52139c2735b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:29.709905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:29.719448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 820/1627] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:29 2022] POST /identity/v3/users => generated 297 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:29.721150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c28546-9b1d-4a77-91f2-cae0c0ff645e admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:29.722364 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 808/1628] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:29.723887 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747513c9-1dea-4cef-a670-a8a3c02ee1e1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.724227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747513c9-1dea-4cef-a670-a8a3c02ee1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.727916 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747513c9-1dea-4cef-a670-a8a3c02ee1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.738500 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c28546-9b1d-4a77-91f2-cae0c0ff645e admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:29.742464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f375c7-8b03-4015-9380-b54ff6658f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:29.745201 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f375c7-8b03-4015-9380-b54ff6658f2d service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.745495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f375c7-8b03-4015-9380-b54ff6658f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.750504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f375c7-8b03-4015-9380-b54ff6658f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.755951 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f375c7-8b03-4015-9380-b54ff6658f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:29.757534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f375c7-8b03-4015-9380-b54ff6658f2d service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:29.781402 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 821/1629] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:29.782902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f375c7-8b03-4015-9380-b54ff6658f2d service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:29.790537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c2f375c7-8b03-4015-9380-b54ff6658f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:29.816107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-747513c9-1dea-4cef-a670-a8a3c02ee1e1 None None] MFA Rules not processed for user `eb70408fecfe41e0b2ea9a53c7ae0823`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:29.816107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-747513c9-1dea-4cef-a670-a8a3c02ee1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:29.816341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f375c7-8b03-4015-9380-b54ff6658f2d service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:29.821756 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d9ae3-c0b9-44e5-ac7b-36dd433bf888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:29.822584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d9ae3-c0b9-44e5-ac7b-36dd433bf888 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.822861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d9ae3-c0b9-44e5-ac7b-36dd433bf888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.823174 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d9ae3-c0b9-44e5-ac7b-36dd433bf888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.823833 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d9ae3-c0b9-44e5-ac7b-36dd433bf888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:29.826137 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d9ae3-c0b9-44e5-ac7b-36dd433bf888 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:29.847675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 822/1630] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:29.847675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d9ae3-c0b9-44e5-ac7b-36dd433bf888 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:29.848383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2e0d9ae3-c0b9-44e5-ac7b-36dd433bf888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:29.863498 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d9ae3-c0b9-44e5-ac7b-36dd433bf888 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:29.869275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93795af-b54e-4c04-a732-02bd039aacc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:29.870087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93795af-b54e-4c04-a732-02bd039aacc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.870599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93795af-b54e-4c04-a732-02bd039aacc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.871682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93795af-b54e-4c04-a732-02bd039aacc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.884252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93795af-b54e-4c04-a732-02bd039aacc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:29.886107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93795af-b54e-4c04-a732-02bd039aacc4 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:29.891533 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 809/1631] 10.222.0.50 () {58 vars in 1062 bytes} [Sat Sep 17 04:40:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:29.892428 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747513c9-1dea-4cef-a670-a8a3c02ee1e1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:29.911116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747513c9-1dea-4cef-a670-a8a3c02ee1e1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:29.916540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f833d2-f150-49fd-b214-869c1a8e2f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:29.917286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f833d2-f150-49fd-b214-869c1a8e2f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.917565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f833d2-f150-49fd-b214-869c1a8e2f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.917837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f833d2-f150-49fd-b214-869c1a8e2f96 admin admin] PATH_INFO: `/v3/projects/de844237a161446cafb2f36f3c160831/users/73185d654ef24bbfafe54fcef85597e9/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.920750 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 823/1632] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:29.922581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93795af-b54e-4c04-a732-02bd039aacc4 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:29.932157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:29.960066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93795af-b54e-4c04-a732-02bd039aacc4 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:29.967205 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f833d2-f150-49fd-b214-869c1a8e2f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de844237a161446cafb2f36f3c160831, user_id=73185d654ef24bbfafe54fcef85597e9, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:29.973471 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f833d2-f150-49fd-b214-869c1a8e2f96 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:29.979167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4279bfb-14ce-40b6-ab93-109994fd8f35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:29.979799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4279bfb-14ce-40b6-ab93-109994fd8f35 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:29.980084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4279bfb-14ce-40b6-ab93-109994fd8f35 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:29.980414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4279bfb-14ce-40b6-ab93-109994fd8f35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:29.989755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f4279bfb-14ce-40b6-ab93-109994fd8f35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:30.082310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4279bfb-14ce-40b6-ab93-109994fd8f35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:30.084807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4279bfb-14ce-40b6-ab93-109994fd8f35 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:30.103030 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 824/1633] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:30.109109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 810/1634] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:29 2022] PUT /identity/v3/projects/de844237a161446cafb2f36f3c160831/users/73185d654ef24bbfafe54fcef85597e9/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:30.112941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4279bfb-14ce-40b6-ab93-109994fd8f35 service nova] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:30.131532 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4279bfb-14ce-40b6-ab93-109994fd8f35 service nova] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:30.218353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf941-f1af-410b-a422-3e8dc01ed568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:30.223297 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf941-f1af-410b-a422-3e8dc01ed568 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:30.223297 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf941-f1af-410b-a422-3e8dc01ed568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:30.223297 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf941-f1af-410b-a422-3e8dc01ed568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:30.223297 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcf941-f1af-410b-a422-3e8dc01ed568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:30.223297 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcf941-f1af-410b-a422-3e8dc01ed568 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:30.256271 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 825/1635] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:30.262095 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f833d2-f150-49fd-b214-869c1a8e2f96 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:30.281891 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f833d2-f150-49fd-b214-869c1a8e2f96 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:30.287183 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceac357-02a7-4a86-9cb4-0bce23b19dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:30.287792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceac357-02a7-4a86-9cb4-0bce23b19dda admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:30.288187 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceac357-02a7-4a86-9cb4-0bce23b19dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:30.288553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceac357-02a7-4a86-9cb4-0bce23b19dda admin admin] PATH_INFO: `/v3/projects/de844237a161446cafb2f36f3c160831/users/73185d654ef24bbfafe54fcef85597e9/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:30.296896 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceac357-02a7-4a86-9cb4-0bce23b19dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=de844237a161446cafb2f36f3c160831, user_id=73185d654ef24bbfafe54fcef85597e9, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:30.299714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceac357-02a7-4a86-9cb4-0bce23b19dda admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:30.328689 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 811/1636] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:30 2022] PUT /identity/v3/projects/de844237a161446cafb2f36f3c160831/users/73185d654ef24bbfafe54fcef85597e9/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:30.338738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d370f5-beaf-438c-82fc-b3472f245505 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:30.339496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d370f5-beaf-438c-82fc-b3472f245505 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:30.339982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d370f5-beaf-438c-82fc-b3472f245505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:30.403040 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c4d370f5-beaf-438c-82fc-b3472f245505 None None] MFA Rules not processed for user `73185d654ef24bbfafe54fcef85597e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:30.406308 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c4d370f5-beaf-438c-82fc-b3472f245505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:30.619486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:30.620502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48971-8667-44a7-b467-1cd6b4603acf None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:30.620502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48971-8667-44a7-b467-1cd6b4603acf None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:30.620502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48971-8667-44a7-b467-1cd6b4603acf None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:30.620502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 812/1637] 10.222.0.50 () {54 vars in 912 bytes} [Sat Sep 17 04:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:40:30.620502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d45ca0-305a-4093-b909-ce49377cf337 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:30.620502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d45ca0-305a-4093-b909-ce49377cf337 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:30.622131 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d45ca0-305a-4093-b909-ce49377cf337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:30.622930 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 826/1638] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:30.625519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-61d45ca0-305a-4093-b909-ce49377cf337 None None] MFA Rules not processed for user `eb70408fecfe41e0b2ea9a53c7ae0823`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:30.625815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d370f5-beaf-438c-82fc-b3472f245505 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:30.625815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c4d370f5-beaf-438c-82fc-b3472f245505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:30.626449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-61d45ca0-305a-4093-b909-ce49377cf337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:30.707031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d370f5-beaf-438c-82fc-b3472f245505 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:30.721522 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 813/1639] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:40:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:30.734294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fcb9c-9f70-4e20-83e9-d6820509db97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:30.735264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fcb9c-9f70-4e20-83e9-d6820509db97 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:30.735699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fcb9c-9f70-4e20-83e9-d6820509db97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:30.736132 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fcb9c-9f70-4e20-83e9-d6820509db97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:30.752320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d45ca0-305a-4093-b909-ce49377cf337 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:30.755096 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-61d45ca0-305a-4093-b909-ce49377cf337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:30.776578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fcb9c-9f70-4e20-83e9-d6820509db97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:30.778643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fcb9c-9f70-4e20-83e9-d6820509db97 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:30.786206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d45ca0-305a-4093-b909-ce49377cf337 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:30.790942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e9d16-7a63-4b0d-9493-3d8c03bb9c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:30.791532 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 827/1640] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:40:30.797819 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9d16-7a63-4b0d-9493-3d8c03bb9c75 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:30.798546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9d16-7a63-4b0d-9493-3d8c03bb9c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:30.798911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9d16-7a63-4b0d-9493-3d8c03bb9c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:30.831800 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e9d16-7a63-4b0d-9493-3d8c03bb9c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:30.833667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e9d16-7a63-4b0d-9493-3d8c03bb9c75 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:30.846298 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 814/1641] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:31.233676 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fcb9c-9f70-4e20-83e9-d6820509db97 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:31.245088 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fcb9c-9f70-4e20-83e9-d6820509db97 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:31.251256 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de558dd2-6597-44d1-ab5d-09b18ee8a6e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:31.252341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de558dd2-6597-44d1-ab5d-09b18ee8a6e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:31.252341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de558dd2-6597-44d1-ab5d-09b18ee8a6e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:31.252519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de558dd2-6597-44d1-ab5d-09b18ee8a6e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:31.254377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-de558dd2-6597-44d1-ab5d-09b18ee8a6e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:31.358421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de558dd2-6597-44d1-ab5d-09b18ee8a6e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:31.359760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de558dd2-6597-44d1-ab5d-09b18ee8a6e0 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:31.397142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 828/1642] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:31.616166 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e9d16-7a63-4b0d-9493-3d8c03bb9c75 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:31.617649 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e78e9d16-7a63-4b0d-9493-3d8c03bb9c75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:31.822444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e9d16-7a63-4b0d-9493-3d8c03bb9c75 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:31.830388 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fefdaa-09da-492f-a9f1-5dc514acfba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:31.831041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fefdaa-09da-492f-a9f1-5dc514acfba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:31.831321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fefdaa-09da-492f-a9f1-5dc514acfba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:31.831591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fefdaa-09da-492f-a9f1-5dc514acfba8 admin admin] PATH_INFO: `/v3/projects/ef26a92a70ec4a12bbd5850f9a96bf2c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:31.834278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fefdaa-09da-492f-a9f1-5dc514acfba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef26a92a70ec4a12bbd5850f9a96bf2c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:31.837599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-03fefdaa-09da-492f-a9f1-5dc514acfba8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:40:31.837599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: warnings.warn(msg) Sep 17 04:40:31.837599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: Sep 17 04:40:31.839775 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fefdaa-09da-492f-a9f1-5dc514acfba8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:31.856234 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:32.012018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03fefdaa-09da-492f-a9f1-5dc514acfba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef26a92a70ec4a12bbd5850f9a96bf2c', 'request_id': 'req-03fefdaa-09da-492f-a9f1-5dc514acfba8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:32.026830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03fefdaa-09da-492f-a9f1-5dc514acfba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef26a92a70ec4a12bbd5850f9a96bf2c', 'request_id': 'req-03fefdaa-09da-492f-a9f1-5dc514acfba8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:32.033812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03fefdaa-09da-492f-a9f1-5dc514acfba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef26a92a70ec4a12bbd5850f9a96bf2c', 'request_id': 'req-03fefdaa-09da-492f-a9f1-5dc514acfba8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:32.203935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03fefdaa-09da-492f-a9f1-5dc514acfba8 admin admin] The token cache is being invalidate because project ef26a92a70ec4a12bbd5850f9a96bf2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:40:32.205544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03fefdaa-09da-492f-a9f1-5dc514acfba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:32.205956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03fefdaa-09da-492f-a9f1-5dc514acfba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:32.209434 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 815/1643] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:40:31 2022] DELETE /identity/v3/projects/ef26a92a70ec4a12bbd5850f9a96bf2c => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:32.215149 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de558dd2-6597-44d1-ab5d-09b18ee8a6e0 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:32.247608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de558dd2-6597-44d1-ab5d-09b18ee8a6e0 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:32.395565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:32.397590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:32.398429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:32.398747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] PATH_INFO: `/v3/users/bfee9d0a5b464af28714de4a9cd7504d` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:32.400765 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfee9d0a5b464af28714de4a9cd7504d)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:32.401908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: WARNING py.warnings [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 04:40:32.401908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: warnings.warn(msg) Sep 17 04:40:32.401908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: Sep 17 04:40:32.403254 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:32.487701 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:32.513433 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e20a8-4ea6-44bf-9fc6-ce8de38ace1c None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:32.513959 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e20a8-4ea6-44bf-9fc6-ce8de38ace1c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:32.514436 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e20a8-4ea6-44bf-9fc6-ce8de38ace1c None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:32.516167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 816/1644] 10.222.0.50 () {54 vars in 965 bytes} [Sat Sep 17 04:40:32 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:40:32.526306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa5ebc-004e-470e-8591-d097c3317527 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:32.527038 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa5ebc-004e-470e-8591-d097c3317527 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:32.527536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa5ebc-004e-470e-8591-d097c3317527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:32.549468 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d8fa5ebc-004e-470e-8591-d097c3317527 None None] MFA Rules not processed for user `eb70408fecfe41e0b2ea9a53c7ae0823`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:32.550863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d8fa5ebc-004e-470e-8591-d097c3317527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:32.654914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 817/1645] 10.222.0.50 () {58 vars in 1062 bytes} [Sat Sep 17 04:40:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:32.666664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe2d04-89c8-4663-a96e-6ff7df8005e0 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:32.668584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe2d04-89c8-4663-a96e-6ff7df8005e0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:32.669213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe2d04-89c8-4663-a96e-6ff7df8005e0 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:32.679957 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 818/1646] 10.222.0.50 () {54 vars in 912 bytes} [Sat Sep 17 04:40:32 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:40:32.683686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47997593-8a72-46a5-ae67-23699c2b8366 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:32.686306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47997593-8a72-46a5-ae67-23699c2b8366 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:32.686651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47997593-8a72-46a5-ae67-23699c2b8366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:32.692716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfee9d0a5b464af28714de4a9cd7504d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:32.719073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-47997593-8a72-46a5-ae67-23699c2b8366 None None] MFA Rules not processed for user `eb70408fecfe41e0b2ea9a53c7ae0823`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:32.720429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-47997593-8a72-46a5-ae67-23699c2b8366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:32.742081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 819/1647] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:40:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:32.748871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47997593-8a72-46a5-ae67-23699c2b8366 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:32.752247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-47997593-8a72-46a5-ae67-23699c2b8366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:32.811833 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfee9d0a5b464af28714de4a9cd7504d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:32.813389 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfee9d0a5b464af28714de4a9cd7504d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:32.835692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfee9d0a5b464af28714de4a9cd7504d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:32.871529 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47997593-8a72-46a5-ae67-23699c2b8366 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:32.878901 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab83f0e-f55d-4d79-aebc-4f236385ffbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:32.879630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfee9d0a5b464af28714de4a9cd7504d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:32.880083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab83f0e-f55d-4d79-aebc-4f236385ffbb service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:32.880542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab83f0e-f55d-4d79-aebc-4f236385ffbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:32.881064 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab83f0e-f55d-4d79-aebc-4f236385ffbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:32.883056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2ab83f0e-f55d-4d79-aebc-4f236385ffbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:32.890645 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 829/1648] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:40:32 2022] DELETE /identity/v3/users/bfee9d0a5b464af28714de4a9cd7504d => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:40:32.903664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab83f0e-f55d-4d79-aebc-4f236385ffbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:32.905259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab83f0e-f55d-4d79-aebc-4f236385ffbb service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:32.922823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 820/1649] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:33.902663 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:33.905957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:34.093279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cf275-1122-403f-b200-575d80103cb7 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:34.100186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aff96-c1a7-4474-abe9-210c7c63d7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:34.101125 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aff96-c1a7-4474-abe9-210c7c63d7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:34.101501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aff96-c1a7-4474-abe9-210c7c63d7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:34.101995 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aff96-c1a7-4474-abe9-210c7c63d7ac admin admin] PATH_INFO: `/v3/projects/e5b0a7e2110a44b6873443b6337d3c14` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:34.104413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087aff96-c1a7-4474-abe9-210c7c63d7ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b0a7e2110a44b6873443b6337d3c14)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:34.107044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087aff96-c1a7-4474-abe9-210c7c63d7ac admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:34.358537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-087aff96-c1a7-4474-abe9-210c7c63d7ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b0a7e2110a44b6873443b6337d3c14', 'request_id': 'req-087aff96-c1a7-4474-abe9-210c7c63d7ac'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:34.370864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-087aff96-c1a7-4474-abe9-210c7c63d7ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b0a7e2110a44b6873443b6337d3c14', 'request_id': 'req-087aff96-c1a7-4474-abe9-210c7c63d7ac'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:34.480782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-087aff96-c1a7-4474-abe9-210c7c63d7ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b0a7e2110a44b6873443b6337d3c14', 'request_id': 'req-087aff96-c1a7-4474-abe9-210c7c63d7ac'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:34.494727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-087aff96-c1a7-4474-abe9-210c7c63d7ac admin admin] The token cache is being invalidate because project e5b0a7e2110a44b6873443b6337d3c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:40:34.495255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-087aff96-c1a7-4474-abe9-210c7c63d7ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:34.496065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-087aff96-c1a7-4474-abe9-210c7c63d7ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:34.501331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 830/1650] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:40:33 2022] DELETE /identity/v3/projects/e5b0a7e2110a44b6873443b6337d3c14 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:34.503407 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741adb2a-0a21-480d-8117-a874c13744a0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:34.503884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741adb2a-0a21-480d-8117-a874c13744a0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:34.504275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741adb2a-0a21-480d-8117-a874c13744a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:34.583594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-741adb2a-0a21-480d-8117-a874c13744a0 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:34.584814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-741adb2a-0a21-480d-8117-a874c13744a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:34.619281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:34.669220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 821/1651] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:34.679670 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d522176-fae3-454a-9d2f-80d656b50bc0 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:34.680144 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d522176-fae3-454a-9d2f-80d656b50bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:34.681740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d522176-fae3-454a-9d2f-80d656b50bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:34.732464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-1d522176-fae3-454a-9d2f-80d656b50bc0 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:34.737079 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1d522176-fae3-454a-9d2f-80d656b50bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:34.775852 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 831/1652] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:34.779036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741adb2a-0a21-480d-8117-a874c13744a0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:34.795698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741adb2a-0a21-480d-8117-a874c13744a0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:34.804275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93f1ae-d135-4e05-aa8d-5d6acd7158c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:34.804906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f1ae-d135-4e05-aa8d-5d6acd7158c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:34.805394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f1ae-d135-4e05-aa8d-5d6acd7158c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:34.806167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f1ae-d135-4e05-aa8d-5d6acd7158c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:34.808878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93f1ae-d135-4e05-aa8d-5d6acd7158c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:40:34.810205 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93f1ae-d135-4e05-aa8d-5d6acd7158c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:34.814129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93f1ae-d135-4e05-aa8d-5d6acd7158c0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:34.865615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 822/1653] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:40:34.870114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d522176-fae3-454a-9d2f-80d656b50bc0 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:34.905139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d522176-fae3-454a-9d2f-80d656b50bc0 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:34.939448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c24eca-0b9c-4888-9e7d-298615bbcae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:34.942332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24eca-0b9c-4888-9e7d-298615bbcae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:34.943909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24eca-0b9c-4888-9e7d-298615bbcae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:34.944889 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24eca-0b9c-4888-9e7d-298615bbcae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:34.949810 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c24eca-0b9c-4888-9e7d-298615bbcae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:34.954373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c24eca-0b9c-4888-9e7d-298615bbcae7 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:35.129400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 832/1654] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:34 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:35.133973 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93f1ae-d135-4e05-aa8d-5d6acd7158c0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:35.147285 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93f1ae-d135-4e05-aa8d-5d6acd7158c0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:35.290761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed723a7-b777-4d4c-8d2c-345112ed7658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:35.291392 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed723a7-b777-4d4c-8d2c-345112ed7658 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:35.291667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed723a7-b777-4d4c-8d2c-345112ed7658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:35.291935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed723a7-b777-4d4c-8d2c-345112ed7658 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:35.292592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed723a7-b777-4d4c-8d2c-345112ed7658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:35.294540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed723a7-b777-4d4c-8d2c-345112ed7658 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:35.377350 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 823/1655] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:35 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:35.378688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c24eca-0b9c-4888-9e7d-298615bbcae7 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:35.388279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:35.401833 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c24eca-0b9c-4888-9e7d-298615bbcae7 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:35.417033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f5b2-037b-4cbd-b9ee-0ac6009c3b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:35.417842 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f5b2-037b-4cbd-b9ee-0ac6009c3b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:35.418221 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f5b2-037b-4cbd-b9ee-0ac6009c3b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:35.418594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f5b2-037b-4cbd-b9ee-0ac6009c3b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:35.419354 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1f5b2-037b-4cbd-b9ee-0ac6009c3b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:35.424327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1f5b2-037b-4cbd-b9ee-0ac6009c3b59 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:35.464064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 833/1656] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:35.464227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed723a7-b777-4d4c-8d2c-345112ed7658 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:35.476010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed723a7-b777-4d4c-8d2c-345112ed7658 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:35.483938 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c91f9-9b55-4077-8377-06d935181084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:35.484608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c91f9-9b55-4077-8377-06d935181084 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:35.484937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c91f9-9b55-4077-8377-06d935181084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:35.485300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c91f9-9b55-4077-8377-06d935181084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:35.485963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c91f9-9b55-4077-8377-06d935181084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:35.487723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c91f9-9b55-4077-8377-06d935181084 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:35.505187 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 824/1657] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:40:35.509298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f5b2-037b-4cbd-b9ee-0ac6009c3b59 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:35.525926 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f5b2-037b-4cbd-b9ee-0ac6009c3b59 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:35.541342 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c51485-5161-40a5-8247-6a92d3ee6195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:35.542241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c51485-5161-40a5-8247-6a92d3ee6195 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:35.542616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c51485-5161-40a5-8247-6a92d3ee6195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:35.543010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c51485-5161-40a5-8247-6a92d3ee6195 admin admin] PATH_INFO: `/v3/projects/c27d72acbe084429b6e1b4b486734f3a/users/ec9bd253f4374cb8836834b5e75da919/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:35.590739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c51485-5161-40a5-8247-6a92d3ee6195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27d72acbe084429b6e1b4b486734f3a, user_id=ec9bd253f4374cb8836834b5e75da919, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:35.593610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c51485-5161-40a5-8247-6a92d3ee6195 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:35.745042 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 834/1658] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:35 2022] PUT /identity/v3/projects/c27d72acbe084429b6e1b4b486734f3a/users/ec9bd253f4374cb8836834b5e75da919/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:35.755944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071d4c6-27bf-4201-addd-8e7817ad4e7a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:35.756421 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071d4c6-27bf-4201-addd-8e7817ad4e7a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:35.757386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071d4c6-27bf-4201-addd-8e7817ad4e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:35.845822 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5071d4c6-27bf-4201-addd-8e7817ad4e7a None None] MFA Rules not processed for user `ec9bd253f4374cb8836834b5e75da919`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:35.847423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5071d4c6-27bf-4201-addd-8e7817ad4e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:36.017501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 825/1659] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:40:36.022876 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c51485-5161-40a5-8247-6a92d3ee6195 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:36.242726 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c51485-5161-40a5-8247-6a92d3ee6195 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:36.261620 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a5805-42d7-4a5e-9b1b-6d6a43dfd52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:36.262262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a5805-42d7-4a5e-9b1b-6d6a43dfd52b admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:36.262564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a5805-42d7-4a5e-9b1b-6d6a43dfd52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:36.262795 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a5805-42d7-4a5e-9b1b-6d6a43dfd52b admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:36.263440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a5805-42d7-4a5e-9b1b-6d6a43dfd52b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:36.265445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a5805-42d7-4a5e-9b1b-6d6a43dfd52b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:36.471805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 835/1660] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:36 2022] POST /identity/v3/projects => generated 373 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:40:36.476524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071d4c6-27bf-4201-addd-8e7817ad4e7a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:36.501676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071d4c6-27bf-4201-addd-8e7817ad4e7a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:36.598260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:36.622647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d9e5c-2a2b-4cdd-b0bd-237c9a8a7955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:36.623934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d9e5c-2a2b-4cdd-b0bd-237c9a8a7955 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:36.624371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d9e5c-2a2b-4cdd-b0bd-237c9a8a7955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:36.624797 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d9e5c-2a2b-4cdd-b0bd-237c9a8a7955 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:36.625638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d9e5c-2a2b-4cdd-b0bd-237c9a8a7955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:36.628129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d9e5c-2a2b-4cdd-b0bd-237c9a8a7955 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:36.799070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a5805-42d7-4a5e-9b1b-6d6a43dfd52b admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:36.809870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 826/1661] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:36 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:36.835561 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a5805-42d7-4a5e-9b1b-6d6a43dfd52b admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:36.849458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7c2f6-d4ee-4e19-81f7-6558e6e7c18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:36.857142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7c2f6-d4ee-4e19-81f7-6558e6e7c18f admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:36.857142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7c2f6-d4ee-4e19-81f7-6558e6e7c18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:36.857142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7c2f6-d4ee-4e19-81f7-6558e6e7c18f admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:36.857142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7c2f6-d4ee-4e19-81f7-6558e6e7c18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:36.865270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7c2f6-d4ee-4e19-81f7-6558e6e7c18f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:36.899462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d9e5c-2a2b-4cdd-b0bd-237c9a8a7955 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:36.911414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 836/1662] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:36.915465 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d9e5c-2a2b-4cdd-b0bd-237c9a8a7955 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:36.929187 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188f53c-54fb-434d-b37a-7358b2e22215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:36.930113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188f53c-54fb-434d-b37a-7358b2e22215 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:36.930560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188f53c-54fb-434d-b37a-7358b2e22215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:36.933394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188f53c-54fb-434d-b37a-7358b2e22215 admin admin] PATH_INFO: `/v3/projects/46f2d99d561344d3ab0866cf563abc49/users/37bc5b575e28419e8a2efa2ad000ae6d/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:36.971704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188f53c-54fb-434d-b37a-7358b2e22215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f2d99d561344d3ab0866cf563abc49, user_id=37bc5b575e28419e8a2efa2ad000ae6d, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:36.975778 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188f53c-54fb-434d-b37a-7358b2e22215 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:37.097892 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 827/1663] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:36 2022] PUT /identity/v3/projects/46f2d99d561344d3ab0866cf563abc49/users/37bc5b575e28419e8a2efa2ad000ae6d/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:37.099032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7c2f6-d4ee-4e19-81f7-6558e6e7c18f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:37.120071 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7c2f6-d4ee-4e19-81f7-6558e6e7c18f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:37.245384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18ff7a-12e2-4e07-a015-0553e8714977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:37.247600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ff7a-12e2-4e07-a015-0553e8714977 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:37.248270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ff7a-12e2-4e07-a015-0553e8714977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:37.248688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ff7a-12e2-4e07-a015-0553e8714977 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:37.255665 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18ff7a-12e2-4e07-a015-0553e8714977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:37.260708 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18ff7a-12e2-4e07-a015-0553e8714977 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:37.283981 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 837/1664] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:37.288072 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188f53c-54fb-434d-b37a-7358b2e22215 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:37.307543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188f53c-54fb-434d-b37a-7358b2e22215 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:37.337797 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793eff19-5634-4d44-ac27-76a3e2b98771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:37.338492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793eff19-5634-4d44-ac27-76a3e2b98771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:37.338787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793eff19-5634-4d44-ac27-76a3e2b98771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:37.339060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793eff19-5634-4d44-ac27-76a3e2b98771 admin admin] PATH_INFO: `/v3/projects/46f2d99d561344d3ab0866cf563abc49/users/37bc5b575e28419e8a2efa2ad000ae6d/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:37.344234 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793eff19-5634-4d44-ac27-76a3e2b98771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f2d99d561344d3ab0866cf563abc49, user_id=37bc5b575e28419e8a2efa2ad000ae6d, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:37.346965 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793eff19-5634-4d44-ac27-76a3e2b98771 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:37.385015 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 828/1665] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:37 2022] PUT /identity/v3/projects/46f2d99d561344d3ab0866cf563abc49/users/37bc5b575e28419e8a2efa2ad000ae6d/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:37.398134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91c018-23cf-457d-90a0-74918ff2cae6 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:37.398828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91c018-23cf-457d-90a0-74918ff2cae6 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:37.399957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91c018-23cf-457d-90a0-74918ff2cae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:37.458672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-bb91c018-23cf-457d-90a0-74918ff2cae6 None None] MFA Rules not processed for user `37bc5b575e28419e8a2efa2ad000ae6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:37.470115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-bb91c018-23cf-457d-90a0-74918ff2cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:37.591501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 838/1666] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:37.606103 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793eff19-5634-4d44-ac27-76a3e2b98771 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:37.608232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-793eff19-5634-4d44-ac27-76a3e2b98771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:37.733141 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793eff19-5634-4d44-ac27-76a3e2b98771 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:37.737114 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bcc3c-3d3b-4091-bdba-09353720f2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:37.738022 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bcc3c-3d3b-4091-bdba-09353720f2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:37.738614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bcc3c-3d3b-4091-bdba-09353720f2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:37.739027 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bcc3c-3d3b-4091-bdba-09353720f2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:37.757019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bcc3c-3d3b-4091-bdba-09353720f2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:37.760339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bcc3c-3d3b-4091-bdba-09353720f2d9 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:37.799014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 829/1667] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:37.858310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:38.239881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91c018-23cf-457d-90a0-74918ff2cae6 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:38.255456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91c018-23cf-457d-90a0-74918ff2cae6 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:38.276686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e7476-155d-4c32-8455-a6797633b09e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:38.277370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e7476-155d-4c32-8455-a6797633b09e service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:38.277646 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e7476-155d-4c32-8455-a6797633b09e service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:38.277914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e7476-155d-4c32-8455-a6797633b09e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:38.428827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e7476-155d-4c32-8455-a6797633b09e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:38.430889 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e7476-155d-4c32-8455-a6797633b09e service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:38.449628 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 839/1668] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:40.808855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bcc3c-3d3b-4091-bdba-09353720f2d9 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:40.812610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5d1bcc3c-3d3b-4091-bdba-09353720f2d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:41.048655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bcc3c-3d3b-4091-bdba-09353720f2d9 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:41.070511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae23ee-7a45-485b-9fcc-19dfa72387ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:41.071183 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae23ee-7a45-485b-9fcc-19dfa72387ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:41.071629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae23ee-7a45-485b-9fcc-19dfa72387ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:41.071717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae23ee-7a45-485b-9fcc-19dfa72387ea admin admin] PATH_INFO: `/v3/users/ba60ba93ba064960b34c6c6c77e94e94` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:41.076764 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae23ee-7a45-485b-9fcc-19dfa72387ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba60ba93ba064960b34c6c6c77e94e94)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:41.078791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae23ee-7a45-485b-9fcc-19dfa72387ea admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:41.129141 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:41.410624 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-85ae23ee-7a45-485b-9fcc-19dfa72387ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba60ba93ba064960b34c6c6c77e94e94'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:41.435583 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-85ae23ee-7a45-485b-9fcc-19dfa72387ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba60ba93ba064960b34c6c6c77e94e94'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:41.482161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-85ae23ee-7a45-485b-9fcc-19dfa72387ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba60ba93ba064960b34c6c6c77e94e94'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:41.586528 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-85ae23ee-7a45-485b-9fcc-19dfa72387ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba60ba93ba064960b34c6c6c77e94e94'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:41.589617 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-85ae23ee-7a45-485b-9fcc-19dfa72387ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba60ba93ba064960b34c6c6c77e94e94'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:41.624427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c45b59-453d-4b25-a8e9-dcd316214dab None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:41.625632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c45b59-453d-4b25-a8e9-dcd316214dab None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:41.626159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c45b59-453d-4b25-a8e9-dcd316214dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:41.635961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 830/1669] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:40:40 2022] DELETE /identity/v3/users/ba60ba93ba064960b34c6c6c77e94e94 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:41.659754 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-28c45b59-453d-4b25-a8e9-dcd316214dab None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:41.661727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-28c45b59-453d-4b25-a8e9-dcd316214dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:41.801444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 840/1670] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:41.878743 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae23ee-7a45-485b-9fcc-19dfa72387ea admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:41.881113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-85ae23ee-7a45-485b-9fcc-19dfa72387ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:42.114936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae23ee-7a45-485b-9fcc-19dfa72387ea admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:42.119851 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850df1a3-f5ff-4910-96e7-057ce1d6c963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:42.120699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850df1a3-f5ff-4910-96e7-057ce1d6c963 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:42.121226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850df1a3-f5ff-4910-96e7-057ce1d6c963 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:42.121717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850df1a3-f5ff-4910-96e7-057ce1d6c963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:42.133564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850df1a3-f5ff-4910-96e7-057ce1d6c963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:42.135742 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850df1a3-f5ff-4910-96e7-057ce1d6c963 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:42.174152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 831/1671] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:43.388667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867e098-084e-4dd8-828f-b021c98c8a22 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:43.389528 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867e098-084e-4dd8-828f-b021c98c8a22 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:43.393514 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867e098-084e-4dd8-828f-b021c98c8a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:43.463282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-1867e098-084e-4dd8-828f-b021c98c8a22 None None] MFA Rules not processed for user `da324489014b4ed7adb3529702cd5e78`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:43.464609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1867e098-084e-4dd8-828f-b021c98c8a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:43.529468 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850df1a3-f5ff-4910-96e7-057ce1d6c963 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:43.531075 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-850df1a3-f5ff-4910-96e7-057ce1d6c963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:43.571484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850df1a3-f5ff-4910-96e7-057ce1d6c963 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:43.577083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f9fd9-c10d-403f-a5b6-ab6180565544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:43.577936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f9fd9-c10d-403f-a5b6-ab6180565544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:43.578358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f9fd9-c10d-403f-a5b6-ab6180565544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:43.578836 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f9fd9-c10d-403f-a5b6-ab6180565544 admin admin] PATH_INFO: `/v3/users/cd6794d95e994d2e955fdd1d3e95d476` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:43.580335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f9fd9-c10d-403f-a5b6-ab6180565544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6794d95e994d2e955fdd1d3e95d476)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:43.583252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f9fd9-c10d-403f-a5b6-ab6180565544 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:43.657384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:43.725566 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 841/1672] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:43.734364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065d711-4bed-4a7f-81df-e2facd1864ef None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:43.734775 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065d711-4bed-4a7f-81df-e2facd1864ef None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:43.734910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065d711-4bed-4a7f-81df-e2facd1864ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:43.780020 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-9065d711-4bed-4a7f-81df-e2facd1864ef None None] MFA Rules not processed for user `da324489014b4ed7adb3529702cd5e78`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:43.789482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9065d711-4bed-4a7f-81df-e2facd1864ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:43.839210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7c9f9fd9-c10d-403f-a5b6-ab6180565544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6794d95e994d2e955fdd1d3e95d476'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:43.854674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 842/1673] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:43.856440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065d711-4bed-4a7f-81df-e2facd1864ef None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:43.859200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9065d711-4bed-4a7f-81df-e2facd1864ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:43.861717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7c9f9fd9-c10d-403f-a5b6-ab6180565544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6794d95e994d2e955fdd1d3e95d476'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:43.915438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7c9f9fd9-c10d-403f-a5b6-ab6180565544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6794d95e994d2e955fdd1d3e95d476'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:44.011796 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7c9f9fd9-c10d-403f-a5b6-ab6180565544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6794d95e994d2e955fdd1d3e95d476'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:44.012488 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7c9f9fd9-c10d-403f-a5b6-ab6180565544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6794d95e994d2e955fdd1d3e95d476'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:44.036302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 832/1674] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:40:43 2022] DELETE /identity/v3/users/cd6794d95e994d2e955fdd1d3e95d476 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:44.041326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed185b-6731-4bd9-a69a-40238405f232 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:44.041675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed185b-6731-4bd9-a69a-40238405f232 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:44.041955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed185b-6731-4bd9-a69a-40238405f232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:44.095297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:44.113656 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-60ed185b-6731-4bd9-a69a-40238405f232 None None] MFA Rules not processed for user `c70f2ce21e9b49ffb3564873e09397e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:44.116148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-60ed185b-6731-4bd9-a69a-40238405f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:44.130579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065d711-4bed-4a7f-81df-e2facd1864ef None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:44.397299 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 833/1675] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:44.399343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e250a-4482-4a14-b662-9a6881dd8eae None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:44.399633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e250a-4482-4a14-b662-9a6881dd8eae None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:44.399910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e250a-4482-4a14-b662-9a6881dd8eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:44.411688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e2207-b9f0-48aa-84c1-4f2da7d2d7d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:44.411688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e2207-b9f0-48aa-84c1-4f2da7d2d7d0 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:44.411688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e2207-b9f0-48aa-84c1-4f2da7d2d7d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:44.411688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e2207-b9f0-48aa-84c1-4f2da7d2d7d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:44.418045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-fc5e2207-b9f0-48aa-84c1-4f2da7d2d7d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:44.439594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2e0e250a-4482-4a14-b662-9a6881dd8eae None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:44.446720 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2e0e250a-4482-4a14-b662-9a6881dd8eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:44.563386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e2207-b9f0-48aa-84c1-4f2da7d2d7d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:44.565895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e2207-b9f0-48aa-84c1-4f2da7d2d7d0 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:44.584903 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 843/1676] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:44.588453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e2207-b9f0-48aa-84c1-4f2da7d2d7d0 service nova] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:44.595315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-fc5e2207-b9f0-48aa-84c1-4f2da7d2d7d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:44.603015 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 834/1677] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:44.605179 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb190833-7702-4736-b82d-1d496addfadd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:44.605461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb190833-7702-4736-b82d-1d496addfadd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:44.605738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb190833-7702-4736-b82d-1d496addfadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:44.628837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e2207-b9f0-48aa-84c1-4f2da7d2d7d0 service nova] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:44.639580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:44.640285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:44.640564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:44.642872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] PATH_INFO: `/v3/projects/50c72c710b484460bd336a758347403c` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:44.643394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c72c710b484460bd336a758347403c)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:44.646903 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:44.675444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-eb190833-7702-4736-b82d-1d496addfadd None None] MFA Rules not processed for user `f29dce2bfd7a4553900e92acf531dd68`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:44.676934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eb190833-7702-4736-b82d-1d496addfadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:44.711701 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:44.834148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 835/1678] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:44.836379 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb190833-7702-4736-b82d-1d496addfadd None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:44.844248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eb190833-7702-4736-b82d-1d496addfadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:44.849234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c72c710b484460bd336a758347403c', 'request_id': 'req-5d3f3b25-ebce-4d97-9906-4f9335896be8'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:44.867902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c72c710b484460bd336a758347403c', 'request_id': 'req-5d3f3b25-ebce-4d97-9906-4f9335896be8'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:44.878609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb190833-7702-4736-b82d-1d496addfadd None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:44.948972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c72c710b484460bd336a758347403c', 'request_id': 'req-5d3f3b25-ebce-4d97-9906-4f9335896be8'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:44.966145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] The token cache is being invalidate because project 50c72c710b484460bd336a758347403c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:40:44.966441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:44.967835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:44.970126 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 844/1679] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:40:44 2022] DELETE /identity/v3/projects/50c72c710b484460bd336a758347403c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:44.990880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:45.001689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:45.051223 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6484456-3e94-4fe9-b690-07411a2723e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:45.052050 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6484456-3e94-4fe9-b690-07411a2723e6 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:45.055231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6484456-3e94-4fe9-b690-07411a2723e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:45.055585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6484456-3e94-4fe9-b690-07411a2723e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:45.065140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d6484456-3e94-4fe9-b690-07411a2723e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:45.199644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f3b25-ebce-4d97-9906-4f9335896be8 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:45.221197 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cd190-f291-4354-b424-36d1a842d44f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:45.221835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cd190-f291-4354-b424-36d1a842d44f service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:45.222115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cd190-f291-4354-b424-36d1a842d44f service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:45.222386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cd190-f291-4354-b424-36d1a842d44f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:45.224250 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-764cd190-f291-4354-b424-36d1a842d44f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:45.247921 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:45.255510 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6484456-3e94-4fe9-b690-07411a2723e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:45.257857 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6484456-3e94-4fe9-b690-07411a2723e6 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:45.288269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 836/1680] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:45.290547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb65557-65c8-4f81-a67e-d56468c174b8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:45.294739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb65557-65c8-4f81-a67e-d56468c174b8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:45.295051 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb65557-65c8-4f81-a67e-d56468c174b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:45.345864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5fb65557-65c8-4f81-a67e-d56468c174b8 None None] MFA Rules not processed for user `f29dce2bfd7a4553900e92acf531dd68`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:45.347916 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5fb65557-65c8-4f81-a67e-d56468c174b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:45.401877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cd190-f291-4354-b424-36d1a842d44f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:45.403782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cd190-f291-4354-b424-36d1a842d44f service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:45.434697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 845/1681] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:45.436227 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579d5a8-9284-44a3-887c-56f9aeec23b5 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:45.436610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579d5a8-9284-44a3-887c-56f9aeec23b5 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:45.436983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579d5a8-9284-44a3-887c-56f9aeec23b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:45.498061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-0579d5a8-9284-44a3-887c-56f9aeec23b5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:45.498871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 837/1682] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:45.499746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb65557-65c8-4f81-a67e-d56468c174b8 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:45.501998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-0579d5a8-9284-44a3-887c-56f9aeec23b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:45.503572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5fb65557-65c8-4f81-a67e-d56468c174b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:45.528426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 846/1683] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:45.537457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde1e66-174e-4971-8c74-12cd8937e2d5 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:45.537870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde1e66-174e-4971-8c74-12cd8937e2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:45.538290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde1e66-174e-4971-8c74-12cd8937e2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:45.539272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb65557-65c8-4f81-a67e-d56468c174b8 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:45.555517 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9e9ee-ca6c-4ccb-8385-b4c96bf30402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:45.559483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9e9ee-ca6c-4ccb-8385-b4c96bf30402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:45.559483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9e9ee-ca6c-4ccb-8385-b4c96bf30402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:45.559483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9e9ee-ca6c-4ccb-8385-b4c96bf30402 admin admin] PATH_INFO: `/v3/users/03bc9d741ab74302a72c634447cdf74f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:45.561610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9e9ee-ca6c-4ccb-8385-b4c96bf30402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03bc9d741ab74302a72c634447cdf74f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:45.563584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9e9ee-ca6c-4ccb-8385-b4c96bf30402 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:45.581664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-6bde1e66-174e-4971-8c74-12cd8937e2d5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:45.583233 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6bde1e66-174e-4971-8c74-12cd8937e2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:45.612177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 847/1684] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:45.613637 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde1e66-174e-4971-8c74-12cd8937e2d5 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:45.636586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde1e66-174e-4971-8c74-12cd8937e2d5 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:45.650531 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7b291-e3b0-471a-9945-584fa884d115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:45.653359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7b291-e3b0-471a-9945-584fa884d115 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:45.653820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7b291-e3b0-471a-9945-584fa884d115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:45.654159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7b291-e3b0-471a-9945-584fa884d115 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:45.654905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7b291-e3b0-471a-9945-584fa884d115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:40:45.656171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7b291-e3b0-471a-9945-584fa884d115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:45.658806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7b291-e3b0-471a-9945-584fa884d115 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:45.698100 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 848/1685] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:40:45.698842 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7b291-e3b0-471a-9945-584fa884d115 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:45.719771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7b291-e3b0-471a-9945-584fa884d115 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:45.736790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c773e-c8bf-4bb4-b1af-4649140d55d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:45.737533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c773e-c8bf-4bb4-b1af-4649140d55d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:45.737912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c773e-c8bf-4bb4-b1af-4649140d55d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:45.738285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c773e-c8bf-4bb4-b1af-4649140d55d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:45.739385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c773e-c8bf-4bb4-b1af-4649140d55d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:45.741250 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c773e-c8bf-4bb4-b1af-4649140d55d9 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:45.851244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4e9e9ee-ca6c-4ccb-8385-b4c96bf30402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03bc9d741ab74302a72c634447cdf74f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:45.868093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4e9e9ee-ca6c-4ccb-8385-b4c96bf30402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03bc9d741ab74302a72c634447cdf74f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:45.885172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:45.895831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4e9e9ee-ca6c-4ccb-8385-b4c96bf30402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03bc9d741ab74302a72c634447cdf74f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:45.897301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 849/1686] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:45 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:45.898509 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c773e-c8bf-4bb4-b1af-4649140d55d9 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:45.901937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7e0c773e-c8bf-4bb4-b1af-4649140d55d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:45.913877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:45.966617 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4e9e9ee-ca6c-4ccb-8385-b4c96bf30402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03bc9d741ab74302a72c634447cdf74f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:45.967756 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4e9e9ee-ca6c-4ccb-8385-b4c96bf30402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03bc9d741ab74302a72c634447cdf74f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:45.976760 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 838/1687] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:40:45 2022] DELETE /identity/v3/users/03bc9d741ab74302a72c634447cdf74f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:45.983113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34946a1d-f8ab-45be-8e9b-9ee342a07651 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:45.983433 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34946a1d-f8ab-45be-8e9b-9ee342a07651 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:45.983685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34946a1d-f8ab-45be-8e9b-9ee342a07651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:46.027795 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c773e-c8bf-4bb4-b1af-4649140d55d9 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:46.061483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-34946a1d-f8ab-45be-8e9b-9ee342a07651 None None] MFA Rules not processed for user `811bb431ddbb42638f909ebf6d921536`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:46.062952 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-34946a1d-f8ab-45be-8e9b-9ee342a07651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:46.174656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb01a21-6593-488c-948d-019d0f365805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:46.175295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01a21-6593-488c-948d-019d0f365805 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:46.175571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01a21-6593-488c-948d-019d0f365805 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:46.176480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01a21-6593-488c-948d-019d0f365805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:46.180799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-feb01a21-6593-488c-948d-019d0f365805 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:46.277560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 839/1688] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:46.277560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34946a1d-f8ab-45be-8e9b-9ee342a07651 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:46.277560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-34946a1d-f8ab-45be-8e9b-9ee342a07651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:46.368603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb01a21-6593-488c-948d-019d0f365805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:46.373831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb01a21-6593-488c-948d-019d0f365805 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:46.402211 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 850/1689] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:46.404167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ace4a5-7123-4273-8b64-5b168b3cbc52 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:46.404447 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ace4a5-7123-4273-8b64-5b168b3cbc52 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:46.406149 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ace4a5-7123-4273-8b64-5b168b3cbc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:46.453814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-70ace4a5-7123-4273-8b64-5b168b3cbc52 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:46.456391 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-70ace4a5-7123-4273-8b64-5b168b3cbc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:46.475142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34946a1d-f8ab-45be-8e9b-9ee342a07651 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:46.490057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 851/1690] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:46.492396 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d72e1-2dbf-428c-ba62-a0b6e7ff698b None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:46.493752 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d72e1-2dbf-428c-ba62-a0b6e7ff698b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:46.494237 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d72e1-2dbf-428c-ba62-a0b6e7ff698b None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:46.500107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 852/1691] 10.222.0.50 () {54 vars in 912 bytes} [Sat Sep 17 04:40:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:40:46.500107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d72e1-2dbf-428c-ba62-a0b6e7ff698b None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:46.503416 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c47f4-ebdc-46f9-938c-acaa40d227cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:46.504225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c47f4-ebdc-46f9-938c-acaa40d227cf admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:46.504644 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c47f4-ebdc-46f9-938c-acaa40d227cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:46.505105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c47f4-ebdc-46f9-938c-acaa40d227cf admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:46.505956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c47f4-ebdc-46f9-938c-acaa40d227cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:46.506661 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-455d72e1-2dbf-428c-ba62-a0b6e7ff698b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:46.510747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c47f4-ebdc-46f9-938c-acaa40d227cf admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:46.660590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 840/1692] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:46 2022] POST /identity/v3/users => generated 287 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:46.662127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7e825-3393-41c1-9dca-f343e8aed661 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:46.662480 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7e825-3393-41c1-9dca-f343e8aed661 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:46.662815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7e825-3393-41c1-9dca-f343e8aed661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:46.668222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d72e1-2dbf-428c-ba62-a0b6e7ff698b None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:46.675061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefff30-c761-4fbd-a076-ca33f46a6a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:46.677174 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefff30-c761-4fbd-a076-ca33f46a6a57 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:46.677562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefff30-c761-4fbd-a076-ca33f46a6a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:46.678525 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefff30-c761-4fbd-a076-ca33f46a6a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:46.697258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefff30-c761-4fbd-a076-ca33f46a6a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:46.699568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefff30-c761-4fbd-a076-ca33f46a6a57 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:46.728530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 853/1693] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:46.729446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefff30-c761-4fbd-a076-ca33f46a6a57 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:46.732807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-deefff30-c761-4fbd-a076-ca33f46a6a57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:46.741991 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0bd7e825-3393-41c1-9dca-f343e8aed661 None None] MFA Rules not processed for user `6469c8860be943168b67ea7fa28bf19d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:46.743325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0bd7e825-3393-41c1-9dca-f343e8aed661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:46.757994 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 841/1694] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:40:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:46.768499 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7e825-3393-41c1-9dca-f343e8aed661 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:46.768655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefff30-c761-4fbd-a076-ca33f46a6a57 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:46.772572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7e825-3393-41c1-9dca-f343e8aed661 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:46.775895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:46.776608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:46.776895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:46.777193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] PATH_INFO: `/v3/projects/7695f8f817e74e14926fd522e17dac0f` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:46.780879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7695f8f817e74e14926fd522e17dac0f)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:46.782883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:46.794640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc86977-1035-4e01-b49a-5f6151359d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:46.795910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc86977-1035-4e01-b49a-5f6151359d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:46.796417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc86977-1035-4e01-b49a-5f6151359d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:46.796946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc86977-1035-4e01-b49a-5f6151359d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:46.797751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc86977-1035-4e01-b49a-5f6151359d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:46.803010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc86977-1035-4e01-b49a-5f6151359d4b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:46.830503 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 842/1695] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:46.830503 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc86977-1035-4e01-b49a-5f6151359d4b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:46.838138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6bc86977-1035-4e01-b49a-5f6151359d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:46.866859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc86977-1035-4e01-b49a-5f6151359d4b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:46.877445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf630c3-9e72-4b30-abb6-410c3042674c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:46.878674 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf630c3-9e72-4b30-abb6-410c3042674c service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:46.883167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf630c3-9e72-4b30-abb6-410c3042674c service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:46.883600 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf630c3-9e72-4b30-abb6-410c3042674c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:46.902358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf630c3-9e72-4b30-abb6-410c3042674c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:46.907424 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf630c3-9e72-4b30-abb6-410c3042674c service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:46.930191 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 843/1696] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:46.931089 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf630c3-9e72-4b30-abb6-410c3042674c service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:46.958117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf630c3-9e72-4b30-abb6-410c3042674c service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:46.980429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e79af-e91a-49f0-b447-ee5af91df2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:46.988931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e79af-e91a-49f0-b447-ee5af91df2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:46.989300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e79af-e91a-49f0-b447-ee5af91df2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:46.989584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e79af-e91a-49f0-b447-ee5af91df2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:46.990274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e79af-e91a-49f0-b447-ee5af91df2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:46.994057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e79af-e91a-49f0-b447-ee5af91df2f8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:46.996211 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7695f8f817e74e14926fd522e17dac0f', 'request_id': 'req-532e6cdd-bd0e-413c-9bd2-44357f55609e'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:47.010770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7695f8f817e74e14926fd522e17dac0f', 'request_id': 'req-532e6cdd-bd0e-413c-9bd2-44357f55609e'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:47.026775 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 844/1697] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:47.031077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e79af-e91a-49f0-b447-ee5af91df2f8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:47.049452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e79af-e91a-49f0-b447-ee5af91df2f8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:47.060713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:47.125790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7695f8f817e74e14926fd522e17dac0f', 'request_id': 'req-532e6cdd-bd0e-413c-9bd2-44357f55609e'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:47.144739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] The token cache is being invalidate because project 7695f8f817e74e14926fd522e17dac0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:40:47.145509 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:47.151493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:47.151493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 854/1698] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:40:46 2022] DELETE /identity/v3/projects/7695f8f817e74e14926fd522e17dac0f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:47.156274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:47.167377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:47.203852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6752c-ca67-425f-876d-32959bf1a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:47.204785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6752c-ca67-425f-876d-32959bf1a845 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:47.205219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6752c-ca67-425f-876d-32959bf1a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:47.205604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6752c-ca67-425f-876d-32959bf1a845 admin admin] PATH_INFO: `/v3/projects/45b6393084504128ba74522101d7237a/users/84c64e31a3464748bfd9a3f562670ff2/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:47.245507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6752c-ca67-425f-876d-32959bf1a845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b6393084504128ba74522101d7237a, user_id=84c64e31a3464748bfd9a3f562670ff2, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:47.248634 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6752c-ca67-425f-876d-32959bf1a845 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:47.303635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e6cdd-bd0e-413c-9bd2-44357f55609e admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:47.310243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e8f63-47da-4430-a1de-bed5c68205e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:47.311005 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e8f63-47da-4430-a1de-bed5c68205e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:47.311274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e8f63-47da-4430-a1de-bed5c68205e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:47.311556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e8f63-47da-4430-a1de-bed5c68205e5 admin admin] PATH_INFO: `/v3/users/73185d654ef24bbfafe54fcef85597e9` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:47.312753 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e8f63-47da-4430-a1de-bed5c68205e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73185d654ef24bbfafe54fcef85597e9)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:47.315099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e8f63-47da-4430-a1de-bed5c68205e5 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:47.356123 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 845/1699] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:47 2022] PUT /identity/v3/projects/45b6393084504128ba74522101d7237a/users/84c64e31a3464748bfd9a3f562670ff2/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:40:47.368340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aabab1-17b9-4b10-93be-b2c9e2c1a2e7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:47.368627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aabab1-17b9-4b10-93be-b2c9e2c1a2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:47.368901 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aabab1-17b9-4b10-93be-b2c9e2c1a2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:47.406161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c4aabab1-17b9-4b10-93be-b2c9e2c1a2e7 None None] MFA Rules not processed for user `84c64e31a3464748bfd9a3f562670ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:47.407389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c4aabab1-17b9-4b10-93be-b2c9e2c1a2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:47.493580 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 846/1700] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:40:47.499315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d3f8e-d61a-4821-b5d6-e9ef7c4e8059 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:47.502469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d3f8e-d61a-4821-b5d6-e9ef7c4e8059 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:47.502817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d3f8e-d61a-4821-b5d6-e9ef7c4e8059 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:47.506043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 847/1701] 10.222.0.50 () {54 vars in 912 bytes} [Sat Sep 17 04:40:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:40:47.513288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cca464-1ca9-4992-851d-507c19e8979c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:47.514314 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cca464-1ca9-4992-851d-507c19e8979c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:47.514705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cca464-1ca9-4992-851d-507c19e8979c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:47.543735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-73cca464-1ca9-4992-851d-507c19e8979c None None] MFA Rules not processed for user `6469c8860be943168b67ea7fa28bf19d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:47.545079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-73cca464-1ca9-4992-851d-507c19e8979c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:47.569843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7c5e8f63-47da-4430-a1de-bed5c68205e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73185d654ef24bbfafe54fcef85597e9'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:47.657732 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:47.668883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 848/1702] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:40:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:40:47.686936 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7c5e8f63-47da-4430-a1de-bed5c68205e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73185d654ef24bbfafe54fcef85597e9'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:47.687579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7c5e8f63-47da-4430-a1de-bed5c68205e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73185d654ef24bbfafe54fcef85597e9'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:47.700501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7c5e8f63-47da-4430-a1de-bed5c68205e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73185d654ef24bbfafe54fcef85597e9'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:47.738006 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cca464-1ca9-4992-851d-507c19e8979c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:47.742454 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-73cca464-1ca9-4992-851d-507c19e8979c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:47.785948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7c5e8f63-47da-4430-a1de-bed5c68205e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73185d654ef24bbfafe54fcef85597e9'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:47.796616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 855/1703] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:40:47 2022] DELETE /identity/v3/users/73185d654ef24bbfafe54fcef85597e9 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:47.799530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e8f63-47da-4430-a1de-bed5c68205e5 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:47.810735 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7c5e8f63-47da-4430-a1de-bed5c68205e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:47.948782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cca464-1ca9-4992-851d-507c19e8979c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:47.997167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e8f63-47da-4430-a1de-bed5c68205e5 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:48.003729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d139f0-d1a0-4910-9fb9-10526aa48d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:48.004481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d139f0-d1a0-4910-9fb9-10526aa48d93 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:48.004757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d139f0-d1a0-4910-9fb9-10526aa48d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:48.005047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d139f0-d1a0-4910-9fb9-10526aa48d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:48.035324 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f3d139f0-d1a0-4910-9fb9-10526aa48d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:48.120069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d139f0-d1a0-4910-9fb9-10526aa48d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:48.128839 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d139f0-d1a0-4910-9fb9-10526aa48d93 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:48.162924 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f83c20-138a-494c-8b86-5e4c8560efbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:48.164144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f83c20-138a-494c-8b86-5e4c8560efbf service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:48.164459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f83c20-138a-494c-8b86-5e4c8560efbf service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:48.164706 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f83c20-138a-494c-8b86-5e4c8560efbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:48.168423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-82f83c20-138a-494c-8b86-5e4c8560efbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:48.172612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 856/1704] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:48.178304 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d139f0-d1a0-4910-9fb9-10526aa48d93 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:48.183031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f3d139f0-d1a0-4910-9fb9-10526aa48d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:48.373821 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f83c20-138a-494c-8b86-5e4c8560efbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:48.377061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f83c20-138a-494c-8b86-5e4c8560efbf service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:48.417321 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:48.420068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 849/1705] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:48.468366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d139f0-d1a0-4910-9fb9-10526aa48d93 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:48.486244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98015c89-ccb0-4fea-a71f-afdf180058d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931a947711a2468baaeef701bbee60c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:48.488237 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015c89-ccb0-4fea-a71f-afdf180058d9 service placement] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:48.490048 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015c89-ccb0-4fea-a71f-afdf180058d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:48.490597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015c89-ccb0-4fea-a71f-afdf180058d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:48.496475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-98015c89-ccb0-4fea-a71f-afdf180058d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:48.547662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98015c89-ccb0-4fea-a71f-afdf180058d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:48.549684 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98015c89-ccb0-4fea-a71f-afdf180058d9 service placement] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:48.564070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 857/1706] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:48.729930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f83c20-138a-494c-8b86-5e4c8560efbf service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:48.733614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-82f83c20-138a-494c-8b86-5e4c8560efbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:48.776422 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98015c89-ccb0-4fea-a71f-afdf180058d9 service placement] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:48.779870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-98015c89-ccb0-4fea-a71f-afdf180058d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:48.796766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f83c20-138a-494c-8b86-5e4c8560efbf service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:48.820061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a23084-dd0f-41b8-b9bd-d934c42ecc06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:48.822714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a23084-dd0f-41b8-b9bd-d934c42ecc06 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:48.822714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a23084-dd0f-41b8-b9bd-d934c42ecc06 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:48.822984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a23084-dd0f-41b8-b9bd-d934c42ecc06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:48.831632 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-03a23084-dd0f-41b8-b9bd-d934c42ecc06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:48.989329 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98015c89-ccb0-4fea-a71f-afdf180058d9 service placement] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:48.996490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cf40b-3529-4d26-947c-3df56bd636ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:48.997775 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cf40b-3529-4d26-947c-3df56bd636ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:48.998905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cf40b-3529-4d26-947c-3df56bd636ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:48.999323 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cf40b-3529-4d26-947c-3df56bd636ab admin admin] PATH_INFO: `/v3/projects/d7114c6162164a3d983522844cb34903` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:49.000696 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cf40b-3529-4d26-947c-3df56bd636ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7114c6162164a3d983522844cb34903)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:49.003656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cf40b-3529-4d26-947c-3df56bd636ab admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:49.012281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a23084-dd0f-41b8-b9bd-d934c42ecc06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:49.014003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a23084-dd0f-41b8-b9bd-d934c42ecc06 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:49.040790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 850/1707] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:49.042039 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a23084-dd0f-41b8-b9bd-d934c42ecc06 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:49.046074 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-03a23084-dd0f-41b8-b9bd-d934c42ecc06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:49.101032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a23084-dd0f-41b8-b9bd-d934c42ecc06 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:49.113470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edc08f-fadb-457e-98c7-4c0ed5330709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:49.114191 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edc08f-fadb-457e-98c7-4c0ed5330709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:49.114472 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edc08f-fadb-457e-98c7-4c0ed5330709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:49.114739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edc08f-fadb-457e-98c7-4c0ed5330709 admin admin] PATH_INFO: `/v3/projects/de844237a161446cafb2f36f3c160831` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:49.116172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edc08f-fadb-457e-98c7-4c0ed5330709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de844237a161446cafb2f36f3c160831)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:49.118361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edc08f-fadb-457e-98c7-4c0ed5330709 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:49.282505 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ce0cf40b-3529-4d26-947c-3df56bd636ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7114c6162164a3d983522844cb34903', 'request_id': 'req-ce0cf40b-3529-4d26-947c-3df56bd636ab'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:49.297543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ce0cf40b-3529-4d26-947c-3df56bd636ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7114c6162164a3d983522844cb34903', 'request_id': 'req-ce0cf40b-3529-4d26-947c-3df56bd636ab'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:49.377542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c9edc08f-fadb-457e-98c7-4c0ed5330709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de844237a161446cafb2f36f3c160831', 'request_id': 'req-c9edc08f-fadb-457e-98c7-4c0ed5330709'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:49.381031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ce0cf40b-3529-4d26-947c-3df56bd636ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7114c6162164a3d983522844cb34903', 'request_id': 'req-ce0cf40b-3529-4d26-947c-3df56bd636ab'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:49.388737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c9edc08f-fadb-457e-98c7-4c0ed5330709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de844237a161446cafb2f36f3c160831', 'request_id': 'req-c9edc08f-fadb-457e-98c7-4c0ed5330709'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:49.397627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c9edc08f-fadb-457e-98c7-4c0ed5330709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de844237a161446cafb2f36f3c160831', 'request_id': 'req-c9edc08f-fadb-457e-98c7-4c0ed5330709'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:49.406257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ce0cf40b-3529-4d26-947c-3df56bd636ab admin admin] The token cache is being invalidate because project d7114c6162164a3d983522844cb34903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:40:49.406257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ce0cf40b-3529-4d26-947c-3df56bd636ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:49.411050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ce0cf40b-3529-4d26-947c-3df56bd636ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:49.415894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 858/1708] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:40:48 2022] DELETE /identity/v3/projects/d7114c6162164a3d983522844cb34903 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:49.421053 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a63aa-d319-48e5-a4c1-3955c658c3ab None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:49.421421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a63aa-d319-48e5-a4c1-3955c658c3ab None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:49.421748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a63aa-d319-48e5-a4c1-3955c658c3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:49.524642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c9edc08f-fadb-457e-98c7-4c0ed5330709 admin admin] The token cache is being invalidate because project de844237a161446cafb2f36f3c160831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:40:49.525581 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c9edc08f-fadb-457e-98c7-4c0ed5330709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:49.527074 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c9edc08f-fadb-457e-98c7-4c0ed5330709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:49.530653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 851/1709] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:40:49 2022] DELETE /identity/v3/projects/de844237a161446cafb2f36f3c160831 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:49.532089 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24419bf2-9b77-40f9-95f4-9519aaff3b39 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:49.532326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24419bf2-9b77-40f9-95f4-9519aaff3b39 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:49.532656 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24419bf2-9b77-40f9-95f4-9519aaff3b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:49.552783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-f87a63aa-d319-48e5-a4c1-3955c658c3ab None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:49.558523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f87a63aa-d319-48e5-a4c1-3955c658c3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:49.600626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:49.616670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-24419bf2-9b77-40f9-95f4-9519aaff3b39 None None] MFA Rules not processed for user `da324489014b4ed7adb3529702cd5e78`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:49.619288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-24419bf2-9b77-40f9-95f4-9519aaff3b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:49.740113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 859/1710] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:49.748287 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ca6c7-6487-44bd-b182-39690e675c99 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:49.748572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ca6c7-6487-44bd-b182-39690e675c99 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:49.748843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ca6c7-6487-44bd-b182-39690e675c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:49.806293 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 852/1711] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:49.811509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71ecdb-6849-4893-9ab0-ab8c564d2589 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:49.812012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71ecdb-6849-4893-9ab0-ab8c564d2589 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:49.815209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71ecdb-6849-4893-9ab0-ab8c564d2589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:49.846125 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-6b2ca6c7-6487-44bd-b182-39690e675c99 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:49.848570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6b2ca6c7-6487-44bd-b182-39690e675c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:49.885129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3e71ecdb-6849-4893-9ab0-ab8c564d2589 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:49.894535 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 860/1712] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:49.902556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e1e35-87ae-43a3-9cff-0879c569d38f None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:49.902798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e1e35-87ae-43a3-9cff-0879c569d38f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:49.903075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e1e35-87ae-43a3-9cff-0879c569d38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:49.930466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3e71ecdb-6849-4893-9ab0-ab8c564d2589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:49.975536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-123e1e35-87ae-43a3-9cff-0879c569d38f None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:49.986319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-123e1e35-87ae-43a3-9cff-0879c569d38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:49.991076 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 853/1713] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:49.995461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71ecdb-6849-4893-9ab0-ab8c564d2589 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:50.003442 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3e71ecdb-6849-4893-9ab0-ab8c564d2589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:50.016795 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 861/1714] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:50.017869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e1e35-87ae-43a3-9cff-0879c569d38f None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:50.039199 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71ecdb-6849-4893-9ab0-ab8c564d2589 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:50.040040 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e1e35-87ae-43a3-9cff-0879c569d38f None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:50.043903 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf9a97-01d3-4f7d-bb57-5e9829aa263c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:50.044654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf9a97-01d3-4f7d-bb57-5e9829aa263c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:50.045017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf9a97-01d3-4f7d-bb57-5e9829aa263c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:50.045730 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf9a97-01d3-4f7d-bb57-5e9829aa263c admin admin] PATH_INFO: `/v3/users/84c64e31a3464748bfd9a3f562670ff2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:50.047786 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf9a97-01d3-4f7d-bb57-5e9829aa263c admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c64e31a3464748bfd9a3f562670ff2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:50.051045 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf9a97-01d3-4f7d-bb57-5e9829aa263c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:50.051948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b639250-1e89-4326-ae53-1f1c6c68d434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:50.052647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639250-1e89-4326-ae53-1f1c6c68d434 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:50.053102 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639250-1e89-4326-ae53-1f1c6c68d434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:50.055277 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639250-1e89-4326-ae53-1f1c6c68d434 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:50.056229 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b639250-1e89-4326-ae53-1f1c6c68d434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:40:50.056681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b639250-1e89-4326-ae53-1f1c6c68d434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:50.059864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b639250-1e89-4326-ae53-1f1c6c68d434 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:50.097886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 862/1715] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:40:50.104299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b639250-1e89-4326-ae53-1f1c6c68d434 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:50.123088 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b639250-1e89-4326-ae53-1f1c6c68d434 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:50.130649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0ae62-12d1-45a8-bae1-af04cc9d533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:50.131801 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0ae62-12d1-45a8-bae1-af04cc9d533f admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:50.134031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0ae62-12d1-45a8-bae1-af04cc9d533f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:50.134466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0ae62-12d1-45a8-bae1-af04cc9d533f admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:50.135745 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0ae62-12d1-45a8-bae1-af04cc9d533f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:40:50.136214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0ae62-12d1-45a8-bae1-af04cc9d533f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:50.140011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0ae62-12d1-45a8-bae1-af04cc9d533f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:50.192219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 863/1716] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:40:50.193412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0ae62-12d1-45a8-bae1-af04cc9d533f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:50.219851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0ae62-12d1-45a8-bae1-af04cc9d533f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:50.267371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713faa94-5f92-48df-8d34-1bc2d777ff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:50.273910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713faa94-5f92-48df-8d34-1bc2d777ff6d admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:50.274291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713faa94-5f92-48df-8d34-1bc2d777ff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:50.274576 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713faa94-5f92-48df-8d34-1bc2d777ff6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:50.279946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713faa94-5f92-48df-8d34-1bc2d777ff6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:50.284495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713faa94-5f92-48df-8d34-1bc2d777ff6d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:50.377591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-09bf9a97-01d3-4f7d-bb57-5e9829aa263c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c64e31a3464748bfd9a3f562670ff2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:50.394936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-09bf9a97-01d3-4f7d-bb57-5e9829aa263c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c64e31a3464748bfd9a3f562670ff2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:50.424385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 864/1717] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:50 2022] POST /identity/v3/projects => generated 357 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:50.425294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713faa94-5f92-48df-8d34-1bc2d777ff6d admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:50.440268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-09bf9a97-01d3-4f7d-bb57-5e9829aa263c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c64e31a3464748bfd9a3f562670ff2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:50.535175 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-09bf9a97-01d3-4f7d-bb57-5e9829aa263c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c64e31a3464748bfd9a3f562670ff2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:50.537749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-09bf9a97-01d3-4f7d-bb57-5e9829aa263c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c64e31a3464748bfd9a3f562670ff2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:50.558970 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 854/1718] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:40:49 2022] DELETE /identity/v3/users/84c64e31a3464748bfd9a3f562670ff2 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:50.562377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf9a97-01d3-4f7d-bb57-5e9829aa263c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:50.564738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713faa94-5f92-48df-8d34-1bc2d777ff6d admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:50.565646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-09bf9a97-01d3-4f7d-bb57-5e9829aa263c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:50.687595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf9a97-01d3-4f7d-bb57-5e9829aa263c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:50.705971 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa600ef-f501-4e5b-a88b-3702dc080985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:50.707103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa600ef-f501-4e5b-a88b-3702dc080985 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:50.707729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa600ef-f501-4e5b-a88b-3702dc080985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:50.708179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa600ef-f501-4e5b-a88b-3702dc080985 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:50.709667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa600ef-f501-4e5b-a88b-3702dc080985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:50.711873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52308bb-875d-4e20-b15a-a94dc4e02a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:50.712372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52308bb-875d-4e20-b15a-a94dc4e02a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:50.712655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52308bb-875d-4e20-b15a-a94dc4e02a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:50.712935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52308bb-875d-4e20-b15a-a94dc4e02a54 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:50.713647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52308bb-875d-4e20-b15a-a94dc4e02a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:50.714519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa600ef-f501-4e5b-a88b-3702dc080985 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:50.724675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52308bb-875d-4e20-b15a-a94dc4e02a54 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:50.835334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:50.843509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 855/1719] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:50 2022] POST /identity/v3/users => generated 279 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:50.847362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 865/1720] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:50 2022] POST /identity/v3/projects => generated 363 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:50.848296 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa600ef-f501-4e5b-a88b-3702dc080985 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:50.849519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00128dda-8d5a-4767-bec9-4ff738ef0b4a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:50.850046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00128dda-8d5a-4767-bec9-4ff738ef0b4a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:50.852509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00128dda-8d5a-4767-bec9-4ff738ef0b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:50.915583 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-00128dda-8d5a-4767-bec9-4ff738ef0b4a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:50.922480 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-00128dda-8d5a-4767-bec9-4ff738ef0b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:50.980027 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa600ef-f501-4e5b-a88b-3702dc080985 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:50.991539 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ec50c-8f35-4092-ab2a-46a9f27bc24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:50.993321 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ec50c-8f35-4092-ab2a-46a9f27bc24f admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:50.996099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ec50c-8f35-4092-ab2a-46a9f27bc24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:50.996099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ec50c-8f35-4092-ab2a-46a9f27bc24f admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:50.996099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ec50c-8f35-4092-ab2a-46a9f27bc24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:50.998010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ec50c-8f35-4092-ab2a-46a9f27bc24f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:51.030205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 866/1721] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:51.031348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ec50c-8f35-4092-ab2a-46a9f27bc24f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:51.034478 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f93ec50c-8f35-4092-ab2a-46a9f27bc24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:51.076654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:51.100173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 856/1722] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:51.101525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00128dda-8d5a-4767-bec9-4ff738ef0b4a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:51.104630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ec50c-8f35-4092-ab2a-46a9f27bc24f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:51.115633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee675b9a-2690-417d-bf9f-28bf97a42f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:51.117121 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee675b9a-2690-417d-bf9f-28bf97a42f29 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:51.117621 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee675b9a-2690-417d-bf9f-28bf97a42f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:51.118269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee675b9a-2690-417d-bf9f-28bf97a42f29 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:51.118565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee675b9a-2690-417d-bf9f-28bf97a42f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:51.121421 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00128dda-8d5a-4767-bec9-4ff738ef0b4a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:51.126940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee675b9a-2690-417d-bf9f-28bf97a42f29 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:51.127387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ec368-532c-4f2a-a983-0c38653545fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:51.128215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ec368-532c-4f2a-a983-0c38653545fa admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:51.128632 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ec368-532c-4f2a-a983-0c38653545fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:51.129063 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ec368-532c-4f2a-a983-0c38653545fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:51.130497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ec368-532c-4f2a-a983-0c38653545fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:51.134140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ec368-532c-4f2a-a983-0c38653545fa admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:51.159556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 857/1723] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:51.161966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ec368-532c-4f2a-a983-0c38653545fa admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:51.168339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a39ec368-532c-4f2a-a983-0c38653545fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:51.238792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ec368-532c-4f2a-a983-0c38653545fa admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:51.243247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc10f-12b4-469c-919a-6800fc3ff6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:51.243937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc10f-12b4-469c-919a-6800fc3ff6ae service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:51.244289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc10f-12b4-469c-919a-6800fc3ff6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:51.244574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc10f-12b4-469c-919a-6800fc3ff6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:51.254366 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbc10f-12b4-469c-919a-6800fc3ff6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:51.255914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbc10f-12b4-469c-919a-6800fc3ff6ae service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:51.267358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 858/1724] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:51.268735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc10f-12b4-469c-919a-6800fc3ff6ae service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:51.281431 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc10f-12b4-469c-919a-6800fc3ff6ae service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:51.287695 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fece59-bfbb-4002-9137-cb01d99f9441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:51.289066 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fece59-bfbb-4002-9137-cb01d99f9441 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:51.289794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fece59-bfbb-4002-9137-cb01d99f9441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:51.290385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fece59-bfbb-4002-9137-cb01d99f9441 admin admin] PATH_INFO: `/v3/projects/f7d508865800430ca98571c00e5ad4f0/users/e90a10adc35e45e1898f9d6ee2e1d568/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:51.311458 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fece59-bfbb-4002-9137-cb01d99f9441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d508865800430ca98571c00e5ad4f0, user_id=e90a10adc35e45e1898f9d6ee2e1d568, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:51.315653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fece59-bfbb-4002-9137-cb01d99f9441 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:51.506501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 859/1725] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:51 2022] PUT /identity/v3/projects/f7d508865800430ca98571c00e5ad4f0/users/e90a10adc35e45e1898f9d6ee2e1d568/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:51.508523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 867/1726] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:51 2022] POST /identity/v3/users => generated 282 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:51.518654 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fece59-bfbb-4002-9137-cb01d99f9441 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:51.519790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e2d7e-e057-4cd2-87fa-842fd634d258 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:51.520979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e2d7e-e057-4cd2-87fa-842fd634d258 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:51.520979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e2d7e-e057-4cd2-87fa-842fd634d258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:51.657442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-d74e2d7e-e057-4cd2-87fa-842fd634d258 None None] MFA Rules not processed for user `e90a10adc35e45e1898f9d6ee2e1d568`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:51.662967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d74e2d7e-e057-4cd2-87fa-842fd634d258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:51.829960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fece59-bfbb-4002-9137-cb01d99f9441 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:51.866067 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd3a12-8652-4960-bfcb-eafd686377e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:51.866067 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd3a12-8652-4960-bfcb-eafd686377e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:51.866067 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd3a12-8652-4960-bfcb-eafd686377e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:51.866067 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd3a12-8652-4960-bfcb-eafd686377e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:51.866525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd3a12-8652-4960-bfcb-eafd686377e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:51.866525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd3a12-8652-4960-bfcb-eafd686377e8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:51.934719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 860/1727] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:51.938516 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd3a12-8652-4960-bfcb-eafd686377e8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:51.952590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 868/1728] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:51.956515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e2d7e-e057-4cd2-87fa-842fd634d258 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:51.971749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:51.983280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd3a12-8652-4960-bfcb-eafd686377e8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:51.993329 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e2d7e-e057-4cd2-87fa-842fd634d258 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:52.002586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b77a0-a2f0-42d4-868e-c155da7824e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:52.003461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b77a0-a2f0-42d4-868e-c155da7824e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:52.003901 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b77a0-a2f0-42d4-868e-c155da7824e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:52.004407 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b77a0-a2f0-42d4-868e-c155da7824e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:52.005246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b77a0-a2f0-42d4-868e-c155da7824e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:52.007254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b77a0-a2f0-42d4-868e-c155da7824e1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:52.013451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19f621-8fea-4386-8220-fbeb9992055e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:52.014406 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19f621-8fea-4386-8220-fbeb9992055e admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:52.017743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19f621-8fea-4386-8220-fbeb9992055e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:52.018396 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19f621-8fea-4386-8220-fbeb9992055e admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:52.019739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19f621-8fea-4386-8220-fbeb9992055e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:52.023408 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 861/1729] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:52.027584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b77a0-a2f0-42d4-868e-c155da7824e1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:52.049771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19f621-8fea-4386-8220-fbeb9992055e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:52.093200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b77a0-a2f0-42d4-868e-c155da7824e1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:52.099084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bc2bf-849f-47eb-a2b1-365f6fc1f536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:52.100038 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc2bf-849f-47eb-a2b1-365f6fc1f536 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:52.101913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc2bf-849f-47eb-a2b1-365f6fc1f536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:52.102482 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc2bf-849f-47eb-a2b1-365f6fc1f536 admin admin] PATH_INFO: `/v3/projects/19853bfc57c742d3af3c8940920805bd/users/bc455645ec304a5996f11863cc439e7a/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:54.340886 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bc2bf-849f-47eb-a2b1-365f6fc1f536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19853bfc57c742d3af3c8940920805bd, user_id=bc455645ec304a5996f11863cc439e7a, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:54.340886 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bc2bf-849f-47eb-a2b1-365f6fc1f536 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:54.345961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 869/1730] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:51 2022] POST /identity/v3/projects => generated 357 bytes in 2325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:54.345961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19f621-8fea-4386-8220-fbeb9992055e admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:54.366015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19f621-8fea-4386-8220-fbeb9992055e admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:54.374009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c44a7-9929-431f-826d-f57692e52b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:54.375052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c44a7-9929-431f-826d-f57692e52b0f admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:54.375052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c44a7-9929-431f-826d-f57692e52b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:54.375281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c44a7-9929-431f-826d-f57692e52b0f admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:54.375956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c44a7-9929-431f-826d-f57692e52b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:54.383700 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c44a7-9929-431f-826d-f57692e52b0f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:54.418542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 862/1731] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:52 2022] PUT /identity/v3/projects/19853bfc57c742d3af3c8940920805bd/users/bc455645ec304a5996f11863cc439e7a/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 2390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:54.419084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bc2bf-849f-47eb-a2b1-365f6fc1f536 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:54.422361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-478bc2bf-849f-47eb-a2b1-365f6fc1f536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:54.525932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 870/1732] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:54 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:40:54.526440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bc2bf-849f-47eb-a2b1-365f6fc1f536 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:54.527841 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142ea7e-a30b-4120-b393-0b770f462a2b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:54.528608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142ea7e-a30b-4120-b393-0b770f462a2b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:54.529044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142ea7e-a30b-4120-b393-0b770f462a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:54.548210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:54.548210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:54.548210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:54.548210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] PATH_INFO: `/v3/projects/45b6393084504128ba74522101d7237a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:54.548570 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b6393084504128ba74522101d7237a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:54.548570 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:54.581609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-a142ea7e-a30b-4120-b393-0b770f462a2b None None] MFA Rules not processed for user `bc455645ec304a5996f11863cc439e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:54.582862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a142ea7e-a30b-4120-b393-0b770f462a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:54.691494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b6393084504128ba74522101d7237a', 'request_id': 'req-34e93b71-0552-411e-96ec-2712433e1219'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:54.698804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b6393084504128ba74522101d7237a', 'request_id': 'req-34e93b71-0552-411e-96ec-2712433e1219'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:54.704251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 871/1733] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:54.705666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142ea7e-a30b-4120-b393-0b770f462a2b None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:54.716013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142ea7e-a30b-4120-b393-0b770f462a2b None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:54.716805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b6393084504128ba74522101d7237a', 'request_id': 'req-34e93b71-0552-411e-96ec-2712433e1219'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:54.775700 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034bc3c-c6b7-4f5b-bafd-6bb3f46ae959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:54.776543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034bc3c-c6b7-4f5b-bafd-6bb3f46ae959 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:54.776824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034bc3c-c6b7-4f5b-bafd-6bb3f46ae959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:54.777127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034bc3c-c6b7-4f5b-bafd-6bb3f46ae959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:54.777873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034bc3c-c6b7-4f5b-bafd-6bb3f46ae959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:54.779575 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034bc3c-c6b7-4f5b-bafd-6bb3f46ae959 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:54.795024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 872/1734] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:54.795024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81bed5-8913-478b-a694-ebbc22791c77 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:54.795024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81bed5-8913-478b-a694-ebbc22791c77 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:54.795024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81bed5-8913-478b-a694-ebbc22791c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:54.812766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] The token cache is being invalidate because project 45b6393084504128ba74522101d7237a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:40:54.813463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:54.814234 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:40:54.815938 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-7c81bed5-8913-478b-a694-ebbc22791c77 None None] MFA Rules not processed for user `c70f2ce21e9b49ffb3564873e09397e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:54.817170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 863/1735] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:40:54 2022] DELETE /identity/v3/projects/45b6393084504128ba74522101d7237a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:54.817301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7c81bed5-8913-478b-a694-ebbc22791c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:54.817688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:54.820466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:54.836326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e93b71-0552-411e-96ec-2712433e1219 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:54.841938 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c26659-3eb5-457f-a0f7-c5301bb8490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:54.842705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c26659-3eb5-457f-a0f7-c5301bb8490e admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:54.842986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c26659-3eb5-457f-a0f7-c5301bb8490e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:54.843254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c26659-3eb5-457f-a0f7-c5301bb8490e admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:54.843895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c26659-3eb5-457f-a0f7-c5301bb8490e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:54.846016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c26659-3eb5-457f-a0f7-c5301bb8490e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:54.880685 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 873/1736] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:54.881594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81bed5-8913-478b-a694-ebbc22791c77 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:54.882882 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7c81bed5-8913-478b-a694-ebbc22791c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:54.899885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81bed5-8913-478b-a694-ebbc22791c77 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:54.905884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed48385-aa0f-4826-b347-b07f754f838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:54.906594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed48385-aa0f-4826-b347-b07f754f838a admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:54.906865 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed48385-aa0f-4826-b347-b07f754f838a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:54.907132 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed48385-aa0f-4826-b347-b07f754f838a admin admin] PATH_INFO: `/v3/projects/44aafc94610d467da456b14c8031a231/users/9143f7b8f5784484bd8452e3bfe7f83e/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:54.924934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed48385-aa0f-4826-b347-b07f754f838a admin admin] RBAC: Authorizing `identity:create_grant(project_id=44aafc94610d467da456b14c8031a231, user_id=9143f7b8f5784484bd8452e3bfe7f83e, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:54.927734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed48385-aa0f-4826-b347-b07f754f838a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:55.017229 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 864/1737] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:54 2022] POST /identity/v3/projects => generated 361 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:55.018863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df83e-956e-46c6-8a48-2f0ba5377dbe None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:55.019274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df83e-956e-46c6-8a48-2f0ba5377dbe None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:55.024578 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df83e-956e-46c6-8a48-2f0ba5377dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:55.036099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 874/1738] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:54 2022] PUT /identity/v3/projects/44aafc94610d467da456b14c8031a231/users/9143f7b8f5784484bd8452e3bfe7f83e/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:55.048380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed48385-aa0f-4826-b347-b07f754f838a admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:55.061358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f90df83e-956e-46c6-8a48-2f0ba5377dbe None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:55.062933 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f90df83e-956e-46c6-8a48-2f0ba5377dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:55.109858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:55.147977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed48385-aa0f-4826-b347-b07f754f838a admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:55.159110 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 865/1739] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:55.159322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbebcd-7720-4fbd-944f-2b946f7d0526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:55.159455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90df83e-956e-46c6-8a48-2f0ba5377dbe None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:55.159547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbebcd-7720-4fbd-944f-2b946f7d0526 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:55.159547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbebcd-7720-4fbd-944f-2b946f7d0526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:55.159547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbebcd-7720-4fbd-944f-2b946f7d0526 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:55.159547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbebcd-7720-4fbd-944f-2b946f7d0526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:55.159547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbebcd-7720-4fbd-944f-2b946f7d0526 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:55.167419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90df83e-956e-46c6-8a48-2f0ba5377dbe None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:55.178446 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06ee67-3db4-4070-bb25-d4543126017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:55.179275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06ee67-3db4-4070-bb25-d4543126017b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:55.179723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06ee67-3db4-4070-bb25-d4543126017b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:55.179723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06ee67-3db4-4070-bb25-d4543126017b admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:55.180559 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06ee67-3db4-4070-bb25-d4543126017b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:55.182659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06ee67-3db4-4070-bb25-d4543126017b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:55.201695 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 866/1740] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:55.201883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc393177-7ddf-4bde-ac25-4d00a93b6c5a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:55.202551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc393177-7ddf-4bde-ac25-4d00a93b6c5a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:55.202675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc393177-7ddf-4bde-ac25-4d00a93b6c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:55.243960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bc393177-7ddf-4bde-ac25-4d00a93b6c5a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:55.247684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bc393177-7ddf-4bde-ac25-4d00a93b6c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:55.267741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 867/1741] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:55.268797 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 875/1742] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:55 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:55.272468 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc393177-7ddf-4bde-ac25-4d00a93b6c5a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:55.273867 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbebcd-7720-4fbd-944f-2b946f7d0526 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:55.294839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc393177-7ddf-4bde-ac25-4d00a93b6c5a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:55.307430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dd1cf-c687-4e6a-87f1-be83eb4ad214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:55.307638 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbebcd-7720-4fbd-944f-2b946f7d0526 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:55.308461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd1cf-c687-4e6a-87f1-be83eb4ad214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:55.309046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd1cf-c687-4e6a-87f1-be83eb4ad214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:55.309469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd1cf-c687-4e6a-87f1-be83eb4ad214 admin admin] PATH_INFO: `/v3/projects/44aafc94610d467da456b14c8031a231/users/9143f7b8f5784484bd8452e3bfe7f83e/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:55.322304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dd1cf-c687-4e6a-87f1-be83eb4ad214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44aafc94610d467da456b14c8031a231, user_id=9143f7b8f5784484bd8452e3bfe7f83e, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:55.330980 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dd1cf-c687-4e6a-87f1-be83eb4ad214 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:55.332479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674e579-2576-444f-9d55-ff41691dc231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:55.334919 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674e579-2576-444f-9d55-ff41691dc231 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:55.339299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674e579-2576-444f-9d55-ff41691dc231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:55.339299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674e579-2576-444f-9d55-ff41691dc231 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:55.339299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674e579-2576-444f-9d55-ff41691dc231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:40:55.339299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674e579-2576-444f-9d55-ff41691dc231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:55.346076 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674e579-2576-444f-9d55-ff41691dc231 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:55.404362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 876/1743] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:40:55.405512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674e579-2576-444f-9d55-ff41691dc231 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:55.409489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 868/1744] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:55 2022] PUT /identity/v3/projects/44aafc94610d467da456b14c8031a231/users/9143f7b8f5784484bd8452e3bfe7f83e/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:55.410680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dd1cf-c687-4e6a-87f1-be83eb4ad214 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:55.421693 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674e579-2576-444f-9d55-ff41691dc231 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:55.515866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284a9c6-b43d-4796-b922-adc4a22896a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:55.516491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284a9c6-b43d-4796-b922-adc4a22896a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:55.516769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284a9c6-b43d-4796-b922-adc4a22896a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:55.517348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284a9c6-b43d-4796-b922-adc4a22896a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:55.518724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284a9c6-b43d-4796-b922-adc4a22896a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:55.520561 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284a9c6-b43d-4796-b922-adc4a22896a6 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:55.542475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 877/1745] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:55.542475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed698bb-48a2-4c19-995f-dea16c206f4a None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:55.542475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed698bb-48a2-4c19-995f-dea16c206f4a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:55.542475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed698bb-48a2-4c19-995f-dea16c206f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:55.584610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dd1cf-c687-4e6a-87f1-be83eb4ad214 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:55.596466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c66d67-b7fe-42eb-b854-457776b56367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:55.597127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c66d67-b7fe-42eb-b854-457776b56367 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:55.597412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c66d67-b7fe-42eb-b854-457776b56367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:55.597731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c66d67-b7fe-42eb-b854-457776b56367 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:55.598422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c66d67-b7fe-42eb-b854-457776b56367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:55.602611 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c66d67-b7fe-42eb-b854-457776b56367 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:55.624638 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-8ed698bb-48a2-4c19-995f-dea16c206f4a None None] MFA Rules not processed for user `9143f7b8f5784484bd8452e3bfe7f83e`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:55.625983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8ed698bb-48a2-4c19-995f-dea16c206f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:55.791870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 869/1746] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:55 2022] POST /identity/v3/projects => generated 373 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:55.793012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c66d67-b7fe-42eb-b854-457776b56367 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:55.817418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 878/1747] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:55 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:55.818278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed698bb-48a2-4c19-995f-dea16c206f4a None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:55.838976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed698bb-48a2-4c19-995f-dea16c206f4a None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:55.963137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c66d67-b7fe-42eb-b854-457776b56367 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:55.967950 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a279e-87f4-48af-8259-46cee5d592d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:55.968909 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a279e-87f4-48af-8259-46cee5d592d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:55.969287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a279e-87f4-48af-8259-46cee5d592d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:55.969571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a279e-87f4-48af-8259-46cee5d592d9 admin admin] PATH_INFO: `/v3/projects/7ec1ee29c4d64fc8b66b4b5d55119391/users/9614c347d75149d6a8fba7714ba5c5ea/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:55.973879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23920a8-aa52-4602-8739-2af110225dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:55.974458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23920a8-aa52-4602-8739-2af110225dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:55.975982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23920a8-aa52-4602-8739-2af110225dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:55.976883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23920a8-aa52-4602-8739-2af110225dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:55.980003 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23920a8-aa52-4602-8739-2af110225dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:55.982921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23920a8-aa52-4602-8739-2af110225dc5 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:56.020398 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a279e-87f4-48af-8259-46cee5d592d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec1ee29c4d64fc8b66b4b5d55119391, user_id=9614c347d75149d6a8fba7714ba5c5ea, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:56.026985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a279e-87f4-48af-8259-46cee5d592d9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:56.087204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 879/1748] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:55 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:56.088358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23920a8-aa52-4602-8739-2af110225dc5 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:56.090214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a23920a8-aa52-4602-8739-2af110225dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:56.146320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 870/1749] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:55 2022] PUT /identity/v3/projects/7ec1ee29c4d64fc8b66b4b5d55119391/users/9614c347d75149d6a8fba7714ba5c5ea/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:56.146320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7655728-115c-42b6-af06-9073cef8f784 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:56.146320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7655728-115c-42b6-af06-9073cef8f784 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:56.146320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7655728-115c-42b6-af06-9073cef8f784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:56.183081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b7655728-115c-42b6-af06-9073cef8f784 None None] MFA Rules not processed for user `811bb431ddbb42638f909ebf6d921536`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:56.183519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23920a8-aa52-4602-8739-2af110225dc5 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:56.184859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b7655728-115c-42b6-af06-9073cef8f784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:56.291097 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 871/1750] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:56.300806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7655728-115c-42b6-af06-9073cef8f784 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:56.334911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ae6b5-8d35-4db5-a5d6-5168dbf3bb92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:56.334911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ae6b5-8d35-4db5-a5d6-5168dbf3bb92 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:56.334911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ae6b5-8d35-4db5-a5d6-5168dbf3bb92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:56.334911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ae6b5-8d35-4db5-a5d6-5168dbf3bb92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:56.465971 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7655728-115c-42b6-af06-9073cef8f784 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:56.494094 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd8b0a-e7bd-4dbf-8326-5181616f5d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:56.497467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8b0a-e7bd-4dbf-8326-5181616f5d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:56.497770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8b0a-e7bd-4dbf-8326-5181616f5d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:56.498577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8b0a-e7bd-4dbf-8326-5181616f5d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:56.500026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd8b0a-e7bd-4dbf-8326-5181616f5d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:56.506368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd8b0a-e7bd-4dbf-8326-5181616f5d4a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:56.517289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ae6b5-8d35-4db5-a5d6-5168dbf3bb92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:56.519110 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ae6b5-8d35-4db5-a5d6-5168dbf3bb92 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:56.534268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 872/1751] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:56.536537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd8b0a-e7bd-4dbf-8326-5181616f5d4a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:56.546461 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 880/1752] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:56.561877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ae6b5-8d35-4db5-a5d6-5168dbf3bb92 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:56.579490 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd8b0a-e7bd-4dbf-8326-5181616f5d4a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:56.594717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1981172-866b-4478-a0de-f378a1ef5509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:56.596704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ae6b5-8d35-4db5-a5d6-5168dbf3bb92 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:56.597562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981172-866b-4478-a0de-f378a1ef5509 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:56.597562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981172-866b-4478-a0de-f378a1ef5509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:56.597761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981172-866b-4478-a0de-f378a1ef5509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:56.599584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1981172-866b-4478-a0de-f378a1ef5509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:56.603730 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1981172-866b-4478-a0de-f378a1ef5509 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:56.607701 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2146d-0617-446b-a33f-c2cf11477921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:56.608328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2146d-0617-446b-a33f-c2cf11477921 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:56.610739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2146d-0617-446b-a33f-c2cf11477921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:56.610739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2146d-0617-446b-a33f-c2cf11477921 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:56.613378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2146d-0617-446b-a33f-c2cf11477921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:56.618196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2146d-0617-446b-a33f-c2cf11477921 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:56.636577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 873/1753] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:56.638063 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1981172-866b-4478-a0de-f378a1ef5509 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:56.654987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 881/1754] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:56.656633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1981172-866b-4478-a0de-f378a1ef5509 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:56.658321 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2146d-0617-446b-a33f-c2cf11477921 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:56.675459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9c27d-5fd9-4750-8fc3-3e15a6bc1364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:56.676160 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9c27d-5fd9-4750-8fc3-3e15a6bc1364 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:56.684974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2146d-0617-446b-a33f-c2cf11477921 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:56.685218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9c27d-5fd9-4750-8fc3-3e15a6bc1364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:56.685635 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9c27d-5fd9-4750-8fc3-3e15a6bc1364 admin admin] PATH_INFO: `/v3/projects/7ec1ee29c4d64fc8b66b4b5d55119391/users/9614c347d75149d6a8fba7714ba5c5ea/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:56.690141 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9c27d-5fd9-4750-8fc3-3e15a6bc1364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec1ee29c4d64fc8b66b4b5d55119391, user_id=9614c347d75149d6a8fba7714ba5c5ea, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:56.699606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9c27d-5fd9-4750-8fc3-3e15a6bc1364 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:56.704361 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf401b-f1b4-459a-8b54-e4ce14f8464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:56.716266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf401b-f1b4-459a-8b54-e4ce14f8464c admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:56.716266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf401b-f1b4-459a-8b54-e4ce14f8464c admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:56.716266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf401b-f1b4-459a-8b54-e4ce14f8464c admin admin] PATH_INFO: `/v3/projects/0c01b73fb9354334a32fcdbe1ffc2399/users/097b6ec711db42caa26c57f24ec40921/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:56.769978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 874/1755] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:56 2022] PUT /identity/v3/projects/7ec1ee29c4d64fc8b66b4b5d55119391/users/9614c347d75149d6a8fba7714ba5c5ea/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:56.785719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadc4fd-8d61-4ff8-9506-a9681e63bf94 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:56.785719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadc4fd-8d61-4ff8-9506-a9681e63bf94 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:56.785719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadc4fd-8d61-4ff8-9506-a9681e63bf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:56.812983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf401b-f1b4-459a-8b54-e4ce14f8464c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c01b73fb9354334a32fcdbe1ffc2399, user_id=097b6ec711db42caa26c57f24ec40921, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:56.831347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf401b-f1b4-459a-8b54-e4ce14f8464c admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:56.901827 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0dadc4fd-8d61-4ff8-9506-a9681e63bf94 None None] MFA Rules not processed for user `9614c347d75149d6a8fba7714ba5c5ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:56.906732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0dadc4fd-8d61-4ff8-9506-a9681e63bf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:56.955078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 882/1756] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:56 2022] PUT /identity/v3/projects/0c01b73fb9354334a32fcdbe1ffc2399/users/097b6ec711db42caa26c57f24ec40921/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:40:56.974542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf401b-f1b4-459a-8b54-e4ce14f8464c admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:56.977456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-53bf401b-f1b4-459a-8b54-e4ce14f8464c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:57.144640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 875/1757] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:57.144640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a644cef-a003-43b4-a467-881eea00e462 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:57.144640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a644cef-a003-43b4-a467-881eea00e462 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:57.144640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a644cef-a003-43b4-a467-881eea00e462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:57.203463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf401b-f1b4-459a-8b54-e4ce14f8464c admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:57.213420 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0a644cef-a003-43b4-a467-881eea00e462 None None] MFA Rules not processed for user `097b6ec711db42caa26c57f24ec40921`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:57.215052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243903e-0819-4be1-bdbd-5c0850f57977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:57.215694 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243903e-0819-4be1-bdbd-5c0850f57977 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:57.216405 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0a644cef-a003-43b4-a467-881eea00e462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:57.221625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243903e-0819-4be1-bdbd-5c0850f57977 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:57.223263 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243903e-0819-4be1-bdbd-5c0850f57977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:57.228422 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6243903e-0819-4be1-bdbd-5c0850f57977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:57.406271 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243903e-0819-4be1-bdbd-5c0850f57977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:57.409119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243903e-0819-4be1-bdbd-5c0850f57977 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:57.435387 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 883/1758] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:40:57.437386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243903e-0819-4be1-bdbd-5c0850f57977 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:57.485049 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243903e-0819-4be1-bdbd-5c0850f57977 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:57.491591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 876/1759] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:57.496565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a644cef-a003-43b4-a467-881eea00e462 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:57.517868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479eeabe-e0cf-4468-8fd6-22d493b285fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:57.518743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479eeabe-e0cf-4468-8fd6-22d493b285fb service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:57.521780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479eeabe-e0cf-4468-8fd6-22d493b285fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:57.522094 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479eeabe-e0cf-4468-8fd6-22d493b285fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:57.677943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a644cef-a003-43b4-a467-881eea00e462 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:57.677943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8a483-43a4-4307-9adf-f52360072992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:57.677943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8a483-43a4-4307-9adf-f52360072992 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:57.677943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8a483-43a4-4307-9adf-f52360072992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:57.678968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8a483-43a4-4307-9adf-f52360072992 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:57.678968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8a483-43a4-4307-9adf-f52360072992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:57.678968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8a483-43a4-4307-9adf-f52360072992 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:57.679892 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479eeabe-e0cf-4468-8fd6-22d493b285fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:57.679892 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479eeabe-e0cf-4468-8fd6-22d493b285fb service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:57.689384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 884/1760] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:57.690861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dda07c-20f5-4bd6-bba2-14ed40ecc261 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:57.691251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dda07c-20f5-4bd6-bba2-14ed40ecc261 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:57.691629 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dda07c-20f5-4bd6-bba2-14ed40ecc261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:57.793082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-37dda07c-20f5-4bd6-bba2-14ed40ecc261 None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:57.798565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-37dda07c-20f5-4bd6-bba2-14ed40ecc261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:57.805044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 877/1761] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:40:57 2022] POST /identity/v3/projects => generated 371 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:40:57.807218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8a483-43a4-4307-9adf-f52360072992 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:57.914987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:57.919761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8a483-43a4-4307-9adf-f52360072992 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:57.924528 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 885/1762] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:40:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:57.925712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d208fea-4fba-4391-b710-177e840ad2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:57.927475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d208fea-4fba-4391-b710-177e840ad2ee admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:57.927871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d208fea-4fba-4391-b710-177e840ad2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:57.928259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d208fea-4fba-4391-b710-177e840ad2ee admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:57.929029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d208fea-4fba-4391-b710-177e840ad2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:57.931275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d208fea-4fba-4391-b710-177e840ad2ee admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:58.113394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 878/1763] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:40:57 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:40:58.117414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dda07c-20f5-4bd6-bba2-14ed40ecc261 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:58.149588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dda07c-20f5-4bd6-bba2-14ed40ecc261 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:58.159095 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b3ad3-c38b-40fc-ac33-44deb3781e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:58.159727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b3ad3-c38b-40fc-ac33-44deb3781e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:58.160000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b3ad3-c38b-40fc-ac33-44deb3781e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:58.160264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b3ad3-c38b-40fc-ac33-44deb3781e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:58.160915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b3ad3-c38b-40fc-ac33-44deb3781e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:58.162576 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b3ad3-c38b-40fc-ac33-44deb3781e73 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:58.193909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 886/1764] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:58.195992 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d208fea-4fba-4391-b710-177e840ad2ee admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:58.202136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b3ad3-c38b-40fc-ac33-44deb3781e73 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:58.212147 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d208fea-4fba-4391-b710-177e840ad2ee admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:58.225914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f275827-038e-4e10-8f5d-166fb85d2875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:58.228399 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275827-038e-4e10-8f5d-166fb85d2875 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:58.231337 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275827-038e-4e10-8f5d-166fb85d2875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:58.231879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275827-038e-4e10-8f5d-166fb85d2875 admin admin] PATH_INFO: `/v3/projects/8826d34dbfd54d0c9d0cc13363ca6789/users/a75e593169a04e34a265086d345101b2/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:58.275798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f275827-038e-4e10-8f5d-166fb85d2875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8826d34dbfd54d0c9d0cc13363ca6789, user_id=a75e593169a04e34a265086d345101b2, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:58.282546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f275827-038e-4e10-8f5d-166fb85d2875 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:58.298451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b3ad3-c38b-40fc-ac33-44deb3781e73 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:58.312059 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723dfb1-cc6f-4531-a17d-7671f5bc8c87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:58.314452 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723dfb1-cc6f-4531-a17d-7671f5bc8c87 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:58.318547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723dfb1-cc6f-4531-a17d-7671f5bc8c87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:58.319157 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723dfb1-cc6f-4531-a17d-7671f5bc8c87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:58.324541 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d723dfb1-cc6f-4531-a17d-7671f5bc8c87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:58.402253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 879/1765] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:58 2022] PUT /identity/v3/projects/8826d34dbfd54d0c9d0cc13363ca6789/users/a75e593169a04e34a265086d345101b2/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:58.403336 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f275827-038e-4e10-8f5d-166fb85d2875 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:58.486122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723dfb1-cc6f-4531-a17d-7671f5bc8c87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:58.487871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723dfb1-cc6f-4531-a17d-7671f5bc8c87 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:58.509916 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 887/1766] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:40:58.510729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723dfb1-cc6f-4531-a17d-7671f5bc8c87 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:58.513959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d723dfb1-cc6f-4531-a17d-7671f5bc8c87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:58.577803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f275827-038e-4e10-8f5d-166fb85d2875 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:58.598924 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b1cdc-113f-4fc7-b71d-5913e7d6b85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:58.599730 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b1cdc-113f-4fc7-b71d-5913e7d6b85b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:58.600427 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b1cdc-113f-4fc7-b71d-5913e7d6b85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:58.600876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b1cdc-113f-4fc7-b71d-5913e7d6b85b admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:58.602576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b1cdc-113f-4fc7-b71d-5913e7d6b85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:58.605889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b1cdc-113f-4fc7-b71d-5913e7d6b85b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:58.627215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 880/1767] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:40:58.632156 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b1cdc-113f-4fc7-b71d-5913e7d6b85b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:58.656055 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b1cdc-113f-4fc7-b71d-5913e7d6b85b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:58.665416 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0ab95-7555-4fbe-95c0-9b185a89ccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:58.666375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0ab95-7555-4fbe-95c0-9b185a89ccd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:58.666841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0ab95-7555-4fbe-95c0-9b185a89ccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:58.667230 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0ab95-7555-4fbe-95c0-9b185a89ccd2 admin admin] PATH_INFO: `/v3/projects/8826d34dbfd54d0c9d0cc13363ca6789/users/a75e593169a04e34a265086d345101b2/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:58.669799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0ab95-7555-4fbe-95c0-9b185a89ccd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8826d34dbfd54d0c9d0cc13363ca6789, user_id=a75e593169a04e34a265086d345101b2, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:58.673704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0ab95-7555-4fbe-95c0-9b185a89ccd2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:58.689560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 881/1768] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:40:58 2022] PUT /identity/v3/projects/8826d34dbfd54d0c9d0cc13363ca6789/users/a75e593169a04e34a265086d345101b2/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:40:58.704011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4b385-ae35-4be6-ab44-d09738703e09 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:58.704591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4b385-ae35-4be6-ab44-d09738703e09 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:58.705087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4b385-ae35-4be6-ab44-d09738703e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:58.773713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e7c4b385-ae35-4be6-ab44-d09738703e09 None None] MFA Rules not processed for user `a75e593169a04e34a265086d345101b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:58.775798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e7c4b385-ae35-4be6-ab44-d09738703e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:58.827657 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723dfb1-cc6f-4531-a17d-7671f5bc8c87 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:58.880968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 882/1769] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:40:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:40:58.883194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67fba2-b696-4148-895e-3ae57ffe098c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:58.883194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67fba2-b696-4148-895e-3ae57ffe098c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:58.883656 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67fba2-b696-4148-895e-3ae57ffe098c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:58.911099 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9a67fba2-b696-4148-895e-3ae57ffe098c None None] MFA Rules not processed for user `6469c8860be943168b67ea7fa28bf19d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:40:58.912556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9a67fba2-b696-4148-895e-3ae57ffe098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:58.954472 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:40:58.990060 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e05f5-60c8-4452-94f6-2d7418a69f68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:58.991537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e05f5-60c8-4452-94f6-2d7418a69f68 service swift] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:58.994370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e05f5-60c8-4452-94f6-2d7418a69f68 service swift] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:58.995247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e05f5-60c8-4452-94f6-2d7418a69f68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:59.000962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 883/1770] 10.222.0.61 () {58 vars in 1015 bytes} [Sat Sep 17 04:40:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:40:59.029301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67fba2-b696-4148-895e-3ae57ffe098c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:59.033639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9a67fba2-b696-4148-895e-3ae57ffe098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:40:59.045175 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67fba2-b696-4148-895e-3ae57ffe098c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:59.052251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f0afd-dd05-43f2-b286-042440b72bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:59.053012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f0afd-dd05-43f2-b286-042440b72bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:59.053395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f0afd-dd05-43f2-b286-042440b72bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:59.053725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f0afd-dd05-43f2-b286-042440b72bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:59.063458 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f0afd-dd05-43f2-b286-042440b72bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:59.065191 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f0afd-dd05-43f2-b286-042440b72bb3 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:59.089716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e05f5-60c8-4452-94f6-2d7418a69f68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:59.089819 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 884/1771] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:40:59.092884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e05f5-60c8-4452-94f6-2d7418a69f68 service swift] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:59.103882 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 888/1772] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:40:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 04:40:59.124781 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f0afd-dd05-43f2-b286-042440b72bb3 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:40:59.263296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f0afd-dd05-43f2-b286-042440b72bb3 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:40:59.269705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bde05-f7fa-49d6-8617-2d96b76b7067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:40:59.270699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bde05-f7fa-49d6-8617-2d96b76b7067 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:40:59.271483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bde05-f7fa-49d6-8617-2d96b76b7067 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:40:59.272019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bde05-f7fa-49d6-8617-2d96b76b7067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:40:59.301564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bde05-f7fa-49d6-8617-2d96b76b7067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:40:59.303333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bde05-f7fa-49d6-8617-2d96b76b7067 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:40:59.341512 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 885/1773] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:40:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:00.131155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:DELETE=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:01.539564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:01.923353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7aa55-771a-45cc-9575-2b5e4b4c74cc None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:01.923961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7aa55-771a-45cc-9575-2b5e4b4c74cc None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:01.924409 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7aa55-771a-45cc-9575-2b5e4b4c74cc None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:01.927159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 889/1774] 10.222.0.50 () {54 vars in 921 bytes} [Sat Sep 17 04:41:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:41:01.963115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9e3bc-7550-4e86-84a9-7fedd91c694b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:01.964715 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9e3bc-7550-4e86-84a9-7fedd91c694b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:01.966852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9e3bc-7550-4e86-84a9-7fedd91c694b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:02.057788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-39c9e3bc-7550-4e86-84a9-7fedd91c694b None None] MFA Rules not processed for user `eb70408fecfe41e0b2ea9a53c7ae0823`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:02.061381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-39c9e3bc-7550-4e86-84a9-7fedd91c694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:02.299856 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 886/1775] 10.222.0.50 () {58 vars in 1018 bytes} [Sat Sep 17 04:41:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:02.466433 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7aa55-771a-45cc-9575-2b5e4b4c74cc None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:02.468507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-44f7aa55-771a-45cc-9575-2b5e4b4c74cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:02.537401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7aa55-771a-45cc-9575-2b5e4b4c74cc None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:02.548307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fdbf2-a292-4c4a-9868-c45bc004e41b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:02.548307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fdbf2-a292-4c4a-9868-c45bc004e41b service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:02.548307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fdbf2-a292-4c4a-9868-c45bc004e41b service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:02.548307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fdbf2-a292-4c4a-9868-c45bc004e41b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:02.560717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fdbf2-a292-4c4a-9868-c45bc004e41b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:02.562662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fdbf2-a292-4c4a-9868-c45bc004e41b service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:02.632958 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 890/1776] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:03.572703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9e3bc-7550-4e86-84a9-7fedd91c694b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:03.776476 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9e3bc-7550-4e86-84a9-7fedd91c694b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:03.813363 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d4e48-fd01-45aa-b652-3f03b49e1ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:03.814305 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d4e48-fd01-45aa-b652-3f03b49e1ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:03.814748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d4e48-fd01-45aa-b652-3f03b49e1ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:03.815229 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d4e48-fd01-45aa-b652-3f03b49e1ae9 admin admin] PATH_INFO: `/v3/users/097b6ec711db42caa26c57f24ec40921` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:03.820421 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d4e48-fd01-45aa-b652-3f03b49e1ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=097b6ec711db42caa26c57f24ec40921)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:03.825934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d4e48-fd01-45aa-b652-3f03b49e1ae9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:03.858894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:03.986607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:04.087131 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d01d4e48-fd01-45aa-b652-3f03b49e1ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '097b6ec711db42caa26c57f24ec40921'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:04.108961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d01d4e48-fd01-45aa-b652-3f03b49e1ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '097b6ec711db42caa26c57f24ec40921'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:04.135574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d01d4e48-fd01-45aa-b652-3f03b49e1ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '097b6ec711db42caa26c57f24ec40921'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:04.234406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d01d4e48-fd01-45aa-b652-3f03b49e1ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '097b6ec711db42caa26c57f24ec40921'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:04.235062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d01d4e48-fd01-45aa-b652-3f03b49e1ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '097b6ec711db42caa26c57f24ec40921'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:04.246419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 887/1777] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:03 2022] DELETE /identity/v3/users/097b6ec711db42caa26c57f24ec40921 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:04.251015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d8ec6-2b29-4e94-8a9e-603c994cd1a3 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:04.251379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d8ec6-2b29-4e94-8a9e-603c994cd1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:04.252337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d8ec6-2b29-4e94-8a9e-603c994cd1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:04.286723 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-9d2d8ec6-2b29-4e94-8a9e-603c994cd1a3 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:04.289303 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9d2d8ec6-2b29-4e94-8a9e-603c994cd1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:04.425420 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 891/1778] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:04.802851 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a0199-7998-486c-a62a-5f2c15b44a41 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:04.803762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a0199-7998-486c-a62a-5f2c15b44a41 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:04.804262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a0199-7998-486c-a62a-5f2c15b44a41 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:04.806466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 888/1779] 10.222.0.50 () {54 vars in 921 bytes} [Sat Sep 17 04:41:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:41:04.812505 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c7104-7473-4877-87c6-4caba7a39979 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:04.812770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c7104-7473-4877-87c6-4caba7a39979 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:04.813071 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c7104-7473-4877-87c6-4caba7a39979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:04.818509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a0199-7998-486c-a62a-5f2c15b44a41 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:04.821396 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d52a0199-7998-486c-a62a-5f2c15b44a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:04.848529 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a0199-7998-486c-a62a-5f2c15b44a41 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:04.854211 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-f59c7104-7473-4877-87c6-4caba7a39979 None None] MFA Rules not processed for user `eb70408fecfe41e0b2ea9a53c7ae0823`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:04.855454 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f59c7104-7473-4877-87c6-4caba7a39979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:04.863317 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa1b6b-2800-4966-82e5-e8b4717c5c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:04.864257 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa1b6b-2800-4966-82e5-e8b4717c5c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:04.864720 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa1b6b-2800-4966-82e5-e8b4717c5c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:04.865193 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa1b6b-2800-4966-82e5-e8b4717c5c68 admin admin] PATH_INFO: `/v3/users/bc455645ec304a5996f11863cc439e7a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:04.867940 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa1b6b-2800-4966-82e5-e8b4717c5c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc455645ec304a5996f11863cc439e7a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:04.870177 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa1b6b-2800-4966-82e5-e8b4717c5c68 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:05.226419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 892/1780] 10.222.0.50 () {58 vars in 1018 bytes} [Sat Sep 17 04:41:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:05.226419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c7104-7473-4877-87c6-4caba7a39979 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:05.230817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f59c7104-7473-4877-87c6-4caba7a39979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:05.257905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4aa1b6b-2800-4966-82e5-e8b4717c5c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc455645ec304a5996f11863cc439e7a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:05.285978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:05.298414 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4aa1b6b-2800-4966-82e5-e8b4717c5c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc455645ec304a5996f11863cc439e7a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:05.333092 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4aa1b6b-2800-4966-82e5-e8b4717c5c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc455645ec304a5996f11863cc439e7a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:05.436578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c7104-7473-4877-87c6-4caba7a39979 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:05.452503 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4c560-9fb4-4faf-a2f9-86cdb8805728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:05.452503 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4c560-9fb4-4faf-a2f9-86cdb8805728 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:05.452503 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4c560-9fb4-4faf-a2f9-86cdb8805728 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:05.452503 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4c560-9fb4-4faf-a2f9-86cdb8805728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:05.454749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4aa1b6b-2800-4966-82e5-e8b4717c5c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc455645ec304a5996f11863cc439e7a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:05.455631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4aa1b6b-2800-4966-82e5-e8b4717c5c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc455645ec304a5996f11863cc439e7a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:05.463768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 889/1781] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:04 2022] DELETE /identity/v3/users/bc455645ec304a5996f11863cc439e7a => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:05.475836 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4c560-9fb4-4faf-a2f9-86cdb8805728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:05.477374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4c560-9fb4-4faf-a2f9-86cdb8805728 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:05.479499 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d53a2-d07d-416f-953a-2678fede2bca None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:05.479820 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d53a2-d07d-416f-953a-2678fede2bca None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:05.480182 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d53a2-d07d-416f-953a-2678fede2bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:05.501538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 893/1782] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:05.532844 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e51d53a2-d07d-416f-953a-2678fede2bca None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:05.534128 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e51d53a2-d07d-416f-953a-2678fede2bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:05.662911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4c560-9fb4-4faf-a2f9-86cdb8805728 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:05.665714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-86e4c560-9fb4-4faf-a2f9-86cdb8805728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:05.698295 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 890/1783] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:05.703402 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4c560-9fb4-4faf-a2f9-86cdb8805728 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:05.831605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d53a2-d07d-416f-953a-2678fede2bca None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:05.834364 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e51d53a2-d07d-416f-953a-2678fede2bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:06.009189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726a315-b99b-42a9-a035-afe9e82abadf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:06.012336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726a315-b99b-42a9-a035-afe9e82abadf service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:06.017921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726a315-b99b-42a9-a035-afe9e82abadf service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:06.017921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726a315-b99b-42a9-a035-afe9e82abadf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:06.027947 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c726a315-b99b-42a9-a035-afe9e82abadf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:06.034581 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d53a2-d07d-416f-953a-2678fede2bca None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:06.047858 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52408df-70e2-4a47-945d-193a9b9b6838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:06.048492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52408df-70e2-4a47-945d-193a9b9b6838 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:06.048979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52408df-70e2-4a47-945d-193a9b9b6838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:06.049380 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52408df-70e2-4a47-945d-193a9b9b6838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:06.055252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726a315-b99b-42a9-a035-afe9e82abadf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:06.065736 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726a315-b99b-42a9-a035-afe9e82abadf service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:06.078651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52408df-70e2-4a47-945d-193a9b9b6838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:06.080886 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52408df-70e2-4a47-945d-193a9b9b6838 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:06.091231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 894/1784] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:41:06.094340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:06.107715 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 891/1785] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:06.649244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:08.138411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726a315-b99b-42a9-a035-afe9e82abadf service nova] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:08.144808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c726a315-b99b-42a9-a035-afe9e82abadf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:08.191359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726a315-b99b-42a9-a035-afe9e82abadf service nova] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:08.204516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:08.210484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:08.210484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:08.210484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] PATH_INFO: `/v3/projects/0c01b73fb9354334a32fcdbe1ffc2399` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:08.210484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c01b73fb9354334a32fcdbe1ffc2399)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:08.215556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:08.355511 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c01b73fb9354334a32fcdbe1ffc2399', 'request_id': 'req-11af77b9-0738-45c5-8953-e9f52efce461'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:08.392734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c01b73fb9354334a32fcdbe1ffc2399', 'request_id': 'req-11af77b9-0738-45c5-8953-e9f52efce461'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:08.511481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c01b73fb9354334a32fcdbe1ffc2399', 'request_id': 'req-11af77b9-0738-45c5-8953-e9f52efce461'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:08.533579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] The token cache is being invalidate because project 0c01b73fb9354334a32fcdbe1ffc2399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:08.535519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:08.537754 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:08.542594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 895/1786] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:08 2022] DELETE /identity/v3/projects/0c01b73fb9354334a32fcdbe1ffc2399 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:08.544883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52408df-70e2-4a47-945d-193a9b9b6838 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:08.564538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:08.572588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52408df-70e2-4a47-945d-193a9b9b6838 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:08.598574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:08.600908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:08.836034 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d259965-813e-4af9-baeb-08c3bf16f5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:08.850270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d259965-813e-4af9-baeb-08c3bf16f5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:08.855651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d259965-813e-4af9-baeb-08c3bf16f5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:08.855651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d259965-813e-4af9-baeb-08c3bf16f5e5 admin admin] PATH_INFO: `/v3/users/a75e593169a04e34a265086d345101b2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:08.855651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d259965-813e-4af9-baeb-08c3bf16f5e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75e593169a04e34a265086d345101b2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:08.857695 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af77b9-0738-45c5-8953-e9f52efce461 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:08.860971 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d259965-813e-4af9-baeb-08c3bf16f5e5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:08.874507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:08.879034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:08.884363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:08.884363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:08.884363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] PATH_INFO: `/v3/projects/19853bfc57c742d3af3c8940920805bd` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:08.886617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19853bfc57c742d3af3c8940920805bd)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:08.898014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:09.096943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19853bfc57c742d3af3c8940920805bd', 'request_id': 'req-d1fc4613-e520-4ecd-b26b-43961f15f880'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:09.110205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19853bfc57c742d3af3c8940920805bd', 'request_id': 'req-d1fc4613-e520-4ecd-b26b-43961f15f880'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:09.110572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3d259965-813e-4af9-baeb-08c3bf16f5e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75e593169a04e34a265086d345101b2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:09.135990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3d259965-813e-4af9-baeb-08c3bf16f5e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75e593169a04e34a265086d345101b2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:09.184199 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3d259965-813e-4af9-baeb-08c3bf16f5e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75e593169a04e34a265086d345101b2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:09.211203 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19853bfc57c742d3af3c8940920805bd', 'request_id': 'req-d1fc4613-e520-4ecd-b26b-43961f15f880'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:09.244246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] The token cache is being invalidate because project 19853bfc57c742d3af3c8940920805bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:09.244768 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:09.246806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:09.251386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 896/1787] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:08 2022] DELETE /identity/v3/projects/19853bfc57c742d3af3c8940920805bd => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:09.263929 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:09.266096 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:09.307993 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3d259965-813e-4af9-baeb-08c3bf16f5e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75e593169a04e34a265086d345101b2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:09.308747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3d259965-813e-4af9-baeb-08c3bf16f5e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75e593169a04e34a265086d345101b2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:09.317356 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 892/1788] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:08 2022] DELETE /identity/v3/users/a75e593169a04e34a265086d345101b2 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:09.410543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc4613-e520-4ecd-b26b-43961f15f880 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:09.506266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb12640-aaf1-455d-9979-bf4b61ec7341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:09.510315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb12640-aaf1-455d-9979-bf4b61ec7341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:09.510315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb12640-aaf1-455d-9979-bf4b61ec7341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:09.510315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb12640-aaf1-455d-9979-bf4b61ec7341 admin admin] PATH_INFO: `/v3/users/9614c347d75149d6a8fba7714ba5c5ea` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:09.510315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb12640-aaf1-455d-9979-bf4b61ec7341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9614c347d75149d6a8fba7714ba5c5ea)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:09.514179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb12640-aaf1-455d-9979-bf4b61ec7341 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:09.517701 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:09.770063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4eb12640-aaf1-455d-9979-bf4b61ec7341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9614c347d75149d6a8fba7714ba5c5ea'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:09.952824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4eb12640-aaf1-455d-9979-bf4b61ec7341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9614c347d75149d6a8fba7714ba5c5ea'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:09.974977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4eb12640-aaf1-455d-9979-bf4b61ec7341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9614c347d75149d6a8fba7714ba5c5ea'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:09.974977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4eb12640-aaf1-455d-9979-bf4b61ec7341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9614c347d75149d6a8fba7714ba5c5ea'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:09.982232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4eb12640-aaf1-455d-9979-bf4b61ec7341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9614c347d75149d6a8fba7714ba5c5ea'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:10.004810 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 897/1789] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:09 2022] DELETE /identity/v3/users/9614c347d75149d6a8fba7714ba5c5ea => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:10.348608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:10.776356 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:10.815177 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d259965-813e-4af9-baeb-08c3bf16f5e5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:10.816808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3d259965-813e-4af9-baeb-08c3bf16f5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:10.839740 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d259965-813e-4af9-baeb-08c3bf16f5e5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:11.099262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda163e9-c66f-46f3-8476-f3ae365f51ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:11.099606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda163e9-c66f-46f3-8476-f3ae365f51ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:11.100588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda163e9-c66f-46f3-8476-f3ae365f51ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:11.101056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda163e9-c66f-46f3-8476-f3ae365f51ec admin admin] PATH_INFO: `/v3/projects/8826d34dbfd54d0c9d0cc13363ca6789` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:11.102520 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda163e9-c66f-46f3-8476-f3ae365f51ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8826d34dbfd54d0c9d0cc13363ca6789)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:11.109667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda163e9-c66f-46f3-8476-f3ae365f51ec admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:11.255491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb12640-aaf1-455d-9979-bf4b61ec7341 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:11.261319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-4eb12640-aaf1-455d-9979-bf4b61ec7341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:11.282360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb12640-aaf1-455d-9979-bf4b61ec7341 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:11.305344 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bda163e9-c66f-46f3-8476-f3ae365f51ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8826d34dbfd54d0c9d0cc13363ca6789', 'request_id': 'req-bda163e9-c66f-46f3-8476-f3ae365f51ec'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:11.325741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bda163e9-c66f-46f3-8476-f3ae365f51ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8826d34dbfd54d0c9d0cc13363ca6789', 'request_id': 'req-bda163e9-c66f-46f3-8476-f3ae365f51ec'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:11.368436 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bda163e9-c66f-46f3-8476-f3ae365f51ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8826d34dbfd54d0c9d0cc13363ca6789', 'request_id': 'req-bda163e9-c66f-46f3-8476-f3ae365f51ec'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:11.423023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919b09c-97c2-4180-9cb1-3c62feb3b759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:11.423897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919b09c-97c2-4180-9cb1-3c62feb3b759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:11.424210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919b09c-97c2-4180-9cb1-3c62feb3b759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:11.424513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919b09c-97c2-4180-9cb1-3c62feb3b759 admin admin] PATH_INFO: `/v3/projects/7ec1ee29c4d64fc8b66b4b5d55119391` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:11.426330 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919b09c-97c2-4180-9cb1-3c62feb3b759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec1ee29c4d64fc8b66b4b5d55119391)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:11.429408 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919b09c-97c2-4180-9cb1-3c62feb3b759 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:11.810955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bda163e9-c66f-46f3-8476-f3ae365f51ec admin admin] The token cache is being invalidate because project 8826d34dbfd54d0c9d0cc13363ca6789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:11.811442 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bda163e9-c66f-46f3-8476-f3ae365f51ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:11.812375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bda163e9-c66f-46f3-8476-f3ae365f51ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:11.814349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 893/1790] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:10 2022] DELETE /identity/v3/projects/8826d34dbfd54d0c9d0cc13363ca6789 => generated 0 bytes in 1000 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:11.822767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea4ea3-66be-46ee-bb1b-6f087d6f1e97 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:11.823240 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea4ea3-66be-46ee-bb1b-6f087d6f1e97 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:11.831444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea4ea3-66be-46ee-bb1b-6f087d6f1e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:11.871789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-25ea4ea3-66be-46ee-bb1b-6f087d6f1e97 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:11.873713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-25ea4ea3-66be-46ee-bb1b-6f087d6f1e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:11.903178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 894/1791] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:11.904808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32e3dd-7bd0-4b08-9cd1-8946e9952971 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:11.905119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32e3dd-7bd0-4b08-9cd1-8946e9952971 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:11.905685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32e3dd-7bd0-4b08-9cd1-8946e9952971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:11.941830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0f32e3dd-7bd0-4b08-9cd1-8946e9952971 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:11.943453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0f32e3dd-7bd0-4b08-9cd1-8946e9952971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:11.989654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e919b09c-97c2-4180-9cb1-3c62feb3b759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec1ee29c4d64fc8b66b4b5d55119391', 'request_id': 'req-e919b09c-97c2-4180-9cb1-3c62feb3b759'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:12.007802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e919b09c-97c2-4180-9cb1-3c62feb3b759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec1ee29c4d64fc8b66b4b5d55119391', 'request_id': 'req-e919b09c-97c2-4180-9cb1-3c62feb3b759'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:12.075785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 895/1792] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:12.080208 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32e3dd-7bd0-4b08-9cd1-8946e9952971 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:12.084220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e919b09c-97c2-4180-9cb1-3c62feb3b759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec1ee29c4d64fc8b66b4b5d55119391', 'request_id': 'req-e919b09c-97c2-4180-9cb1-3c62feb3b759'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:12.102766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32e3dd-7bd0-4b08-9cd1-8946e9952971 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:12.112550 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8dff8-dc3f-48b6-915a-200eaa4ed4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:12.113246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8dff8-dc3f-48b6-915a-200eaa4ed4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.113557 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8dff8-dc3f-48b6-915a-200eaa4ed4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.114074 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8dff8-dc3f-48b6-915a-200eaa4ed4d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.114816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8dff8-dc3f-48b6-915a-200eaa4ed4d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:12.115334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8dff8-dc3f-48b6-915a-200eaa4ed4d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:12.117504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8dff8-dc3f-48b6-915a-200eaa4ed4d6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:12.118501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e919b09c-97c2-4180-9cb1-3c62feb3b759 admin admin] The token cache is being invalidate because project 7ec1ee29c4d64fc8b66b4b5d55119391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:12.118821 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e919b09c-97c2-4180-9cb1-3c62feb3b759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:12.119699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e919b09c-97c2-4180-9cb1-3c62feb3b759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:12.121800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 898/1793] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:11 2022] DELETE /identity/v3/projects/7ec1ee29c4d64fc8b66b4b5d55119391 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:12.126695 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973574f8-8377-4a5f-a5ee-00fcc1fe88f9 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.126985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973574f8-8377-4a5f-a5ee-00fcc1fe88f9 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.127259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973574f8-8377-4a5f-a5ee-00fcc1fe88f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.138418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 896/1794] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:41:12.139411 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8dff8-dc3f-48b6-915a-200eaa4ed4d6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:12.143171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f7c8dff8-dc3f-48b6-915a-200eaa4ed4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:12.175009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-973574f8-8377-4a5f-a5ee-00fcc1fe88f9 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:12.177738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8dff8-dc3f-48b6-915a-200eaa4ed4d6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:12.180526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-973574f8-8377-4a5f-a5ee-00fcc1fe88f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:12.187613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb107113-7007-42e0-a4f6-0e8440aa7dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:12.189282 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb107113-7007-42e0-a4f6-0e8440aa7dcb admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.190396 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb107113-7007-42e0-a4f6-0e8440aa7dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.190396 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb107113-7007-42e0-a4f6-0e8440aa7dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.191548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb107113-7007-42e0-a4f6-0e8440aa7dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:12.194334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb107113-7007-42e0-a4f6-0e8440aa7dcb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:12.201541 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 899/1795] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:12.212904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8449e0f-ae24-40e2-a792-cfe1be6790ec None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.213282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8449e0f-ae24-40e2-a792-cfe1be6790ec None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.213636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8449e0f-ae24-40e2-a792-cfe1be6790ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.242484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-d8449e0f-ae24-40e2-a792-cfe1be6790ec None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:12.244177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d8449e0f-ae24-40e2-a792-cfe1be6790ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:12.261789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 900/1796] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:12.263327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8449e0f-ae24-40e2-a792-cfe1be6790ec None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:12.280210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8449e0f-ae24-40e2-a792-cfe1be6790ec None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:12.286592 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f657a-a0b4-465f-8acc-8f147f203423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:12.288550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f657a-a0b4-465f-8acc-8f147f203423 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.289214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f657a-a0b4-465f-8acc-8f147f203423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.289636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f657a-a0b4-465f-8acc-8f147f203423 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.290814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f657a-a0b4-465f-8acc-8f147f203423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:12.291620 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f657a-a0b4-465f-8acc-8f147f203423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:12.293711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f657a-a0b4-465f-8acc-8f147f203423 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:12.309502 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 901/1797] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:41:12.318700 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f657a-a0b4-465f-8acc-8f147f203423 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:12.326066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f657a-a0b4-465f-8acc-8f147f203423 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:12.332529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f4f2-c965-4137-b78f-94d7c2a1c962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:12.333489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f4f2-c965-4137-b78f-94d7c2a1c962 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.333958 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f4f2-c965-4137-b78f-94d7c2a1c962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.335723 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f4f2-c965-4137-b78f-94d7c2a1c962 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.337461 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0f4f2-c965-4137-b78f-94d7c2a1c962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:12.344954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:12.352590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0f4f2-c965-4137-b78f-94d7c2a1c962 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:12.416502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 897/1798] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:12 2022] POST /identity/v3/projects => generated 407 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:12.418742 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb107113-7007-42e0-a4f6-0e8440aa7dcb admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:12.491066 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb107113-7007-42e0-a4f6-0e8440aa7dcb admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:12.496031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77b9bb-82d6-4b7f-943b-8371a6c0dc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:12.496643 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77b9bb-82d6-4b7f-943b-8371a6c0dc86 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.496924 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77b9bb-82d6-4b7f-943b-8371a6c0dc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.497218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77b9bb-82d6-4b7f-943b-8371a6c0dc86 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.497918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77b9bb-82d6-4b7f-943b-8371a6c0dc86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:12.499941 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77b9bb-82d6-4b7f-943b-8371a6c0dc86 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:12.517539 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 902/1799] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:12 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:12.519538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f4f2-c965-4137-b78f-94d7c2a1c962 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:12.582915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f4f2-c965-4137-b78f-94d7c2a1c962 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:12.588181 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d43ab-e6fe-4a1d-bdb8-ea7264b45c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:12.588783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d43ab-e6fe-4a1d-bdb8-ea7264b45c57 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.589088 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d43ab-e6fe-4a1d-bdb8-ea7264b45c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.589361 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d43ab-e6fe-4a1d-bdb8-ea7264b45c57 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.590004 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d43ab-e6fe-4a1d-bdb8-ea7264b45c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:12.592045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d43ab-e6fe-4a1d-bdb8-ea7264b45c57 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:12.606297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 898/1800] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:12 2022] POST /identity/v3/users => generated 304 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:12.610081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77b9bb-82d6-4b7f-943b-8371a6c0dc86 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:12.620045 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77b9bb-82d6-4b7f-943b-8371a6c0dc86 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:12.625532 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf7018-1506-444c-ab2f-8be63ff848f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:12.625532 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7018-1506-444c-ab2f-8be63ff848f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.625532 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7018-1506-444c-ab2f-8be63ff848f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.625831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7018-1506-444c-ab2f-8be63ff848f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.626437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf7018-1506-444c-ab2f-8be63ff848f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:12.628012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf7018-1506-444c-ab2f-8be63ff848f4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:12.638809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 899/1801] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:12.642183 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf7018-1506-444c-ab2f-8be63ff848f4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:12.653397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf7018-1506-444c-ab2f-8be63ff848f4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:12.658246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefd0d0-a8c4-4c2d-a1d0-e43457de3092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:12.658805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd0d0-a8c4-4c2d-a1d0-e43457de3092 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.659081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd0d0-a8c4-4c2d-a1d0-e43457de3092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.659346 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd0d0-a8c4-4c2d-a1d0-e43457de3092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.659958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefd0d0-a8c4-4c2d-a1d0-e43457de3092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:12.661534 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefd0d0-a8c4-4c2d-a1d0-e43457de3092 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:12.675269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 900/1802] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:12.680418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 903/1803] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:12 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:12.681112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefd0d0-a8c4-4c2d-a1d0-e43457de3092 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:12.682052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d43ab-e6fe-4a1d-bdb8-ea7264b45c57 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:12.689260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefd0d0-a8c4-4c2d-a1d0-e43457de3092 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:12.691715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d43ab-e6fe-4a1d-bdb8-ea7264b45c57 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:12.694459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ea5c4-df96-4cc5-85ee-025153266a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:12.695097 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ea5c4-df96-4cc5-85ee-025153266a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.695374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ea5c4-df96-4cc5-85ee-025153266a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.695670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ea5c4-df96-4cc5-85ee-025153266a47 admin admin] PATH_INFO: `/v3/projects/33a5f91dbb1d4a94b5ea20f0bf5703fc/users/996e81645e674b528039abcfcafcd936/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.697243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce12a3-920f-4c75-81e7-7c6abf03cba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:12.697845 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce12a3-920f-4c75-81e7-7c6abf03cba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.698121 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce12a3-920f-4c75-81e7-7c6abf03cba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.698391 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce12a3-920f-4c75-81e7-7c6abf03cba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.699186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce12a3-920f-4c75-81e7-7c6abf03cba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:12.700810 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce12a3-920f-4c75-81e7-7c6abf03cba3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:12.710946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ea5c4-df96-4cc5-85ee-025153266a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a5f91dbb1d4a94b5ea20f0bf5703fc, user_id=996e81645e674b528039abcfcafcd936, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:12.711688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 904/1804] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:12.714750 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ea5c4-df96-4cc5-85ee-025153266a47 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:12.715574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce12a3-920f-4c75-81e7-7c6abf03cba3 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:12.726361 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce12a3-920f-4c75-81e7-7c6abf03cba3 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:12.731490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bedd4d-7423-4f0d-9f26-8f03d5f76207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:12.732073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bedd4d-7423-4f0d-9f26-8f03d5f76207 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.732350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bedd4d-7423-4f0d-9f26-8f03d5f76207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.732625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bedd4d-7423-4f0d-9f26-8f03d5f76207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.733340 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bedd4d-7423-4f0d-9f26-8f03d5f76207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:12.738346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bedd4d-7423-4f0d-9f26-8f03d5f76207 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:12.750802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 905/1805] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:12.751728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bedd4d-7423-4f0d-9f26-8f03d5f76207 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:12.764305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bedd4d-7423-4f0d-9f26-8f03d5f76207 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:12.769891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771cd04-5089-4f3f-8eab-ac1a1e395d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:12.770762 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771cd04-5089-4f3f-8eab-ac1a1e395d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.770972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771cd04-5089-4f3f-8eab-ac1a1e395d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.771309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771cd04-5089-4f3f-8eab-ac1a1e395d26 admin admin] PATH_INFO: `/v3/projects/4c4a1363a09640979e83b8921ed33d72/users/54fb5b13d8494f08ac72b5ee6fa5a6a4/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.793838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771cd04-5089-4f3f-8eab-ac1a1e395d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4a1363a09640979e83b8921ed33d72, user_id=54fb5b13d8494f08ac72b5ee6fa5a6a4, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:12.797784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771cd04-5089-4f3f-8eab-ac1a1e395d26 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:12.821749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 901/1806] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:12 2022] PUT /identity/v3/projects/33a5f91dbb1d4a94b5ea20f0bf5703fc/users/996e81645e674b528039abcfcafcd936/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:12.833403 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac88a3-750d-46ac-bb19-4c3ed7a1ae7c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.833959 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac88a3-750d-46ac-bb19-4c3ed7a1ae7c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.834232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac88a3-750d-46ac-bb19-4c3ed7a1ae7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.864705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:12.869633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e6ac88a3-750d-46ac-bb19-4c3ed7a1ae7c None None] MFA Rules not processed for user `996e81645e674b528039abcfcafcd936`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:12.871045 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e6ac88a3-750d-46ac-bb19-4c3ed7a1ae7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:12.899401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 906/1807] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:12 2022] PUT /identity/v3/projects/4c4a1363a09640979e83b8921ed33d72/users/54fb5b13d8494f08ac72b5ee6fa5a6a4/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:12.909921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a9cb3-8089-4d82-ad33-e250c0a88c8a None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:12.910367 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a9cb3-8089-4d82-ad33-e250c0a88c8a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:12.910723 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a9cb3-8089-4d82-ad33-e250c0a88c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:12.948167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-f50a9cb3-8089-4d82-ad33-e250c0a88c8a None None] MFA Rules not processed for user `54fb5b13d8494f08ac72b5ee6fa5a6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:12.949521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f50a9cb3-8089-4d82-ad33-e250c0a88c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:12.973770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 902/1808] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:12 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:12.982198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac88a3-750d-46ac-bb19-4c3ed7a1ae7c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:13.023385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 907/1809] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:13.024825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a9cb3-8089-4d82-ad33-e250c0a88c8a None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:13.044844 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac88a3-750d-46ac-bb19-4c3ed7a1ae7c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:13.086499 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a9cb3-8089-4d82-ad33-e250c0a88c8a None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:13.092263 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f936f70-0257-494b-bb93-def5b2059fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:13.093337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f936f70-0257-494b-bb93-def5b2059fec admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:13.093931 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f936f70-0257-494b-bb93-def5b2059fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:13.094268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f936f70-0257-494b-bb93-def5b2059fec admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:13.095298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f936f70-0257-494b-bb93-def5b2059fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:13.098041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f936f70-0257-494b-bb93-def5b2059fec admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:13.102535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572f50e-d44b-4ab3-8c30-3d04b5de23b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:13.103160 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572f50e-d44b-4ab3-8c30-3d04b5de23b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:13.103438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572f50e-d44b-4ab3-8c30-3d04b5de23b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:13.103796 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572f50e-d44b-4ab3-8c30-3d04b5de23b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:13.104345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572f50e-d44b-4ab3-8c30-3d04b5de23b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:13.106364 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572f50e-d44b-4ab3-8c30-3d04b5de23b4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:13.222784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 908/1810] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:13 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:13.229760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f936f70-0257-494b-bb93-def5b2059fec admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:13.258359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 903/1811] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:12 2022] POST /identity/v3/projects => generated 409 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:13.270909 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572f50e-d44b-4ab3-8c30-3d04b5de23b4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:13.306471 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f936f70-0257-494b-bb93-def5b2059fec admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:13.351504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572f50e-d44b-4ab3-8c30-3d04b5de23b4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:13.358600 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de83ae9-9339-4cbe-91f3-d2e66d4460eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:13.359220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de83ae9-9339-4cbe-91f3-d2e66d4460eb admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:13.359500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de83ae9-9339-4cbe-91f3-d2e66d4460eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:13.359775 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de83ae9-9339-4cbe-91f3-d2e66d4460eb admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:13.360439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de83ae9-9339-4cbe-91f3-d2e66d4460eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:13.363106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de83ae9-9339-4cbe-91f3-d2e66d4460eb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:13.383794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c2d3a-b472-471a-b55c-cb94fa376bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:13.384440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c2d3a-b472-471a-b55c-cb94fa376bdb admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:13.384704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c2d3a-b472-471a-b55c-cb94fa376bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:13.384979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c2d3a-b472-471a-b55c-cb94fa376bdb admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:13.385719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c2d3a-b472-471a-b55c-cb94fa376bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:13.387641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c2d3a-b472-471a-b55c-cb94fa376bdb admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:13.508116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 904/1812] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:13 2022] POST /identity/v3/users => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:13.509739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de83ae9-9339-4cbe-91f3-d2e66d4460eb admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:13.512432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 909/1813] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:13 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:13.517188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c2d3a-b472-471a-b55c-cb94fa376bdb admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:13.526014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de83ae9-9339-4cbe-91f3-d2e66d4460eb admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:13.535345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c657a-e2f0-473d-8a7c-40938e05b381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:13.535971 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c657a-e2f0-473d-8a7c-40938e05b381 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:13.536378 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c657a-e2f0-473d-8a7c-40938e05b381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:13.536675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c657a-e2f0-473d-8a7c-40938e05b381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:13.538093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c657a-e2f0-473d-8a7c-40938e05b381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:13.540391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c657a-e2f0-473d-8a7c-40938e05b381 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:13.543680 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c2d3a-b472-471a-b55c-cb94fa376bdb admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:13.559952 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b40ba2-d924-4e98-b311-d9cc8e4331b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:13.559952 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b40ba2-d924-4e98-b311-d9cc8e4331b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:13.559952 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b40ba2-d924-4e98-b311-d9cc8e4331b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:13.559952 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b40ba2-d924-4e98-b311-d9cc8e4331b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:13.560326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b40ba2-d924-4e98-b311-d9cc8e4331b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:13.561148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 905/1814] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:13.566427 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c657a-e2f0-473d-8a7c-40938e05b381 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:13.566652 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b40ba2-d924-4e98-b311-d9cc8e4331b3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:13.576256 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c657a-e2f0-473d-8a7c-40938e05b381 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:13.582484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f497f-837c-4544-a7d1-fe346cd69f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:13.583173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f497f-837c-4544-a7d1-fe346cd69f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:13.583454 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f497f-837c-4544-a7d1-fe346cd69f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:13.583726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f497f-837c-4544-a7d1-fe346cd69f04 admin admin] PATH_INFO: `/v3/projects/a9486cd9c50a42c591da6637cd159a87/users/f7463affa6b14c0487ecbda519a7e617/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:13.593449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 910/1815] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:13.597540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b40ba2-d924-4e98-b311-d9cc8e4331b3 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:13.606607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f497f-837c-4544-a7d1-fe346cd69f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9486cd9c50a42c591da6637cd159a87, user_id=f7463affa6b14c0487ecbda519a7e617, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:13.609469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f497f-837c-4544-a7d1-fe346cd69f04 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:13.617225 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b40ba2-d924-4e98-b311-d9cc8e4331b3 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:13.623102 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24313f-7ff8-400c-877a-e82116055243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:13.624023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24313f-7ff8-400c-877a-e82116055243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:13.624376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24313f-7ff8-400c-877a-e82116055243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:13.624724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24313f-7ff8-400c-877a-e82116055243 admin admin] PATH_INFO: `/v3/projects/550e2fc451f84842a3c0a6631ccf2aed/users/e869aa64731b448fb3e0b602a417fb2e/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:13.644946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24313f-7ff8-400c-877a-e82116055243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=550e2fc451f84842a3c0a6631ccf2aed, user_id=e869aa64731b448fb3e0b602a417fb2e, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:13.648230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24313f-7ff8-400c-877a-e82116055243 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:13.696281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 906/1816] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:13 2022] PUT /identity/v3/projects/a9486cd9c50a42c591da6637cd159a87/users/f7463affa6b14c0487ecbda519a7e617/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:13.700189 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f497f-837c-4544-a7d1-fe346cd69f04 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:13.761524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f497f-837c-4544-a7d1-fe346cd69f04 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:13.773784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa862da-722f-46dd-8dcb-1e25a538fd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:13.773784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa862da-722f-46dd-8dcb-1e25a538fd7b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:13.773784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa862da-722f-46dd-8dcb-1e25a538fd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:13.773784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa862da-722f-46dd-8dcb-1e25a538fd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:13.774209 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 911/1817] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:13 2022] PUT /identity/v3/projects/550e2fc451f84842a3c0a6631ccf2aed/users/e869aa64731b448fb3e0b602a417fb2e/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:13.774321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa862da-722f-46dd-8dcb-1e25a538fd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:13.774321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa862da-722f-46dd-8dcb-1e25a538fd7b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:13.775428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24313f-7ff8-400c-877a-e82116055243 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:13.787465 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 907/1818] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:13.791720 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa862da-722f-46dd-8dcb-1e25a538fd7b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:13.801549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa862da-722f-46dd-8dcb-1e25a538fd7b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:13.844240 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24313f-7ff8-400c-877a-e82116055243 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:13.848947 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08a44e-af8e-411c-9980-750d645e76f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:13.850602 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08a44e-af8e-411c-9980-750d645e76f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:13.850602 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08a44e-af8e-411c-9980-750d645e76f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:13.850871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08a44e-af8e-411c-9980-750d645e76f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:13.851530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08a44e-af8e-411c-9980-750d645e76f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:13.853194 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08a44e-af8e-411c-9980-750d645e76f6 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:13.857838 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf281a-3e83-4b25-a028-0a518ac21de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:13.858519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf281a-3e83-4b25-a028-0a518ac21de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:13.858792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf281a-3e83-4b25-a028-0a518ac21de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:13.859059 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf281a-3e83-4b25-a028-0a518ac21de1 admin admin] PATH_INFO: `/v3/projects/a9486cd9c50a42c591da6637cd159a87/users/f7463affa6b14c0487ecbda519a7e617/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:13.861626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf281a-3e83-4b25-a028-0a518ac21de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9486cd9c50a42c591da6637cd159a87, user_id=f7463affa6b14c0487ecbda519a7e617, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:13.863124 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 912/1819] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:13.864271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf281a-3e83-4b25-a028-0a518ac21de1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:13.867392 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08a44e-af8e-411c-9980-750d645e76f6 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:13.875462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 908/1820] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:13 2022] PUT /identity/v3/projects/a9486cd9c50a42c591da6637cd159a87/users/f7463affa6b14c0487ecbda519a7e617/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:13.880864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08a44e-af8e-411c-9980-750d645e76f6 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:13.891640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a154b3-5f11-4ce4-b115-070096104693 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:13.891924 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a154b3-5f11-4ce4-b115-070096104693 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:13.892199 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a154b3-5f11-4ce4-b115-070096104693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:13.921153 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-03a154b3-5f11-4ce4-b115-070096104693 None None] MFA Rules not processed for user `f7463affa6b14c0487ecbda519a7e617`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:13.922372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-03a154b3-5f11-4ce4-b115-070096104693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:13.941677 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612123e-ebcc-4df4-8e1f-5847ec9931c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:13.942446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612123e-ebcc-4df4-8e1f-5847ec9931c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:13.942715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612123e-ebcc-4df4-8e1f-5847ec9931c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:13.942992 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612123e-ebcc-4df4-8e1f-5847ec9931c4 admin admin] PATH_INFO: `/v3/projects/550e2fc451f84842a3c0a6631ccf2aed/users/e869aa64731b448fb3e0b602a417fb2e/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:13.945644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612123e-ebcc-4df4-8e1f-5847ec9931c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=550e2fc451f84842a3c0a6631ccf2aed, user_id=e869aa64731b448fb3e0b602a417fb2e, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:13.948646 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612123e-ebcc-4df4-8e1f-5847ec9931c4 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:13.963905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 913/1821] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:13 2022] PUT /identity/v3/projects/550e2fc451f84842a3c0a6631ccf2aed/users/e869aa64731b448fb3e0b602a417fb2e/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:13.981669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1165a-86ba-4502-b9cf-f0438580be03 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:13.981954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1165a-86ba-4502-b9cf-f0438580be03 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:13.982422 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1165a-86ba-4502-b9cf-f0438580be03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:14.024790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 909/1822] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:13 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:14.035846 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-a9d1165a-86ba-4502-b9cf-f0438580be03 None None] MFA Rules not processed for user `e869aa64731b448fb3e0b602a417fb2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:14.037201 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a9d1165a-86ba-4502-b9cf-f0438580be03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:14.051717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:14.076664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a154b3-5f11-4ce4-b115-070096104693 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:14.078270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-03a154b3-5f11-4ce4-b115-070096104693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:14.146596 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 914/1823] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:14.160745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a154b3-5f11-4ce4-b115-070096104693 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:14.237635 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5187c8-c31e-4a83-8ebc-a6abd402fb29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:14.238124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5187c8-c31e-4a83-8ebc-a6abd402fb29 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:14.238407 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5187c8-c31e-4a83-8ebc-a6abd402fb29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:14.238701 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5187c8-c31e-4a83-8ebc-a6abd402fb29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:14.243430 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1165a-86ba-4502-b9cf-f0438580be03 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:14.244923 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a9d1165a-86ba-4502-b9cf-f0438580be03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:14.257066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1165a-86ba-4502-b9cf-f0438580be03 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:14.261648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64637ed2-24b4-4792-9e4e-55a663d06d1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:14.261648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637ed2-24b4-4792-9e4e-55a663d06d1f service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:14.261892 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637ed2-24b4-4792-9e4e-55a663d06d1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:14.262332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637ed2-24b4-4792-9e4e-55a663d06d1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:14.273251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64637ed2-24b4-4792-9e4e-55a663d06d1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:14.274917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64637ed2-24b4-4792-9e4e-55a663d06d1f service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:14.284884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 915/1824] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:41:14.304714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5187c8-c31e-4a83-8ebc-a6abd402fb29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:14.306598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5187c8-c31e-4a83-8ebc-a6abd402fb29 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:14.316533 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 910/1825] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:14 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:41:14.786475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64637ed2-24b4-4792-9e4e-55a663d06d1f service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:14.795823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64637ed2-24b4-4792-9e4e-55a663d06d1f service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:14.801855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba9c33-5de8-4de1-90bd-be873d79aa43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:14.802487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba9c33-5de8-4de1-90bd-be873d79aa43 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:14.802942 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba9c33-5de8-4de1-90bd-be873d79aa43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:14.804001 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba9c33-5de8-4de1-90bd-be873d79aa43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:14.870258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba9c33-5de8-4de1-90bd-be873d79aa43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:14.872145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba9c33-5de8-4de1-90bd-be873d79aa43 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:14.882197 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 916/1826] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:14 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:15.707234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:17.330646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:18.622412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5187c8-c31e-4a83-8ebc-a6abd402fb29 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:18.699246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5187c8-c31e-4a83-8ebc-a6abd402fb29 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:18.713351 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:18.717019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b1954-63db-4eb1-856c-4f307d892ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:18.717905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b1954-63db-4eb1-856c-4f307d892ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:18.718288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b1954-63db-4eb1-856c-4f307d892ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:18.718659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b1954-63db-4eb1-856c-4f307d892ddf admin admin] PATH_INFO: `/v3/users/54fb5b13d8494f08ac72b5ee6fa5a6a4` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:18.719936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b1954-63db-4eb1-856c-4f307d892ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=54fb5b13d8494f08ac72b5ee6fa5a6a4)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:18.725253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b1954-63db-4eb1-856c-4f307d892ddf admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:18.904167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c36b1954-63db-4eb1-856c-4f307d892ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fb5b13d8494f08ac72b5ee6fa5a6a4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:18.912964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c36b1954-63db-4eb1-856c-4f307d892ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fb5b13d8494f08ac72b5ee6fa5a6a4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:18.925910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c36b1954-63db-4eb1-856c-4f307d892ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fb5b13d8494f08ac72b5ee6fa5a6a4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:18.970945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:19.028107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c36b1954-63db-4eb1-856c-4f307d892ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fb5b13d8494f08ac72b5ee6fa5a6a4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:19.028891 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c36b1954-63db-4eb1-856c-4f307d892ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fb5b13d8494f08ac72b5ee6fa5a6a4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:19.038311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 911/1827] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:18 2022] DELETE /identity/v3/users/54fb5b13d8494f08ac72b5ee6fa5a6a4 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:19.040724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f133b36-16db-4518-aff8-7bd05bdaf35f None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:19.041225 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f133b36-16db-4518-aff8-7bd05bdaf35f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:19.041748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f133b36-16db-4518-aff8-7bd05bdaf35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:19.085255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-3f133b36-16db-4518-aff8-7bd05bdaf35f None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:19.086493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-3f133b36-16db-4518-aff8-7bd05bdaf35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:19.188934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 917/1828] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:19.203076 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b1954-63db-4eb1-856c-4f307d892ddf admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:19.205038 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c36b1954-63db-4eb1-856c-4f307d892ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:19.296109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b1954-63db-4eb1-856c-4f307d892ddf admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:19.310353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b5d2b-0ea9-4f94-b309-5fac8a48abbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:19.310992 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b5d2b-0ea9-4f94-b309-5fac8a48abbe service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:19.311277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b5d2b-0ea9-4f94-b309-5fac8a48abbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:19.311548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b5d2b-0ea9-4f94-b309-5fac8a48abbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:19.330943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b5d2b-0ea9-4f94-b309-5fac8a48abbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:19.333387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b5d2b-0ea9-4f94-b309-5fac8a48abbe service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:19.350484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 912/1829] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:19.990169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f133b36-16db-4518-aff8-7bd05bdaf35f None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:19.992764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-3f133b36-16db-4518-aff8-7bd05bdaf35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:20.007837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f133b36-16db-4518-aff8-7bd05bdaf35f None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:20.012763 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:20.013457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:20.013728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:20.013996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] PATH_INFO: `/v3/projects/4c4a1363a09640979e83b8921ed33d72` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:20.015136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4a1363a09640979e83b8921ed33d72)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:20.017150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:20.122046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4a1363a09640979e83b8921ed33d72', 'request_id': 'req-f579c6e9-2a3f-4a36-b45e-610fd1d01880'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:20.129301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4a1363a09640979e83b8921ed33d72', 'request_id': 'req-f579c6e9-2a3f-4a36-b45e-610fd1d01880'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:20.190805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4a1363a09640979e83b8921ed33d72', 'request_id': 'req-f579c6e9-2a3f-4a36-b45e-610fd1d01880'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:20.204240 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] The token cache is being invalidate because project 4c4a1363a09640979e83b8921ed33d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:20.204527 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:20.212739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:20.214285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 918/1830] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:19 2022] DELETE /identity/v3/projects/4c4a1363a09640979e83b8921ed33d72 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:20.223863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b5d2b-0ea9-4f94-b309-5fac8a48abbe service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:20.234997 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b5d2b-0ea9-4f94-b309-5fac8a48abbe service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:20.298480 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bc855-795f-4c93-824e-2e30fe4991cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:20.298480 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bc855-795f-4c93-824e-2e30fe4991cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:20.298480 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bc855-795f-4c93-824e-2e30fe4991cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:20.298747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bc855-795f-4c93-824e-2e30fe4991cf admin admin] PATH_INFO: `/v3/users/e869aa64731b448fb3e0b602a417fb2e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:20.299789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bc855-795f-4c93-824e-2e30fe4991cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e869aa64731b448fb3e0b602a417fb2e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:20.301792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bc855-795f-4c93-824e-2e30fe4991cf admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:20.481588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9d4bc855-795f-4c93-824e-2e30fe4991cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e869aa64731b448fb3e0b602a417fb2e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:20.491356 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9d4bc855-795f-4c93-824e-2e30fe4991cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e869aa64731b448fb3e0b602a417fb2e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:20.503134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9d4bc855-795f-4c93-824e-2e30fe4991cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e869aa64731b448fb3e0b602a417fb2e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:20.586719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9d4bc855-795f-4c93-824e-2e30fe4991cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e869aa64731b448fb3e0b602a417fb2e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:20.590567 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9d4bc855-795f-4c93-824e-2e30fe4991cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e869aa64731b448fb3e0b602a417fb2e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:20.593823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 913/1831] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:20 2022] DELETE /identity/v3/users/e869aa64731b448fb3e0b602a417fb2e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:20.780037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:21.174318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:21.181054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:21.187449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:21.204541 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579c6e9-2a3f-4a36-b45e-610fd1d01880 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:21.266505 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:21.267138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:21.267418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:21.267706 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6 admin admin] PATH_INFO: `/v3/projects/550e2fc451f84842a3c0a6631ccf2aed` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:21.269207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=550e2fc451f84842a3c0a6631ccf2aed)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:21.271582 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:21.478187 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '550e2fc451f84842a3c0a6631ccf2aed', 'request_id': 'req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:21.484487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '550e2fc451f84842a3c0a6631ccf2aed', 'request_id': 'req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:21.584895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '550e2fc451f84842a3c0a6631ccf2aed', 'request_id': 'req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:21.597062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6 admin admin] The token cache is being invalidate because project 550e2fc451f84842a3c0a6631ccf2aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:21.597358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:21.598090 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-6a1b75f9-0b78-4072-a0bb-f1654682b7d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:21.600373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 919/1832] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:21 2022] DELETE /identity/v3/projects/550e2fc451f84842a3c0a6631ccf2aed => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:21.609789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61165c-24c1-4736-aae4-6f36b8198217 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:21.609789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61165c-24c1-4736-aae4-6f36b8198217 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:21.609789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61165c-24c1-4736-aae4-6f36b8198217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:21.626857 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7d61165c-24c1-4736-aae4-6f36b8198217 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:21.628077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7d61165c-24c1-4736-aae4-6f36b8198217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:21.702077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 914/1833] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:21.709897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54528ae-ecc9-42d8-9056-24cdaff58842 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:21.711340 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54528ae-ecc9-42d8-9056-24cdaff58842 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:21.711702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54528ae-ecc9-42d8-9056-24cdaff58842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:21.732686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-a54528ae-ecc9-42d8-9056-24cdaff58842 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:21.733962 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a54528ae-ecc9-42d8-9056-24cdaff58842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:21.750234 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61165c-24c1-4736-aae4-6f36b8198217 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:21.754668 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 920/1834] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:21.763435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61165c-24c1-4736-aae4-6f36b8198217 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:21.777809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c7e3b-6798-4b23-aefe-0d2f9d338b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:21.778561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c7e3b-6798-4b23-aefe-0d2f9d338b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:21.778983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c7e3b-6798-4b23-aefe-0d2f9d338b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:21.779279 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c7e3b-6798-4b23-aefe-0d2f9d338b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:21.780162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c7e3b-6798-4b23-aefe-0d2f9d338b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:21.780757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c7e3b-6798-4b23-aefe-0d2f9d338b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:21.782609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c7e3b-6798-4b23-aefe-0d2f9d338b06 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:21.803356 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 915/1835] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:41:21.807855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54528ae-ecc9-42d8-9056-24cdaff58842 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:21.825736 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54528ae-ecc9-42d8-9056-24cdaff58842 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:21.828217 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb580ff5-8810-4535-b540-c587c6e8a879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:21.829451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580ff5-8810-4535-b540-c587c6e8a879 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:21.829795 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580ff5-8810-4535-b540-c587c6e8a879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:21.830278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580ff5-8810-4535-b540-c587c6e8a879 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:21.831034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb580ff5-8810-4535-b540-c587c6e8a879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:21.833163 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb580ff5-8810-4535-b540-c587c6e8a879 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:21.918406 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 921/1836] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:21 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:21.922632 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c7e3b-6798-4b23-aefe-0d2f9d338b06 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:21.932833 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c7e3b-6798-4b23-aefe-0d2f9d338b06 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:21.936184 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:21.990498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d04092-ab06-454e-8d78-7d874a8f95e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:21.990962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d04092-ab06-454e-8d78-7d874a8f95e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:21.991240 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d04092-ab06-454e-8d78-7d874a8f95e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:21.991510 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d04092-ab06-454e-8d78-7d874a8f95e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:21.992152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d04092-ab06-454e-8d78-7d874a8f95e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:21.994126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d04092-ab06-454e-8d78-7d874a8f95e6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:22.082663 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 916/1837] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:21 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:22.087470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb580ff5-8810-4535-b540-c587c6e8a879 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:22.102273 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59b5d4-15ef-458f-9d73-491a8f1433a6 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:22.102819 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59b5d4-15ef-458f-9d73-491a8f1433a6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:22.103259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59b5d4-15ef-458f-9d73-491a8f1433a6 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:22.103872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb580ff5-8810-4535-b540-c587c6e8a879 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:22.106960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 917/1838] 10.222.0.50 () {54 vars in 921 bytes} [Sat Sep 17 04:41:22 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:41:22.112840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e8a80-38dc-4dc5-8642-d8e4eb4a6b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:22.112840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e8a80-38dc-4dc5-8642-d8e4eb4a6b55 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:22.112840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e8a80-38dc-4dc5-8642-d8e4eb4a6b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:22.113445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e8a80-38dc-4dc5-8642-d8e4eb4a6b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:22.114286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e8a80-38dc-4dc5-8642-d8e4eb4a6b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:22.116525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881ddb-205e-4607-8f5e-3e9998877646 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:22.116745 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e8a80-38dc-4dc5-8642-d8e4eb4a6b55 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:22.117347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881ddb-205e-4607-8f5e-3e9998877646 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:22.117890 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881ddb-205e-4607-8f5e-3e9998877646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:22.129048 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 922/1839] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:22.132673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e8a80-38dc-4dc5-8642-d8e4eb4a6b55 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:22.141517 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f0881ddb-205e-4607-8f5e-3e9998877646 None None] MFA Rules not processed for user `eb70408fecfe41e0b2ea9a53c7ae0823`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:22.142861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f0881ddb-205e-4607-8f5e-3e9998877646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:22.142997 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e8a80-38dc-4dc5-8642-d8e4eb4a6b55 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:22.150327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2280589-8c99-414f-abf2-2d72b63d23a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:22.152268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2280589-8c99-414f-abf2-2d72b63d23a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:22.152561 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2280589-8c99-414f-abf2-2d72b63d23a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:22.152840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2280589-8c99-414f-abf2-2d72b63d23a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:22.153527 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2280589-8c99-414f-abf2-2d72b63d23a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:22.155280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2280589-8c99-414f-abf2-2d72b63d23a4 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:22.169513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 923/1840] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:22.173791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2280589-8c99-414f-abf2-2d72b63d23a4 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:22.185008 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2280589-8c99-414f-abf2-2d72b63d23a4 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:22.192692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b754afe-7c08-4527-981d-1ee2df220d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:22.194724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b754afe-7c08-4527-981d-1ee2df220d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:22.195106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b754afe-7c08-4527-981d-1ee2df220d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:22.195457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b754afe-7c08-4527-981d-1ee2df220d4f admin admin] PATH_INFO: `/v3/projects/0a6b2d329b734e90a6958afa84c4445e/users/fb8340f4d83046ed8e9d64ce9f5f65a0/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:22.209745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:22.214107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b754afe-7c08-4527-981d-1ee2df220d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6b2d329b734e90a6958afa84c4445e, user_id=fb8340f4d83046ed8e9d64ce9f5f65a0, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:22.216900 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b754afe-7c08-4527-981d-1ee2df220d4f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:22.248429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 918/1841] 10.222.0.50 () {58 vars in 1018 bytes} [Sat Sep 17 04:41:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:22.310455 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 924/1842] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:22 2022] PUT /identity/v3/projects/0a6b2d329b734e90a6958afa84c4445e/users/fb8340f4d83046ed8e9d64ce9f5f65a0/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:22.321424 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0881ddb-205e-4607-8f5e-3e9998877646 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:22.322945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f0881ddb-205e-4607-8f5e-3e9998877646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:22.329202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e59f-51ae-4139-b992-25dc7acde88a None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:22.329685 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e59f-51ae-4139-b992-25dc7acde88a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:22.330125 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e59f-51ae-4139-b992-25dc7acde88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:22.347782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0881ddb-205e-4607-8f5e-3e9998877646 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:22.367616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-b6d4e59f-51ae-4139-b992-25dc7acde88a None None] MFA Rules not processed for user `fb8340f4d83046ed8e9d64ce9f5f65a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:22.369241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b6d4e59f-51ae-4139-b992-25dc7acde88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:22.432396 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67944d72-061d-4316-9bf3-8d9bebcab150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:22.432912 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67944d72-061d-4316-9bf3-8d9bebcab150 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:22.433220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67944d72-061d-4316-9bf3-8d9bebcab150 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:22.433497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67944d72-061d-4316-9bf3-8d9bebcab150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:22.442222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67944d72-061d-4316-9bf3-8d9bebcab150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:22.444339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67944d72-061d-4316-9bf3-8d9bebcab150 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:22.451164 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 925/1843] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:22.454884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 919/1844] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:22.455586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e59f-51ae-4139-b992-25dc7acde88a None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:22.549517 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e59f-51ae-4139-b992-25dc7acde88a None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:22.558074 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185453b8-a88a-46d7-962e-a3a60bc972b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:22.558973 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185453b8-a88a-46d7-962e-a3a60bc972b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:22.561263 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185453b8-a88a-46d7-962e-a3a60bc972b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:22.561585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185453b8-a88a-46d7-962e-a3a60bc972b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:22.562293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185453b8-a88a-46d7-962e-a3a60bc972b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:22.564872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185453b8-a88a-46d7-962e-a3a60bc972b8 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:22.734417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 926/1845] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:22 2022] POST /identity/v3/projects => generated 369 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:22.735686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67944d72-061d-4316-9bf3-8d9bebcab150 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:22.747397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67944d72-061d-4316-9bf3-8d9bebcab150 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:22.850305 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f485d04-cec5-43bf-9724-a73f7b521d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:22.850921 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f485d04-cec5-43bf-9724-a73f7b521d74 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:22.851200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f485d04-cec5-43bf-9724-a73f7b521d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:22.851713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f485d04-cec5-43bf-9724-a73f7b521d74 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:22.852352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f485d04-cec5-43bf-9724-a73f7b521d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:22.854357 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f485d04-cec5-43bf-9724-a73f7b521d74 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:22.890100 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:22.978315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 920/1846] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:22 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:22.982731 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185453b8-a88a-46d7-962e-a3a60bc972b8 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:23.011452 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185453b8-a88a-46d7-962e-a3a60bc972b8 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:23.021347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99290903-80f3-497c-a8ab-4ebe075786cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:23.021987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99290903-80f3-497c-a8ab-4ebe075786cf admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:23.022264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99290903-80f3-497c-a8ab-4ebe075786cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:23.022589 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99290903-80f3-497c-a8ab-4ebe075786cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:23.023246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99290903-80f3-497c-a8ab-4ebe075786cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:23.024939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99290903-80f3-497c-a8ab-4ebe075786cf admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:23.038539 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 927/1847] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:23.042782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f485d04-cec5-43bf-9724-a73f7b521d74 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:23.053496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f485d04-cec5-43bf-9724-a73f7b521d74 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:23.060643 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad937567-f2d0-4cca-8055-36276946deac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:23.061477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad937567-f2d0-4cca-8055-36276946deac admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:23.061851 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad937567-f2d0-4cca-8055-36276946deac admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:23.062225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad937567-f2d0-4cca-8055-36276946deac admin admin] PATH_INFO: `/v3/projects/aec8702dfcc04b24aa0cad3b92d5e32c/users/b4ed8c832d884286879f6904cbbe9f6d/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:23.079658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad937567-f2d0-4cca-8055-36276946deac admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec8702dfcc04b24aa0cad3b92d5e32c, user_id=b4ed8c832d884286879f6904cbbe9f6d, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:23.082565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad937567-f2d0-4cca-8055-36276946deac admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:23.095517 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99290903-80f3-497c-a8ab-4ebe075786cf admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:23.097256 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-99290903-80f3-497c-a8ab-4ebe075786cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:23.110478 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99290903-80f3-497c-a8ab-4ebe075786cf admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:23.116719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f38ca9-850b-484f-95b1-4de3348c9eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:23.117385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f38ca9-850b-484f-95b1-4de3348c9eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:23.117658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f38ca9-850b-484f-95b1-4de3348c9eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:23.117923 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f38ca9-850b-484f-95b1-4de3348c9eed admin admin] PATH_INFO: `/v3/users/996e81645e674b528039abcfcafcd936` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:23.119674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f38ca9-850b-484f-95b1-4de3348c9eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=996e81645e674b528039abcfcafcd936)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:23.120949 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f38ca9-850b-484f-95b1-4de3348c9eed admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:23.199450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 921/1848] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:23 2022] PUT /identity/v3/projects/aec8702dfcc04b24aa0cad3b92d5e32c/users/b4ed8c832d884286879f6904cbbe9f6d/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:23.201905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad937567-f2d0-4cca-8055-36276946deac admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:23.288111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad937567-f2d0-4cca-8055-36276946deac admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:23.293745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad32b5e-a67e-4a64-83a8-fedb104e902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:23.294744 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad32b5e-a67e-4a64-83a8-fedb104e902a admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:23.295089 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad32b5e-a67e-4a64-83a8-fedb104e902a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:23.295544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad32b5e-a67e-4a64-83a8-fedb104e902a admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:23.296217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad32b5e-a67e-4a64-83a8-fedb104e902a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:23.298732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad32b5e-a67e-4a64-83a8-fedb104e902a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:23.311834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 922/1849] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:23.316214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad32b5e-a67e-4a64-83a8-fedb104e902a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:23.319635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-04f38ca9-850b-484f-95b1-4de3348c9eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996e81645e674b528039abcfcafcd936'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:23.328690 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad32b5e-a67e-4a64-83a8-fedb104e902a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:23.334275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411aee0-894c-44cf-98aa-9247cb684c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:23.335162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411aee0-894c-44cf-98aa-9247cb684c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:23.335468 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411aee0-894c-44cf-98aa-9247cb684c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:23.335796 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411aee0-894c-44cf-98aa-9247cb684c26 admin admin] PATH_INFO: `/v3/projects/aec8702dfcc04b24aa0cad3b92d5e32c/users/b4ed8c832d884286879f6904cbbe9f6d/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:23.339872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411aee0-894c-44cf-98aa-9247cb684c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec8702dfcc04b24aa0cad3b92d5e32c, user_id=b4ed8c832d884286879f6904cbbe9f6d, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:23.342712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411aee0-894c-44cf-98aa-9247cb684c26 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:23.354759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 923/1850] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:23 2022] PUT /identity/v3/projects/aec8702dfcc04b24aa0cad3b92d5e32c/users/b4ed8c832d884286879f6904cbbe9f6d/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:23.364872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3beb4a5-8000-47b2-8042-a721f05432a4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:23.366724 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3beb4a5-8000-47b2-8042-a721f05432a4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:23.367013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3beb4a5-8000-47b2-8042-a721f05432a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:23.398195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f3beb4a5-8000-47b2-8042-a721f05432a4 None None] MFA Rules not processed for user `b4ed8c832d884286879f6904cbbe9f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:23.402771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f3beb4a5-8000-47b2-8042-a721f05432a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:23.407644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-04f38ca9-850b-484f-95b1-4de3348c9eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996e81645e674b528039abcfcafcd936'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:23.408639 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-04f38ca9-850b-484f-95b1-4de3348c9eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996e81645e674b528039abcfcafcd936'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:23.408966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:23.422064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-04f38ca9-850b-484f-95b1-4de3348c9eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996e81645e674b528039abcfcafcd936'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:23.439279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-04f38ca9-850b-484f-95b1-4de3348c9eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996e81645e674b528039abcfcafcd936'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:23.446665 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 928/1851] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:23 2022] DELETE /identity/v3/users/996e81645e674b528039abcfcafcd936 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:23.451046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a91278-f990-4bcd-b636-5afb8f739c52 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:23.451403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a91278-f990-4bcd-b636-5afb8f739c52 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:23.451748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a91278-f990-4bcd-b636-5afb8f739c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:23.486044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-60a91278-f990-4bcd-b636-5afb8f739c52 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:23.491895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-60a91278-f990-4bcd-b636-5afb8f739c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:23.550160 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 924/1852] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:23.585992 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3beb4a5-8000-47b2-8042-a721f05432a4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:23.587598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f3beb4a5-8000-47b2-8042-a721f05432a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:23.609724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 929/1853] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:23.626723 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a91278-f990-4bcd-b636-5afb8f739c52 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:23.628424 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-60a91278-f990-4bcd-b636-5afb8f739c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:23.685808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3beb4a5-8000-47b2-8042-a721f05432a4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:23.731596 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a91278-f990-4bcd-b636-5afb8f739c52 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:23.735796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8c7c6-0450-44fb-aad8-c90fee7b3241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:23.736399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8c7c6-0450-44fb-aad8-c90fee7b3241 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:23.736809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8c7c6-0450-44fb-aad8-c90fee7b3241 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:23.737481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8c7c6-0450-44fb-aad8-c90fee7b3241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:23.746887 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ee0b4-ce7e-4748-b273-669a09ab7c18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:23.747653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ee0b4-ce7e-4748-b273-669a09ab7c18 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:23.747907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ee0b4-ce7e-4748-b273-669a09ab7c18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:23.748008 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8c7c6-0450-44fb-aad8-c90fee7b3241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:23.748181 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ee0b4-ce7e-4748-b273-669a09ab7c18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:23.749489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8c7c6-0450-44fb-aad8-c90fee7b3241 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:23.760718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 930/1854] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:41:23.761695 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8c7c6-0450-44fb-aad8-c90fee7b3241 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:23.762951 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-14c8c7c6-0450-44fb-aad8-c90fee7b3241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:23.781646 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8c7c6-0450-44fb-aad8-c90fee7b3241 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:23.787807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d5c8e-d6a8-48c9-b824-d6aaa5114162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:23.788929 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d5c8e-d6a8-48c9-b824-d6aaa5114162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:23.788929 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d5c8e-d6a8-48c9-b824-d6aaa5114162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:23.789212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d5c8e-d6a8-48c9-b824-d6aaa5114162 admin admin] PATH_INFO: `/v3/users/e90a10adc35e45e1898f9d6ee2e1d568` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:23.790173 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d5c8e-d6a8-48c9-b824-d6aaa5114162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e90a10adc35e45e1898f9d6ee2e1d568)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:23.792094 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d5c8e-d6a8-48c9-b824-d6aaa5114162 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:23.838723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ee0b4-ce7e-4748-b273-669a09ab7c18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:23.840942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ee0b4-ce7e-4748-b273-669a09ab7c18 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:23.858101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 925/1855] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:24.057808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-db0d5c8e-d6a8-48c9-b824-d6aaa5114162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e90a10adc35e45e1898f9d6ee2e1d568'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:24.149660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ee0b4-ce7e-4748-b273-669a09ab7c18 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:24.151120 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8f5ee0b4-ce7e-4748-b273-669a09ab7c18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:24.163343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ee0b4-ce7e-4748-b273-669a09ab7c18 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:24.167276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059382a-5ab8-4fec-a41a-941318ceb4fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:24.167899 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059382a-5ab8-4fec-a41a-941318ceb4fc service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:24.171899 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059382a-5ab8-4fec-a41a-941318ceb4fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:24.171899 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059382a-5ab8-4fec-a41a-941318ceb4fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:24.171899 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0059382a-5ab8-4fec-a41a-941318ceb4fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:24.193349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-db0d5c8e-d6a8-48c9-b824-d6aaa5114162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e90a10adc35e45e1898f9d6ee2e1d568'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:24.199131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-db0d5c8e-d6a8-48c9-b824-d6aaa5114162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e90a10adc35e45e1898f9d6ee2e1d568'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:24.205718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-db0d5c8e-d6a8-48c9-b824-d6aaa5114162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e90a10adc35e45e1898f9d6ee2e1d568'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:24.225612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-db0d5c8e-d6a8-48c9-b824-d6aaa5114162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e90a10adc35e45e1898f9d6ee2e1d568'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:24.245091 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 931/1856] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:23 2022] DELETE /identity/v3/users/e90a10adc35e45e1898f9d6ee2e1d568 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:24.246497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059382a-5ab8-4fec-a41a-941318ceb4fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:24.248256 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059382a-5ab8-4fec-a41a-941318ceb4fc service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:24.250492 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e4e8-7914-4e5e-abfc-ac49d1b68336 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:24.254035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e4e8-7914-4e5e-abfc-ac49d1b68336 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:24.254454 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e4e8-7914-4e5e-abfc-ac49d1b68336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:24.266917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 926/1857] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:41:24.286034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-99b8e4e8-7914-4e5e-abfc-ac49d1b68336 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:24.288078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-99b8e4e8-7914-4e5e-abfc-ac49d1b68336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:24.350305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 932/1858] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:24.360080 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059382a-5ab8-4fec-a41a-941318ceb4fc service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:24.361636 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0059382a-5ab8-4fec-a41a-941318ceb4fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:24.373209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059382a-5ab8-4fec-a41a-941318ceb4fc service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:24.423815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa47982-998d-4d20-addf-e76703466390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:24.424417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa47982-998d-4d20-addf-e76703466390 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:24.424762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa47982-998d-4d20-addf-e76703466390 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:24.425097 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa47982-998d-4d20-addf-e76703466390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:24.426409 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8e4e8-7914-4e5e-abfc-ac49d1b68336 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:24.428058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-99b8e4e8-7914-4e5e-abfc-ac49d1b68336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:24.436684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa47982-998d-4d20-addf-e76703466390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:24.438869 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa47982-998d-4d20-addf-e76703466390 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:24.441065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8e4e8-7914-4e5e-abfc-ac49d1b68336 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:24.447270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:24.448052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:24.448429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:24.448968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] PATH_INFO: `/v3/projects/33a5f91dbb1d4a94b5ea20f0bf5703fc` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:24.450223 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a5f91dbb1d4a94b5ea20f0bf5703fc)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:24.451319 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 927/1859] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:24.452210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:24.456983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:24.598459 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a5f91dbb1d4a94b5ea20f0bf5703fc', 'request_id': 'req-a7f27bec-3353-422d-aecf-04cfa10c7e11'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:24.608692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a5f91dbb1d4a94b5ea20f0bf5703fc', 'request_id': 'req-a7f27bec-3353-422d-aecf-04cfa10c7e11'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:24.690102 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a5f91dbb1d4a94b5ea20f0bf5703fc', 'request_id': 'req-a7f27bec-3353-422d-aecf-04cfa10c7e11'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:24.706486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] The token cache is being invalidate because project 33a5f91dbb1d4a94b5ea20f0bf5703fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:24.706785 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:24.708194 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:24.720109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa47982-998d-4d20-addf-e76703466390 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:24.739509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa47982-998d-4d20-addf-e76703466390 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:24.750745 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 933/1860] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:24 2022] DELETE /identity/v3/projects/33a5f91dbb1d4a94b5ea20f0bf5703fc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:24.871322 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d260-ce1d-47a6-874d-a6fe8acdd401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:24.872159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d260-ce1d-47a6-874d-a6fe8acdd401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:24.872545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d260-ce1d-47a6-874d-a6fe8acdd401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:24.872880 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d260-ce1d-47a6-874d-a6fe8acdd401 admin admin] PATH_INFO: `/v3/users/f7463affa6b14c0487ecbda519a7e617` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:24.874601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1d260-ce1d-47a6-874d-a6fe8acdd401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7463affa6b14c0487ecbda519a7e617)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:24.881899 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1d260-ce1d-47a6-874d-a6fe8acdd401 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:25.120068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0da1d260-ce1d-47a6-874d-a6fe8acdd401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7463affa6b14c0487ecbda519a7e617'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:25.139625 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0da1d260-ce1d-47a6-874d-a6fe8acdd401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7463affa6b14c0487ecbda519a7e617'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:25.172784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0da1d260-ce1d-47a6-874d-a6fe8acdd401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7463affa6b14c0487ecbda519a7e617'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:25.191543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:25.278091 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0da1d260-ce1d-47a6-874d-a6fe8acdd401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7463affa6b14c0487ecbda519a7e617'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:25.278643 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0da1d260-ce1d-47a6-874d-a6fe8acdd401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7463affa6b14c0487ecbda519a7e617'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:25.289841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 928/1861] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:24 2022] DELETE /identity/v3/users/f7463affa6b14c0487ecbda519a7e617 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:25.351645 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:25.353161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:25.423798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f27bec-3353-422d-aecf-04cfa10c7e11 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:25.528171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:25.529311 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:25.529652 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:25.530557 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] PATH_INFO: `/v3/projects/f7d508865800430ca98571c00e5ad4f0` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:25.531243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d508865800430ca98571c00e5ad4f0)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:25.533311 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:25.703119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d508865800430ca98571c00e5ad4f0', 'request_id': 'req-bade2994-2751-4638-9e6f-fa6f4d8fc612'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:25.710202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d508865800430ca98571c00e5ad4f0', 'request_id': 'req-bade2994-2751-4638-9e6f-fa6f4d8fc612'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:25.802744 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d508865800430ca98571c00e5ad4f0', 'request_id': 'req-bade2994-2751-4638-9e6f-fa6f4d8fc612'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:25.810311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d260-ce1d-47a6-874d-a6fe8acdd401 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:25.813449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:25.814976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0da1d260-ce1d-47a6-874d-a6fe8acdd401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:25.822944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] The token cache is being invalidate because project f7d508865800430ca98571c00e5ad4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:25.823386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:25.824815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:25.826789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 934/1862] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:25 2022] DELETE /identity/v3/projects/f7d508865800430ca98571c00e5ad4f0 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:25.830837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:25.832162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d260-ce1d-47a6-874d-a6fe8acdd401 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:25.832368 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:25.908861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:25.911311 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:25.912275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:25.913338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298 admin admin] PATH_INFO: `/v3/projects/a9486cd9c50a42c591da6637cd159a87` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:25.914904 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9486cd9c50a42c591da6637cd159a87)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:25.917964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:25.925367 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade2994-2751-4638-9e6f-fa6f4d8fc612 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:25.932511 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25782259-b9c2-496e-ae32-d1a66d6b8ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:25.933585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25782259-b9c2-496e-ae32-d1a66d6b8ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:25.934060 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25782259-b9c2-496e-ae32-d1a66d6b8ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:25.934656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25782259-b9c2-496e-ae32-d1a66d6b8ea4 admin admin] PATH_INFO: `/v3/users/9143f7b8f5784484bd8452e3bfe7f83e` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:25.936360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25782259-b9c2-496e-ae32-d1a66d6b8ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9143f7b8f5784484bd8452e3bfe7f83e)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:25.938605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25782259-b9c2-496e-ae32-d1a66d6b8ea4 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:26.067391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9486cd9c50a42c591da6637cd159a87', 'request_id': 'req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:26.073733 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9486cd9c50a42c591da6637cd159a87', 'request_id': 'req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:26.079394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9486cd9c50a42c591da6637cd159a87', 'request_id': 'req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:26.193381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298 admin admin] The token cache is being invalidate because project a9486cd9c50a42c591da6637cd159a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:26.196407 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:26.196407 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-70a5cbdb-59a7-4e9e-9b7c-9a30d4f55298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:26.197123 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 929/1863] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:25 2022] DELETE /identity/v3/projects/a9486cd9c50a42c591da6637cd159a87 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:26.201494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a588c7-0b2d-40d1-b141-f88c2567d925 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:26.201792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a588c7-0b2d-40d1-b141-f88c2567d925 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:26.202102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a588c7-0b2d-40d1-b141-f88c2567d925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:26.206122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-25782259-b9c2-496e-ae32-d1a66d6b8ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9143f7b8f5784484bd8452e3bfe7f83e'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:26.226528 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f4a588c7-0b2d-40d1-b141-f88c2567d925 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:26.227837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f4a588c7-0b2d-40d1-b141-f88c2567d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:26.301454 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 930/1864] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:26.304241 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acd862-ea42-426e-88af-043f07321f6a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:26.304525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acd862-ea42-426e-88af-043f07321f6a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:26.305087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acd862-ea42-426e-88af-043f07321f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:26.328195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-22acd862-ea42-426e-88af-043f07321f6a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:26.329455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-22acd862-ea42-426e-88af-043f07321f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:26.339811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 931/1865] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:26.344198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acd862-ea42-426e-88af-043f07321f6a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:26.352689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-25782259-b9c2-496e-ae32-d1a66d6b8ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9143f7b8f5784484bd8452e3bfe7f83e'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:26.354375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-25782259-b9c2-496e-ae32-d1a66d6b8ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9143f7b8f5784484bd8452e3bfe7f83e'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:26.359084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acd862-ea42-426e-88af-043f07321f6a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:26.366694 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-25782259-b9c2-496e-ae32-d1a66d6b8ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9143f7b8f5784484bd8452e3bfe7f83e'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:26.367794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560d4d0-354e-4676-af8a-a2c3c91ff5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:26.368612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560d4d0-354e-4676-af8a-a2c3c91ff5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:26.369113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560d4d0-354e-4676-af8a-a2c3c91ff5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:26.369562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560d4d0-354e-4676-af8a-a2c3c91ff5e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:26.370372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560d4d0-354e-4676-af8a-a2c3c91ff5e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:26.370858 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560d4d0-354e-4676-af8a-a2c3c91ff5e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:26.372856 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560d4d0-354e-4676-af8a-a2c3c91ff5e1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:26.390983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 932/1866] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:41:26.405058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560d4d0-354e-4676-af8a-a2c3c91ff5e1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:26.405058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4560d4d0-354e-4676-af8a-a2c3c91ff5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:26.409762 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-25782259-b9c2-496e-ae32-d1a66d6b8ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9143f7b8f5784484bd8452e3bfe7f83e'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:26.416337 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560d4d0-354e-4676-af8a-a2c3c91ff5e1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:26.418195 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 935/1867] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:25 2022] DELETE /identity/v3/users/9143f7b8f5784484bd8452e3bfe7f83e => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:26.526297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f18dd5-1442-406b-bbe8-b9da53fb27b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:26.526297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f18dd5-1442-406b-bbe8-b9da53fb27b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:26.526297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f18dd5-1442-406b-bbe8-b9da53fb27b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:26.526297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f18dd5-1442-406b-bbe8-b9da53fb27b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:26.540315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f18dd5-1442-406b-bbe8-b9da53fb27b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:26.542714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f18dd5-1442-406b-bbe8-b9da53fb27b4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:26.658962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 933/1868] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:26 2022] POST /identity/v3/projects => generated 375 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:26.663504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25782259-b9c2-496e-ae32-d1a66d6b8ea4 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:26.674598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25782259-b9c2-496e-ae32-d1a66d6b8ea4 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:26.679675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:26.767702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d1e21-094d-4ccc-b273-e85f4d39b810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:26.768941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d1e21-094d-4ccc-b273-e85f4d39b810 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:26.769660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d1e21-094d-4ccc-b273-e85f4d39b810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:26.770129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d1e21-094d-4ccc-b273-e85f4d39b810 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:26.771384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d1e21-094d-4ccc-b273-e85f4d39b810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:26.773871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d1e21-094d-4ccc-b273-e85f4d39b810 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:26.883804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 936/1869] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:26 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:26.888058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f18dd5-1442-406b-bbe8-b9da53fb27b4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:26.898825 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f18dd5-1442-406b-bbe8-b9da53fb27b4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:26.903605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d498f48-6d4d-497b-b4e2-b77068981087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:26.904206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d498f48-6d4d-497b-b4e2-b77068981087 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:26.904487 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d498f48-6d4d-497b-b4e2-b77068981087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:26.904761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d498f48-6d4d-497b-b4e2-b77068981087 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:26.905475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d498f48-6d4d-497b-b4e2-b77068981087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:26.907053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d498f48-6d4d-497b-b4e2-b77068981087 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:26.917885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 934/1870] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:26.922004 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d1e21-094d-4ccc-b273-e85f4d39b810 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:26.932759 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d1e21-094d-4ccc-b273-e85f4d39b810 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:26.937388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1d3f7-b858-4d6b-99df-948faaa61b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:26.937982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1d3f7-b858-4d6b-99df-948faaa61b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:26.938259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1d3f7-b858-4d6b-99df-948faaa61b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:26.938530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1d3f7-b858-4d6b-99df-948faaa61b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:26.939216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1d3f7-b858-4d6b-99df-948faaa61b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:26.940792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1d3f7-b858-4d6b-99df-948faaa61b4d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:26.950557 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 937/1871] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:26.954686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d498f48-6d4d-497b-b4e2-b77068981087 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:26.976111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d498f48-6d4d-497b-b4e2-b77068981087 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:26.976111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec265020-3cfa-46c6-b834-d0fdd486b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:26.976700 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1d3f7-b858-4d6b-99df-948faaa61b4d admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:26.976791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec265020-3cfa-46c6-b834-d0fdd486b376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:26.976791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec265020-3cfa-46c6-b834-d0fdd486b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:26.976791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec265020-3cfa-46c6-b834-d0fdd486b376 admin admin] PATH_INFO: `/v3/projects/41682abe02fe44be8b47d5c0fae73760/users/1c0486fe03d34ac18f81ad0fc57e5468/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:26.979472 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-66a1d3f7-b858-4d6b-99df-948faaa61b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:27.003799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1d3f7-b858-4d6b-99df-948faaa61b4d admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:27.004306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec265020-3cfa-46c6-b834-d0fdd486b376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41682abe02fe44be8b47d5c0fae73760, user_id=1c0486fe03d34ac18f81ad0fc57e5468, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:27.007923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec265020-3cfa-46c6-b834-d0fdd486b376 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:27.019755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c4ab3-5d73-448a-b2bc-783b87528e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:27.020440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c4ab3-5d73-448a-b2bc-783b87528e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:27.026009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c4ab3-5d73-448a-b2bc-783b87528e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:27.026009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c4ab3-5d73-448a-b2bc-783b87528e17 admin admin] PATH_INFO: `/v3/projects/44aafc94610d467da456b14c8031a231` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:27.026009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c4ab3-5d73-448a-b2bc-783b87528e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44aafc94610d467da456b14c8031a231)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:27.026009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c4ab3-5d73-448a-b2bc-783b87528e17 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:27.099929 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 935/1872] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:26 2022] PUT /identity/v3/projects/41682abe02fe44be8b47d5c0fae73760/users/1c0486fe03d34ac18f81ad0fc57e5468/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:27.111223 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fa8df-bfca-491e-a9c7-a8cdbe5800d6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:27.111511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fa8df-bfca-491e-a9c7-a8cdbe5800d6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:27.111783 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fa8df-bfca-491e-a9c7-a8cdbe5800d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:27.138152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-939c4ab3-5d73-448a-b2bc-783b87528e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44aafc94610d467da456b14c8031a231', 'request_id': 'req-939c4ab3-5d73-448a-b2bc-783b87528e17'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:27.143435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-538fa8df-bfca-491e-a9c7-a8cdbe5800d6 None None] MFA Rules not processed for user `1c0486fe03d34ac18f81ad0fc57e5468`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:27.144920 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-538fa8df-bfca-491e-a9c7-a8cdbe5800d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:27.148319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-939c4ab3-5d73-448a-b2bc-783b87528e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44aafc94610d467da456b14c8031a231', 'request_id': 'req-939c4ab3-5d73-448a-b2bc-783b87528e17'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:27.231791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-939c4ab3-5d73-448a-b2bc-783b87528e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44aafc94610d467da456b14c8031a231', 'request_id': 'req-939c4ab3-5d73-448a-b2bc-783b87528e17'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:27.233966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 936/1873] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:27.248171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fa8df-bfca-491e-a9c7-a8cdbe5800d6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:27.249684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-538fa8df-bfca-491e-a9c7-a8cdbe5800d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:27.256646 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-939c4ab3-5d73-448a-b2bc-783b87528e17 admin admin] The token cache is being invalidate because project 44aafc94610d467da456b14c8031a231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:27.261186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-939c4ab3-5d73-448a-b2bc-783b87528e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:27.261186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-939c4ab3-5d73-448a-b2bc-783b87528e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:27.261186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 938/1874] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:26 2022] DELETE /identity/v3/projects/44aafc94610d467da456b14c8031a231 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:27.264961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ef0da-58e9-4820-9190-79d0e1bee1f8 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:27.265457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ef0da-58e9-4820-9190-79d0e1bee1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:27.265821 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ef0da-58e9-4820-9190-79d0e1bee1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:27.285764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-786ef0da-58e9-4820-9190-79d0e1bee1f8 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:27.287722 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-786ef0da-58e9-4820-9190-79d0e1bee1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:27.309789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fa8df-bfca-491e-a9c7-a8cdbe5800d6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:27.314135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091484d-f3d4-4121-b245-67d09e7db3ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:27.314791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091484d-f3d4-4121-b245-67d09e7db3ae service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:27.315151 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091484d-f3d4-4121-b245-67d09e7db3ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:27.315640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091484d-f3d4-4121-b245-67d09e7db3ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:27.317608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f091484d-f3d4-4121-b245-67d09e7db3ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:27.331093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091484d-f3d4-4121-b245-67d09e7db3ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:27.332709 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091484d-f3d4-4121-b245-67d09e7db3ae service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:27.346379 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 937/1875] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:41:27.362744 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 939/1876] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:27.371783 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9833d0c-03bb-4412-9bd0-faa4e9cf47e7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:27.372103 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9833d0c-03bb-4412-9bd0-faa4e9cf47e7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:27.372383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9833d0c-03bb-4412-9bd0-faa4e9cf47e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:27.392598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c9833d0c-03bb-4412-9bd0-faa4e9cf47e7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:27.393854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c9833d0c-03bb-4412-9bd0-faa4e9cf47e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:27.402426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 938/1877] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:27.406843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ef0da-58e9-4820-9190-79d0e1bee1f8 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:27.419848 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ef0da-58e9-4820-9190-79d0e1bee1f8 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:27.424665 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2b867-ddae-4493-a2cd-669bb073f457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:27.425308 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2b867-ddae-4493-a2cd-669bb073f457 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:27.425584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2b867-ddae-4493-a2cd-669bb073f457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:27.425909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2b867-ddae-4493-a2cd-669bb073f457 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:27.426494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2b867-ddae-4493-a2cd-669bb073f457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:27.426802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2b867-ddae-4493-a2cd-669bb073f457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:27.428392 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2b867-ddae-4493-a2cd-669bb073f457 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:27.444918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 940/1878] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:41:27.449540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9833d0c-03bb-4412-9bd0-faa4e9cf47e7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:27.459498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9833d0c-03bb-4412-9bd0-faa4e9cf47e7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:27.465011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a6637-1b7c-4206-b90d-762195691652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:27.465814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a6637-1b7c-4206-b90d-762195691652 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:27.466092 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a6637-1b7c-4206-b90d-762195691652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:27.466362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a6637-1b7c-4206-b90d-762195691652 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:27.467566 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a6637-1b7c-4206-b90d-762195691652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:27.468892 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a6637-1b7c-4206-b90d-762195691652 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:27.600035 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 939/1879] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:27 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:27.604439 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2b867-ddae-4493-a2cd-669bb073f457 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:27.614569 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2b867-ddae-4493-a2cd-669bb073f457 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:27.673902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9704582-902d-45d1-8679-86011e2a2900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:27.674515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9704582-902d-45d1-8679-86011e2a2900 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:27.674800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9704582-902d-45d1-8679-86011e2a2900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:27.675074 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9704582-902d-45d1-8679-86011e2a2900 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:27.675712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9704582-902d-45d1-8679-86011e2a2900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:27.678549 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9704582-902d-45d1-8679-86011e2a2900 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:27.798123 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 941/1880] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:27 2022] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:27.802235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a6637-1b7c-4206-b90d-762195691652 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:27.813618 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a6637-1b7c-4206-b90d-762195691652 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:27.818572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc53ec-c920-469b-aaed-a3b88d925a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:27.819313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc53ec-c920-469b-aaed-a3b88d925a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:27.819664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc53ec-c920-469b-aaed-a3b88d925a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:27.820010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc53ec-c920-469b-aaed-a3b88d925a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:27.820732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc53ec-c920-469b-aaed-a3b88d925a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:27.822445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc53ec-c920-469b-aaed-a3b88d925a90 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:27.832790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 940/1881] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:27.837755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9704582-902d-45d1-8679-86011e2a2900 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:27.848998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9704582-902d-45d1-8679-86011e2a2900 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:27.854509 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f6c8a-3557-40d8-87f9-3d11c9f66a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:27.855118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f6c8a-3557-40d8-87f9-3d11c9f66a29 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:27.855397 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f6c8a-3557-40d8-87f9-3d11c9f66a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:27.855671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f6c8a-3557-40d8-87f9-3d11c9f66a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:27.856317 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f6c8a-3557-40d8-87f9-3d11c9f66a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:27.857957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f6c8a-3557-40d8-87f9-3d11c9f66a29 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:27.869517 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 942/1882] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:27.873803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc53ec-c920-469b-aaed-a3b88d925a90 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:27.884223 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc53ec-c920-469b-aaed-a3b88d925a90 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:27.889361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84634c02-7b75-408f-ad38-2d082ed2b82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:27.890239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84634c02-7b75-408f-ad38-2d082ed2b82f admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:27.893472 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84634c02-7b75-408f-ad38-2d082ed2b82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:27.893472 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84634c02-7b75-408f-ad38-2d082ed2b82f admin admin] PATH_INFO: `/v3/projects/eec663c659ae475c9cdc33eecba5ce51/users/1ab6880cd4e94bcc90b00841c59fcc0b/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:27.930909 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84634c02-7b75-408f-ad38-2d082ed2b82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec663c659ae475c9cdc33eecba5ce51, user_id=1ab6880cd4e94bcc90b00841c59fcc0b, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:27.933575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84634c02-7b75-408f-ad38-2d082ed2b82f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:28.003996 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 941/1883] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:27 2022] PUT /identity/v3/projects/eec663c659ae475c9cdc33eecba5ce51/users/1ab6880cd4e94bcc90b00841c59fcc0b/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:28.014275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aea703-5a61-4b68-89b9-656a2027bba8 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:28.014559 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aea703-5a61-4b68-89b9-656a2027bba8 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:28.014832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aea703-5a61-4b68-89b9-656a2027bba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:28.043426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-90aea703-5a61-4b68-89b9-656a2027bba8 None None] MFA Rules not processed for user `1ab6880cd4e94bcc90b00841c59fcc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:28.044662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-90aea703-5a61-4b68-89b9-656a2027bba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:28.082464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:28.116938 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 943/1884] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:28.121335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84634c02-7b75-408f-ad38-2d082ed2b82f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:28.183204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84634c02-7b75-408f-ad38-2d082ed2b82f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:28.187733 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f96d3-d4ee-4bef-8792-4fd5d1d38da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:28.188336 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f96d3-d4ee-4bef-8792-4fd5d1d38da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:28.188613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f96d3-d4ee-4bef-8792-4fd5d1d38da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:28.188884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f96d3-d4ee-4bef-8792-4fd5d1d38da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:28.189556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f96d3-d4ee-4bef-8792-4fd5d1d38da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:28.191486 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f96d3-d4ee-4bef-8792-4fd5d1d38da4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:28.287904 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 942/1885] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:28 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:28.291710 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aea703-5a61-4b68-89b9-656a2027bba8 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:28.304174 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aea703-5a61-4b68-89b9-656a2027bba8 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:28.368290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5933dc-9725-46b6-a10e-e7d662f0c155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:28.369075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5933dc-9725-46b6-a10e-e7d662f0c155 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:28.369428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5933dc-9725-46b6-a10e-e7d662f0c155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:28.369767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5933dc-9725-46b6-a10e-e7d662f0c155 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:28.370516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5933dc-9725-46b6-a10e-e7d662f0c155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:28.372631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5933dc-9725-46b6-a10e-e7d662f0c155 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:28.457227 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 944/1886] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:28 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:28.458609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f96d3-d4ee-4bef-8792-4fd5d1d38da4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:28.472381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f96d3-d4ee-4bef-8792-4fd5d1d38da4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:28.477999 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7facf3-af12-46f9-a4e0-f7a59333a8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:28.478478 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7facf3-af12-46f9-a4e0-f7a59333a8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:28.478754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7facf3-af12-46f9-a4e0-f7a59333a8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:28.479019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7facf3-af12-46f9-a4e0-f7a59333a8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:28.479852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7facf3-af12-46f9-a4e0-f7a59333a8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:28.481666 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7facf3-af12-46f9-a4e0-f7a59333a8a4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:28.493512 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 943/1887] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:28.498192 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5933dc-9725-46b6-a10e-e7d662f0c155 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:28.510125 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5933dc-9725-46b6-a10e-e7d662f0c155 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:28.523695 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a16edc-58da-48aa-b236-4de8916ed71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:28.524529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a16edc-58da-48aa-b236-4de8916ed71b admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:28.525445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a16edc-58da-48aa-b236-4de8916ed71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:28.525722 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a16edc-58da-48aa-b236-4de8916ed71b admin admin] PATH_INFO: `/v3/projects/4fe2e27dd7944dfab78d5859b237d311/users/fb2b6a35ebde453c8860427233c34631/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:28.552078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a16edc-58da-48aa-b236-4de8916ed71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe2e27dd7944dfab78d5859b237d311, user_id=fb2b6a35ebde453c8860427233c34631, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:28.557903 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a16edc-58da-48aa-b236-4de8916ed71b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:28.648539 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 945/1888] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:28 2022] PUT /identity/v3/projects/4fe2e27dd7944dfab78d5859b237d311/users/fb2b6a35ebde453c8860427233c34631/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:28.653214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7facf3-af12-46f9-a4e0-f7a59333a8a4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:28.667524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7facf3-af12-46f9-a4e0-f7a59333a8a4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:28.746645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8063f88-4bc0-467a-b0bf-72d1c0c6f1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:28.747380 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8063f88-4bc0-467a-b0bf-72d1c0c6f1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:28.747730 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8063f88-4bc0-467a-b0bf-72d1c0c6f1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:28.748077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8063f88-4bc0-467a-b0bf-72d1c0c6f1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:28.748906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8063f88-4bc0-467a-b0bf-72d1c0c6f1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:28.750836 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8063f88-4bc0-467a-b0bf-72d1c0c6f1c2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:28.792057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 944/1889] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:28.796009 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a16edc-58da-48aa-b236-4de8916ed71b admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:28.809175 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a16edc-58da-48aa-b236-4de8916ed71b admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:28.817486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77539a2-25d7-4799-8630-b827774fecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:28.820737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77539a2-25d7-4799-8630-b827774fecb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:28.826583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77539a2-25d7-4799-8630-b827774fecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:28.826958 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77539a2-25d7-4799-8630-b827774fecb0 admin admin] PATH_INFO: `/v3/projects/4fe2e27dd7944dfab78d5859b237d311/users/fb2b6a35ebde453c8860427233c34631/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:28.829182 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77539a2-25d7-4799-8630-b827774fecb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe2e27dd7944dfab78d5859b237d311, user_id=fb2b6a35ebde453c8860427233c34631, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:28.831947 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77539a2-25d7-4799-8630-b827774fecb0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:28.844528 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 946/1890] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:28 2022] PUT /identity/v3/projects/4fe2e27dd7944dfab78d5859b237d311/users/fb2b6a35ebde453c8860427233c34631/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:28.855498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f7f2d-1a75-43a3-a620-24bdeca89d56 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:28.855817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f7f2d-1a75-43a3-a620-24bdeca89d56 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:28.856149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f7f2d-1a75-43a3-a620-24bdeca89d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:28.889861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9c4f7f2d-1a75-43a3-a620-24bdeca89d56 None None] MFA Rules not processed for user `fb2b6a35ebde453c8860427233c34631`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:28.891104 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9c4f7f2d-1a75-43a3-a620-24bdeca89d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:28.964549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 945/1891] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:29.009594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:29.203538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77539a2-25d7-4799-8630-b827774fecb0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:29.205783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c77539a2-25d7-4799-8630-b827774fecb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:29.311256 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77539a2-25d7-4799-8630-b827774fecb0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:29.315403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea58f64-34f5-4f17-8f19-bac5183fcc3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:29.326315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea58f64-34f5-4f17-8f19-bac5183fcc3f service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:29.326315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea58f64-34f5-4f17-8f19-bac5183fcc3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:29.326315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea58f64-34f5-4f17-8f19-bac5183fcc3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:29.338346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea58f64-34f5-4f17-8f19-bac5183fcc3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:29.340070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea58f64-34f5-4f17-8f19-bac5183fcc3f service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:29.366338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 947/1892] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:29.422128 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f7f2d-1a75-43a3-a620-24bdeca89d56 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:29.423847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9c4f7f2d-1a75-43a3-a620-24bdeca89d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:29.498901 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f7f2d-1a75-43a3-a620-24bdeca89d56 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:29.504276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88862725-4a70-43a9-8a95-b182b7510ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:29.504915 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88862725-4a70-43a9-8a95-b182b7510ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:29.505224 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88862725-4a70-43a9-8a95-b182b7510ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:29.506179 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88862725-4a70-43a9-8a95-b182b7510ba9 admin admin] PATH_INFO: `/v3/users/ec9bd253f4374cb8836834b5e75da919` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:29.510331 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88862725-4a70-43a9-8a95-b182b7510ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec9bd253f4374cb8836834b5e75da919)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:29.513548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88862725-4a70-43a9-8a95-b182b7510ba9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:29.657774 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea58f64-34f5-4f17-8f19-bac5183fcc3f service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:29.668437 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea58f64-34f5-4f17-8f19-bac5183fcc3f service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:29.672678 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ca8cd-076e-47f2-8ae2-421dba4258b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:29.673489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca8cd-076e-47f2-8ae2-421dba4258b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:29.673824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca8cd-076e-47f2-8ae2-421dba4258b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:29.674097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca8cd-076e-47f2-8ae2-421dba4258b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:29.733236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ca8cd-076e-47f2-8ae2-421dba4258b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:29.735164 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ca8cd-076e-47f2-8ae2-421dba4258b4 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:29.746633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 948/1893] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:41:29.758077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88862725-4a70-43a9-8a95-b182b7510ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec9bd253f4374cb8836834b5e75da919'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:29.771768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88862725-4a70-43a9-8a95-b182b7510ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec9bd253f4374cb8836834b5e75da919'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:29.784980 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88862725-4a70-43a9-8a95-b182b7510ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec9bd253f4374cb8836834b5e75da919'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:29.877476 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88862725-4a70-43a9-8a95-b182b7510ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec9bd253f4374cb8836834b5e75da919'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:29.878516 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88862725-4a70-43a9-8a95-b182b7510ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec9bd253f4374cb8836834b5e75da919'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:29.899961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 946/1894] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:29 2022] DELETE /identity/v3/users/ec9bd253f4374cb8836834b5e75da919 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:29.905551 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fb7b7-4997-4d8f-896c-d1cbe2b2ce80 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:29.905846 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fb7b7-4997-4d8f-896c-d1cbe2b2ce80 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:29.913246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fb7b7-4997-4d8f-896c-d1cbe2b2ce80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:29.933660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-212fb7b7-4997-4d8f-896c-d1cbe2b2ce80 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:29.934980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-212fb7b7-4997-4d8f-896c-d1cbe2b2ce80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:30.011746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 949/1895] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:30.019169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88862725-4a70-43a9-8a95-b182b7510ba9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:30.022320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-88862725-4a70-43a9-8a95-b182b7510ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:30.180228 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88862725-4a70-43a9-8a95-b182b7510ba9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:30.183811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728c2f2-89f4-48d6-8ae7-b45f10d2b00c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:30.185119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728c2f2-89f4-48d6-8ae7-b45f10d2b00c service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:30.185119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728c2f2-89f4-48d6-8ae7-b45f10d2b00c service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:30.185318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728c2f2-89f4-48d6-8ae7-b45f10d2b00c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:30.195399 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728c2f2-89f4-48d6-8ae7-b45f10d2b00c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:30.196834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728c2f2-89f4-48d6-8ae7-b45f10d2b00c service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:30.226635 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 947/1896] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:30.230780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fb7b7-4997-4d8f-896c-d1cbe2b2ce80 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:30.233900 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-212fb7b7-4997-4d8f-896c-d1cbe2b2ce80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:30.249169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fb7b7-4997-4d8f-896c-d1cbe2b2ce80 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:30.254715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3f3f0-cf46-41d2-90a4-37013fb2c2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:30.255322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3f3f0-cf46-41d2-90a4-37013fb2c2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:30.259480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3f3f0-cf46-41d2-90a4-37013fb2c2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:30.260399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3f3f0-cf46-41d2-90a4-37013fb2c2a3 admin admin] PATH_INFO: `/v3/users/fb8340f4d83046ed8e9d64ce9f5f65a0` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:30.262373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3f3f0-cf46-41d2-90a4-37013fb2c2a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb8340f4d83046ed8e9d64ce9f5f65a0)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:30.264580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3f3f0-cf46-41d2-90a4-37013fb2c2a3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:30.420195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:30.670173 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-1ae3f3f0-cf46-41d2-90a4-37013fb2c2a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb8340f4d83046ed8e9d64ce9f5f65a0'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:30.830143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-1ae3f3f0-cf46-41d2-90a4-37013fb2c2a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb8340f4d83046ed8e9d64ce9f5f65a0'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:30.830607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-1ae3f3f0-cf46-41d2-90a4-37013fb2c2a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb8340f4d83046ed8e9d64ce9f5f65a0'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:30.845384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-1ae3f3f0-cf46-41d2-90a4-37013fb2c2a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb8340f4d83046ed8e9d64ce9f5f65a0'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:30.874493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-1ae3f3f0-cf46-41d2-90a4-37013fb2c2a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb8340f4d83046ed8e9d64ce9f5f65a0'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:30.888066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 950/1897] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:30 2022] DELETE /identity/v3/users/fb8340f4d83046ed8e9d64ce9f5f65a0 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:30.892754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84e678-289f-4c1f-bfda-275cedc992c6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:30.893245 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84e678-289f-4c1f-bfda-275cedc992c6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:30.893665 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84e678-289f-4c1f-bfda-275cedc992c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:30.917865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7c84e678-289f-4c1f-bfda-275cedc992c6 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:30.919392 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7c84e678-289f-4c1f-bfda-275cedc992c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:30.995759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 948/1898] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:31.026973 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3f3f0-cf46-41d2-90a4-37013fb2c2a3 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:31.029274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1ae3f3f0-cf46-41d2-90a4-37013fb2c2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:31.193995 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3f3f0-cf46-41d2-90a4-37013fb2c2a3 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:31.203716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f5a2f-4822-4885-baf8-a27c8d2a681e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:31.204893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f5a2f-4822-4885-baf8-a27c8d2a681e service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:31.205473 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f5a2f-4822-4885-baf8-a27c8d2a681e service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:31.205844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f5a2f-4822-4885-baf8-a27c8d2a681e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:31.217351 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f5a2f-4822-4885-baf8-a27c8d2a681e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:31.219462 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f5a2f-4822-4885-baf8-a27c8d2a681e service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:31.233060 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 951/1899] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:31.676086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:32.118302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:32.171474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84e678-289f-4c1f-bfda-275cedc992c6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:32.175315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7c84e678-289f-4c1f-bfda-275cedc992c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:32.202677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84e678-289f-4c1f-bfda-275cedc992c6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:32.219434 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:32.220614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:32.220895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:32.221205 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] PATH_INFO: `/v3/projects/c27d72acbe084429b6e1b4b486734f3a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:32.222677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27d72acbe084429b6e1b4b486734f3a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:32.225673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:32.384660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27d72acbe084429b6e1b4b486734f3a', 'request_id': 'req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:32.393639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27d72acbe084429b6e1b4b486734f3a', 'request_id': 'req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:32.409695 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27d72acbe084429b6e1b4b486734f3a', 'request_id': 'req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:32.562737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] The token cache is being invalidate because project c27d72acbe084429b6e1b4b486734f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:32.563037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:32.566297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:32.568631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 949/1900] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:32 2022] DELETE /identity/v3/projects/c27d72acbe084429b6e1b4b486734f3a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:32.572374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f5a2f-4822-4885-baf8-a27c8d2a681e service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:32.604127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:32.607765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:32.633494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f5a2f-4822-4885-baf8-a27c8d2a681e service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:32.786959 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eaf9d9-4476-4e09-8b16-54eab9c6d10d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:32.810459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:32.810459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:32.810459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:32.810459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] PATH_INFO: `/v3/projects/0a6b2d329b734e90a6958afa84c4445e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:32.811155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6b2d329b734e90a6958afa84c4445e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:32.811155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:32.855970 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe15c8-48b3-414a-b46e-5defbc07267e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:32.856851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe15c8-48b3-414a-b46e-5defbc07267e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:32.857181 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe15c8-48b3-414a-b46e-5defbc07267e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:32.857461 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe15c8-48b3-414a-b46e-5defbc07267e admin admin] PATH_INFO: `/v3/users/37bc5b575e28419e8a2efa2ad000ae6d` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:32.868593 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe15c8-48b3-414a-b46e-5defbc07267e admin admin] RBAC: Authorizing `identity:delete_user(user_id=37bc5b575e28419e8a2efa2ad000ae6d)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:32.868593 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe15c8-48b3-414a-b46e-5defbc07267e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:33.004573 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6b2d329b734e90a6958afa84c4445e', 'request_id': 'req-cbda4d35-315d-45d4-bb2d-1a4895709f9a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.012520 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6b2d329b734e90a6958afa84c4445e', 'request_id': 'req-cbda4d35-315d-45d4-bb2d-1a4895709f9a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.018985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6b2d329b734e90a6958afa84c4445e', 'request_id': 'req-cbda4d35-315d-45d4-bb2d-1a4895709f9a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.204298 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] The token cache is being invalidate because project 0a6b2d329b734e90a6958afa84c4445e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:33.205185 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.205867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.209173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 950/1901] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:32 2022] DELETE /identity/v3/projects/0a6b2d329b734e90a6958afa84c4445e => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:33.214503 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:33.216079 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-23fe15c8-48b3-414a-b46e-5defbc07267e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37bc5b575e28419e8a2efa2ad000ae6d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.216349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:33.285380 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda4d35-315d-45d4-bb2d-1a4895709f9a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:33.290332 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d52e0-8b0e-46e9-92b4-a639f21c8556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:33.291185 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d52e0-8b0e-46e9-92b4-a639f21c8556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:33.291459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d52e0-8b0e-46e9-92b4-a639f21c8556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:33.291727 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d52e0-8b0e-46e9-92b4-a639f21c8556 admin admin] PATH_INFO: `/v3/users/b4ed8c832d884286879f6904cbbe9f6d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:33.292849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d52e0-8b0e-46e9-92b4-a639f21c8556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ed8c832d884286879f6904cbbe9f6d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:33.294795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d52e0-8b0e-46e9-92b4-a639f21c8556 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:33.334574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-23fe15c8-48b3-414a-b46e-5defbc07267e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37bc5b575e28419e8a2efa2ad000ae6d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.335725 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-23fe15c8-48b3-414a-b46e-5defbc07267e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37bc5b575e28419e8a2efa2ad000ae6d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.343917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-23fe15c8-48b3-414a-b46e-5defbc07267e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37bc5b575e28419e8a2efa2ad000ae6d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.356881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-23fe15c8-48b3-414a-b46e-5defbc07267e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37bc5b575e28419e8a2efa2ad000ae6d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.363397 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 952/1902] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:32 2022] DELETE /identity/v3/users/37bc5b575e28419e8a2efa2ad000ae6d => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:33.590287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-107d52e0-8b0e-46e9-92b4-a639f21c8556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ed8c832d884286879f6904cbbe9f6d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.619074 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-107d52e0-8b0e-46e9-92b4-a639f21c8556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ed8c832d884286879f6904cbbe9f6d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.630140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:33.641288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-107d52e0-8b0e-46e9-92b4-a639f21c8556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ed8c832d884286879f6904cbbe9f6d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.716840 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-107d52e0-8b0e-46e9-92b4-a639f21c8556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ed8c832d884286879f6904cbbe9f6d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.717805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-107d52e0-8b0e-46e9-92b4-a639f21c8556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ed8c832d884286879f6904cbbe9f6d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:33.726423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 951/1903] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:33 2022] DELETE /identity/v3/users/b4ed8c832d884286879f6904cbbe9f6d => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:33.866562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe15c8-48b3-414a-b46e-5defbc07267e admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:33.868414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-23fe15c8-48b3-414a-b46e-5defbc07267e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:33.972912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:34.000058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe15c8-48b3-414a-b46e-5defbc07267e admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:34.091160 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f988d-2266-474d-b1de-48c6aedf6fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:34.091877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f988d-2266-474d-b1de-48c6aedf6fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:34.092170 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f988d-2266-474d-b1de-48c6aedf6fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:34.092431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f988d-2266-474d-b1de-48c6aedf6fb2 admin admin] PATH_INFO: `/v3/projects/46f2d99d561344d3ab0866cf563abc49` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:34.093655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f988d-2266-474d-b1de-48c6aedf6fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46f2d99d561344d3ab0866cf563abc49)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:34.095999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f988d-2266-474d-b1de-48c6aedf6fb2 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:34.220397 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d63f988d-2266-474d-b1de-48c6aedf6fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f2d99d561344d3ab0866cf563abc49', 'request_id': 'req-d63f988d-2266-474d-b1de-48c6aedf6fb2'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:34.228574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d63f988d-2266-474d-b1de-48c6aedf6fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f2d99d561344d3ab0866cf563abc49', 'request_id': 'req-d63f988d-2266-474d-b1de-48c6aedf6fb2'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:34.357626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d63f988d-2266-474d-b1de-48c6aedf6fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f2d99d561344d3ab0866cf563abc49', 'request_id': 'req-d63f988d-2266-474d-b1de-48c6aedf6fb2'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:34.365770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d52e0-8b0e-46e9-92b4-a639f21c8556 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:34.368250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-107d52e0-8b0e-46e9-92b4-a639f21c8556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:34.379407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d63f988d-2266-474d-b1de-48c6aedf6fb2 admin admin] The token cache is being invalidate because project 46f2d99d561344d3ab0866cf563abc49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:34.379808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d63f988d-2266-474d-b1de-48c6aedf6fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:34.385102 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d63f988d-2266-474d-b1de-48c6aedf6fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:34.385102 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 953/1904] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:33 2022] DELETE /identity/v3/projects/46f2d99d561344d3ab0866cf563abc49 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:34.390986 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2f2e-f1b7-46fe-a3c2-46c83f6eb06f None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:34.391947 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2f2e-f1b7-46fe-a3c2-46c83f6eb06f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:34.392813 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2f2e-f1b7-46fe-a3c2-46c83f6eb06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:34.401941 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d52e0-8b0e-46e9-92b4-a639f21c8556 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:34.404489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:34.420965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-41cb2f2e-f1b7-46fe-a3c2-46c83f6eb06f None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:34.422563 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-41cb2f2e-f1b7-46fe-a3c2-46c83f6eb06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:34.479215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606fc19-d3f7-4abc-8546-302da3cc882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:34.480558 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606fc19-d3f7-4abc-8546-302da3cc882e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:34.481693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606fc19-d3f7-4abc-8546-302da3cc882e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:34.482506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606fc19-d3f7-4abc-8546-302da3cc882e admin admin] PATH_INFO: `/v3/projects/aec8702dfcc04b24aa0cad3b92d5e32c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:34.484684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606fc19-d3f7-4abc-8546-302da3cc882e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec8702dfcc04b24aa0cad3b92d5e32c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:34.487712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606fc19-d3f7-4abc-8546-302da3cc882e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:34.501370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 954/1905] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:34.509297 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875319-4790-4eb8-b676-4a7c5a640816 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:34.509661 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875319-4790-4eb8-b676-4a7c5a640816 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:34.510012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875319-4790-4eb8-b676-4a7c5a640816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:34.534763 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-af875319-4790-4eb8-b676-4a7c5a640816 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:34.535987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-af875319-4790-4eb8-b676-4a7c5a640816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:34.544939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 955/1906] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:34.549042 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af875319-4790-4eb8-b676-4a7c5a640816 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:34.558527 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af875319-4790-4eb8-b676-4a7c5a640816 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:34.563317 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68833bb9-1d06-405f-bb23-5da6208f0ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:34.563918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68833bb9-1d06-405f-bb23-5da6208f0ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:34.564198 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68833bb9-1d06-405f-bb23-5da6208f0ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:34.564475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68833bb9-1d06-405f-bb23-5da6208f0ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:34.565217 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68833bb9-1d06-405f-bb23-5da6208f0ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:34.565542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68833bb9-1d06-405f-bb23-5da6208f0ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:34.567261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68833bb9-1d06-405f-bb23-5da6208f0ce0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:34.579121 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 956/1907] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:41:34.584199 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68833bb9-1d06-405f-bb23-5da6208f0ce0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:34.594081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68833bb9-1d06-405f-bb23-5da6208f0ce0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:34.599731 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b0ef6-b200-4c4b-a0d1-0c0fe828d9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:34.600342 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b0ef6-b200-4c4b-a0d1-0c0fe828d9cb admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:34.600605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b0ef6-b200-4c4b-a0d1-0c0fe828d9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:34.600879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b0ef6-b200-4c4b-a0d1-0c0fe828d9cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:34.601635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b0ef6-b200-4c4b-a0d1-0c0fe828d9cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:34.603754 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b0ef6-b200-4c4b-a0d1-0c0fe828d9cb admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:34.627807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8606fc19-d3f7-4abc-8546-302da3cc882e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec8702dfcc04b24aa0cad3b92d5e32c', 'request_id': 'req-8606fc19-d3f7-4abc-8546-302da3cc882e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:34.634823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8606fc19-d3f7-4abc-8546-302da3cc882e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec8702dfcc04b24aa0cad3b92d5e32c', 'request_id': 'req-8606fc19-d3f7-4abc-8546-302da3cc882e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:34.640913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8606fc19-d3f7-4abc-8546-302da3cc882e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec8702dfcc04b24aa0cad3b92d5e32c', 'request_id': 'req-8606fc19-d3f7-4abc-8546-302da3cc882e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:34.699393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 957/1908] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:34 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:34.700399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b0ef6-b200-4c4b-a0d1-0c0fe828d9cb admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:34.717211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8606fc19-d3f7-4abc-8546-302da3cc882e admin admin] The token cache is being invalidate because project aec8702dfcc04b24aa0cad3b92d5e32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:34.717501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8606fc19-d3f7-4abc-8546-302da3cc882e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:34.718277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8606fc19-d3f7-4abc-8546-302da3cc882e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:34.719917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 952/1909] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:34 2022] DELETE /identity/v3/projects/aec8702dfcc04b24aa0cad3b92d5e32c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:34.725446 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980ef21-68c8-4882-91ce-7a516cda3d23 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:34.725729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980ef21-68c8-4882-91ce-7a516cda3d23 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:34.726002 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980ef21-68c8-4882-91ce-7a516cda3d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:34.752935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f980ef21-68c8-4882-91ce-7a516cda3d23 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:34.754176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f980ef21-68c8-4882-91ce-7a516cda3d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:34.774655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b0ef6-b200-4c4b-a0d1-0c0fe828d9cb admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:34.779341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32f54f-7334-4324-804f-d6f7beb5d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:34.779948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32f54f-7334-4324-804f-d6f7beb5d23a admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:34.780230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32f54f-7334-4324-804f-d6f7beb5d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:34.780506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32f54f-7334-4324-804f-d6f7beb5d23a admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:34.781191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32f54f-7334-4324-804f-d6f7beb5d23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:34.783117 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32f54f-7334-4324-804f-d6f7beb5d23a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:34.814339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 953/1910] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:34.822512 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76826-c1c6-42ca-9442-a5044b189dc9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:34.822802 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76826-c1c6-42ca-9442-a5044b189dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:34.823081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76826-c1c6-42ca-9442-a5044b189dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:34.845024 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-edf76826-c1c6-42ca-9442-a5044b189dc9 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:34.846255 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-edf76826-c1c6-42ca-9442-a5044b189dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:34.855316 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 954/1911] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:34.859543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf76826-c1c6-42ca-9442-a5044b189dc9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:34.868975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf76826-c1c6-42ca-9442-a5044b189dc9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:34.873649 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c851363-5e60-4780-b4b4-6bb9acac4117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:34.874223 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c851363-5e60-4780-b4b4-6bb9acac4117 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:34.874503 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c851363-5e60-4780-b4b4-6bb9acac4117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:34.874774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c851363-5e60-4780-b4b4-6bb9acac4117 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:34.875407 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c851363-5e60-4780-b4b4-6bb9acac4117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:34.875712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c851363-5e60-4780-b4b4-6bb9acac4117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:34.877376 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c851363-5e60-4780-b4b4-6bb9acac4117 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:34.881390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 958/1912] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:34 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:34.887374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32f54f-7334-4324-804f-d6f7beb5d23a admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:34.889161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-3a32f54f-7334-4324-804f-d6f7beb5d23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:34.891849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 955/1913] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:41:34.897184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c851363-5e60-4780-b4b4-6bb9acac4117 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:34.902176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32f54f-7334-4324-804f-d6f7beb5d23a admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:34.907145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd994e4-3ada-424d-a6db-18ec5b00bf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:34.907505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c851363-5e60-4780-b4b4-6bb9acac4117 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:34.907911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd994e4-3ada-424d-a6db-18ec5b00bf1b admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:34.908187 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd994e4-3ada-424d-a6db-18ec5b00bf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:34.908458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd994e4-3ada-424d-a6db-18ec5b00bf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:34.909273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd994e4-3ada-424d-a6db-18ec5b00bf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:34.910999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd994e4-3ada-424d-a6db-18ec5b00bf1b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:34.914532 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7f75b-41ce-4906-acad-6837a9597721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:34.919200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7f75b-41ce-4906-acad-6837a9597721 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:34.919200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7f75b-41ce-4906-acad-6837a9597721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:34.919200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7f75b-41ce-4906-acad-6837a9597721 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:34.919200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7f75b-41ce-4906-acad-6837a9597721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:34.919200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7f75b-41ce-4906-acad-6837a9597721 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:34.922118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 959/1914] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:34.926000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd994e4-3ada-424d-a6db-18ec5b00bf1b admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:34.936565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd994e4-3ada-424d-a6db-18ec5b00bf1b admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:34.941542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06305b2-aeae-4498-82a6-af327322805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:34.942074 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06305b2-aeae-4498-82a6-af327322805b admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:34.944654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06305b2-aeae-4498-82a6-af327322805b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:34.944968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06305b2-aeae-4498-82a6-af327322805b admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:34.945640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06305b2-aeae-4498-82a6-af327322805b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:34.947231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06305b2-aeae-4498-82a6-af327322805b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:34.957930 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 960/1915] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:34.962941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06305b2-aeae-4498-82a6-af327322805b admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:34.972257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06305b2-aeae-4498-82a6-af327322805b admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:34.977400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bb9c5-fa5b-4516-abdd-5904085bd1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:34.978050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bb9c5-fa5b-4516-abdd-5904085bd1d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:34.978329 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bb9c5-fa5b-4516-abdd-5904085bd1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:34.978605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bb9c5-fa5b-4516-abdd-5904085bd1d3 admin admin] PATH_INFO: `/v3/projects/0925c1cadde34dbd9b458b639696cfee/users/6ed5796d8871406abd3a48f8340f9f1e/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:34.995078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bb9c5-fa5b-4516-abdd-5904085bd1d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0925c1cadde34dbd9b458b639696cfee, user_id=6ed5796d8871406abd3a48f8340f9f1e, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:34.998171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bb9c5-fa5b-4516-abdd-5904085bd1d3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:35.033022 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 956/1916] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:34 2022] POST /identity/v3/projects => generated 389 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:35.036637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7f75b-41ce-4906-acad-6837a9597721 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:35.091007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 961/1917] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:34 2022] PUT /identity/v3/projects/0925c1cadde34dbd9b458b639696cfee/users/6ed5796d8871406abd3a48f8340f9f1e/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:35.106599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c03953-fbee-45ab-b474-c4b2eb284af0 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:35.107172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c03953-fbee-45ab-b474-c4b2eb284af0 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:35.107461 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c03953-fbee-45ab-b474-c4b2eb284af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:35.137923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7f75b-41ce-4906-acad-6837a9597721 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:35.158238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-53c03953-fbee-45ab-b474-c4b2eb284af0 None None] MFA Rules not processed for user `6ed5796d8871406abd3a48f8340f9f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:35.160718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-53c03953-fbee-45ab-b474-c4b2eb284af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:35.210680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4a667-aa9a-4012-b9f8-61e5296d2913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:35.211301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a667-aa9a-4012-b9f8-61e5296d2913 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:35.211576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a667-aa9a-4012-b9f8-61e5296d2913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:35.211847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a667-aa9a-4012-b9f8-61e5296d2913 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:35.212495 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4a667-aa9a-4012-b9f8-61e5296d2913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:35.214614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4a667-aa9a-4012-b9f8-61e5296d2913 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:35.261021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 962/1918] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:35.262887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c03953-fbee-45ab-b474-c4b2eb284af0 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:35.274759 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c03953-fbee-45ab-b474-c4b2eb284af0 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:35.279607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb1721-6723-4276-9253-460c6421e72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:35.280209 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb1721-6723-4276-9253-460c6421e72b admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:35.280487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb1721-6723-4276-9253-460c6421e72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:35.280849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb1721-6723-4276-9253-460c6421e72b admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:35.281627 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb1721-6723-4276-9253-460c6421e72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:35.288360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb1721-6723-4276-9253-460c6421e72b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:35.341041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 957/1919] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:35 2022] POST /identity/v3/users => generated 295 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:35.345614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4a667-aa9a-4012-b9f8-61e5296d2913 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:35.353379 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4a667-aa9a-4012-b9f8-61e5296d2913 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:35.359870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e32c7a-b5e0-44f1-b8b6-65ce44bd43af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:35.359870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32c7a-b5e0-44f1-b8b6-65ce44bd43af admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:35.359870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32c7a-b5e0-44f1-b8b6-65ce44bd43af admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:35.359870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32c7a-b5e0-44f1-b8b6-65ce44bd43af admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:35.360458 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e32c7a-b5e0-44f1-b8b6-65ce44bd43af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:35.362123 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e32c7a-b5e0-44f1-b8b6-65ce44bd43af admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:35.374269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 958/1920] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:35.379892 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e32c7a-b5e0-44f1-b8b6-65ce44bd43af admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:35.390337 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e32c7a-b5e0-44f1-b8b6-65ce44bd43af admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:35.395798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad81c5-6900-45a0-87a8-2e6116fd9f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:35.396456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad81c5-6900-45a0-87a8-2e6116fd9f56 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:35.396794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad81c5-6900-45a0-87a8-2e6116fd9f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:35.397265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad81c5-6900-45a0-87a8-2e6116fd9f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:35.398101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad81c5-6900-45a0-87a8-2e6116fd9f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:35.399986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad81c5-6900-45a0-87a8-2e6116fd9f56 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:35.408570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 963/1921] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:35 2022] POST /identity/v3/projects => generated 391 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:35.412534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb1721-6723-4276-9253-460c6421e72b admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:35.412710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 959/1922] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:35.416412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad81c5-6900-45a0-87a8-2e6116fd9f56 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:35.429465 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad81c5-6900-45a0-87a8-2e6116fd9f56 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:35.492392 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb1721-6723-4276-9253-460c6421e72b admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:35.495949 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2fa79-52b1-480d-af08-5f7a555d59f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:35.496978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2fa79-52b1-480d-af08-5f7a555d59f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:35.497483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2fa79-52b1-480d-af08-5f7a555d59f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:35.497780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1d2ae-57ea-4136-8742-0b860ded8fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:35.498276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2fa79-52b1-480d-af08-5f7a555d59f4 admin admin] PATH_INFO: `/v3/projects/d103aec2459343818f9ff54304f02c8f/users/722e7f565f69494a9f42150f9bc99855/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:35.498667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d2ae-57ea-4136-8742-0b860ded8fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:35.499013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d2ae-57ea-4136-8742-0b860ded8fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:35.499504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d2ae-57ea-4136-8742-0b860ded8fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:35.500258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1d2ae-57ea-4136-8742-0b860ded8fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:35.502288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1d2ae-57ea-4136-8742-0b860ded8fb3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:35.516128 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2fa79-52b1-480d-af08-5f7a555d59f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d103aec2459343818f9ff54304f02c8f, user_id=722e7f565f69494a9f42150f9bc99855, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:35.518918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2fa79-52b1-480d-af08-5f7a555d59f4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:35.580513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 964/1923] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:35 2022] POST /identity/v3/users => generated 302 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:35.585047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1d2ae-57ea-4136-8742-0b860ded8fb3 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:35.594712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1d2ae-57ea-4136-8742-0b860ded8fb3 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:35.598448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:35.603584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296551f5-f26a-47c7-9ba9-ffaee6c7e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:35.604205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296551f5-f26a-47c7-9ba9-ffaee6c7e47f admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:35.604481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296551f5-f26a-47c7-9ba9-ffaee6c7e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:35.604949 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296551f5-f26a-47c7-9ba9-ffaee6c7e47f admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:35.606379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296551f5-f26a-47c7-9ba9-ffaee6c7e47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:35.607694 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296551f5-f26a-47c7-9ba9-ffaee6c7e47f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:35.611385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 960/1924] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:35 2022] PUT /identity/v3/projects/d103aec2459343818f9ff54304f02c8f/users/722e7f565f69494a9f42150f9bc99855/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:35.626887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 965/1925] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:35.627069 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3675f3-5eb0-4aa2-930a-345893ea8cf8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:35.627069 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3675f3-5eb0-4aa2-930a-345893ea8cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:35.627069 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3675f3-5eb0-4aa2-930a-345893ea8cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:35.627904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296551f5-f26a-47c7-9ba9-ffaee6c7e47f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:35.641482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296551f5-f26a-47c7-9ba9-ffaee6c7e47f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:35.655170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bb3675f3-5eb0-4aa2-930a-345893ea8cf8 None None] MFA Rules not processed for user `722e7f565f69494a9f42150f9bc99855`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:35.656540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bb3675f3-5eb0-4aa2-930a-345893ea8cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:35.704844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14d234-887c-4ceb-89f7-35e25a01d85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:35.705452 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14d234-887c-4ceb-89f7-35e25a01d85a admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:35.705732 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14d234-887c-4ceb-89f7-35e25a01d85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:35.706176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14d234-887c-4ceb-89f7-35e25a01d85a admin admin] PATH_INFO: `/v3/projects/22ae8f29adbd417699993f47121f2144/users/07e38944acfc4709926c9dd8faa0cc9a/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:35.720638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 961/1926] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:35.725395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3675f3-5eb0-4aa2-930a-345893ea8cf8 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:35.725765 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14d234-887c-4ceb-89f7-35e25a01d85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ae8f29adbd417699993f47121f2144, user_id=07e38944acfc4709926c9dd8faa0cc9a, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:35.728441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14d234-887c-4ceb-89f7-35e25a01d85a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:35.735773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3675f3-5eb0-4aa2-930a-345893ea8cf8 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:35.741142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ad04f-860f-44af-9f60-cb0ec7cfdeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:35.741738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ad04f-860f-44af-9f60-cb0ec7cfdeb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:35.742019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ad04f-860f-44af-9f60-cb0ec7cfdeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:35.742296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ad04f-860f-44af-9f60-cb0ec7cfdeb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:35.742922 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ad04f-860f-44af-9f60-cb0ec7cfdeb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:35.744855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ad04f-860f-44af-9f60-cb0ec7cfdeb9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:35.774728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:35.814716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 966/1927] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:35 2022] PUT /identity/v3/projects/22ae8f29adbd417699993f47121f2144/users/07e38944acfc4709926c9dd8faa0cc9a/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:35.819087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14d234-887c-4ceb-89f7-35e25a01d85a admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:35.851897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 962/1928] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:35 2022] POST /identity/v3/projects => generated 389 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:35.857368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ad04f-860f-44af-9f60-cb0ec7cfdeb9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:35.884307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14d234-887c-4ceb-89f7-35e25a01d85a admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:35.918499 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ad04f-860f-44af-9f60-cb0ec7cfdeb9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:35.923323 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d1acd-ad32-4379-8ef2-7aa6ae88ff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:35.923929 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d1acd-ad32-4379-8ef2-7aa6ae88ff5e admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:35.924207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d1acd-ad32-4379-8ef2-7aa6ae88ff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:35.924476 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d1acd-ad32-4379-8ef2-7aa6ae88ff5e admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:35.925142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d1acd-ad32-4379-8ef2-7aa6ae88ff5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:35.927305 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d1acd-ad32-4379-8ef2-7aa6ae88ff5e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:35.939370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f57616-48a5-49de-b149-786eb132b550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:35.939972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f57616-48a5-49de-b149-786eb132b550 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:35.940253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f57616-48a5-49de-b149-786eb132b550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:35.940519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f57616-48a5-49de-b149-786eb132b550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:35.941186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f57616-48a5-49de-b149-786eb132b550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:35.944223 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f57616-48a5-49de-b149-786eb132b550 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:35.953794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 967/1929] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:35.957838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f57616-48a5-49de-b149-786eb132b550 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:35.969745 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f57616-48a5-49de-b149-786eb132b550 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:35.975169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d46369-7817-46b2-90d6-08ad386f638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:35.975812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d46369-7817-46b2-90d6-08ad386f638e admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:35.976085 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d46369-7817-46b2-90d6-08ad386f638e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:35.976352 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d46369-7817-46b2-90d6-08ad386f638e admin admin] PATH_INFO: `/v3/projects/22ae8f29adbd417699993f47121f2144/users/07e38944acfc4709926c9dd8faa0cc9a/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:35.978341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d46369-7817-46b2-90d6-08ad386f638e admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ae8f29adbd417699993f47121f2144, user_id=07e38944acfc4709926c9dd8faa0cc9a, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:35.980951 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d46369-7817-46b2-90d6-08ad386f638e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:35.992012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 968/1930] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:35 2022] PUT /identity/v3/projects/22ae8f29adbd417699993f47121f2144/users/07e38944acfc4709926c9dd8faa0cc9a/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:36.002522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e6197-43d7-4224-ac2e-a8084363e9ce None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:36.002803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e6197-43d7-4224-ac2e-a8084363e9ce None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:36.006095 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e6197-43d7-4224-ac2e-a8084363e9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:36.034494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-197e6197-43d7-4224-ac2e-a8084363e9ce None None] MFA Rules not processed for user `07e38944acfc4709926c9dd8faa0cc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:36.035697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-197e6197-43d7-4224-ac2e-a8084363e9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:36.094824 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 963/1931] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:35 2022] POST /identity/v3/users => generated 301 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:36.102379 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d1acd-ad32-4379-8ef2-7aa6ae88ff5e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:36.105741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 969/1932] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:36.113562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d1acd-ad32-4379-8ef2-7aa6ae88ff5e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:36.117465 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e6197-43d7-4224-ac2e-a8084363e9ce None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:36.119555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-197e6197-43d7-4224-ac2e-a8084363e9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:36.173921 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a11a9-5757-470e-ab2d-9011f2d633b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:36.174538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a11a9-5757-470e-ab2d-9011f2d633b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:36.174816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a11a9-5757-470e-ab2d-9011f2d633b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:36.175088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a11a9-5757-470e-ab2d-9011f2d633b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:36.175798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a11a9-5757-470e-ab2d-9011f2d633b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:36.178127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a11a9-5757-470e-ab2d-9011f2d633b9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:36.189091 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e6197-43d7-4224-ac2e-a8084363e9ce None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:36.189509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 964/1933] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:36.194113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c53fce-e2ce-469c-b4d3-d87a9d780994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:36.194863 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c53fce-e2ce-469c-b4d3-d87a9d780994 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:36.195145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c53fce-e2ce-469c-b4d3-d87a9d780994 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:36.195279 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a11a9-5757-470e-ab2d-9011f2d633b9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:36.195415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c53fce-e2ce-469c-b4d3-d87a9d780994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:36.205153 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c53fce-e2ce-469c-b4d3-d87a9d780994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:36.205569 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a11a9-5757-470e-ab2d-9011f2d633b9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:36.206712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c53fce-e2ce-469c-b4d3-d87a9d780994 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:36.210553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066422b8-48ec-48a2-8eb2-06a60b26793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:36.211249 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066422b8-48ec-48a2-8eb2-06a60b26793c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:36.211592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066422b8-48ec-48a2-8eb2-06a60b26793c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:36.211868 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066422b8-48ec-48a2-8eb2-06a60b26793c admin admin] PATH_INFO: `/v3/projects/5423c2f5fd3440eca1fab6bf1fda4fc3/users/a1b1fce7436d45ddb92d52f129673ee2/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:36.216400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 970/1934] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:36 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:36.228716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066422b8-48ec-48a2-8eb2-06a60b26793c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5423c2f5fd3440eca1fab6bf1fda4fc3, user_id=a1b1fce7436d45ddb92d52f129673ee2, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:36.235736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066422b8-48ec-48a2-8eb2-06a60b26793c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:36.267176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c53fce-e2ce-469c-b4d3-d87a9d780994 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:36.268668 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-84c53fce-e2ce-469c-b4d3-d87a9d780994 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:36.280247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c53fce-e2ce-469c-b4d3-d87a9d780994 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:36.286481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75466bd5-2e24-42d5-a391-a159bef740f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:36.287155 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75466bd5-2e24-42d5-a391-a159bef740f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:36.287380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75466bd5-2e24-42d5-a391-a159bef740f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:36.287649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75466bd5-2e24-42d5-a391-a159bef740f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:36.333249 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 965/1935] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:36 2022] PUT /identity/v3/projects/5423c2f5fd3440eca1fab6bf1fda4fc3/users/a1b1fce7436d45ddb92d52f129673ee2/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:36.333249 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066422b8-48ec-48a2-8eb2-06a60b26793c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:36.350243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75466bd5-2e24-42d5-a391-a159bef740f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:36.351965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75466bd5-2e24-42d5-a391-a159bef740f0 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:36.361831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 971/1936] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:41:36.405382 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066422b8-48ec-48a2-8eb2-06a60b26793c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:36.409285 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091c8a5-d28c-498f-b902-1339f51b4470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:36.410116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091c8a5-d28c-498f-b902-1339f51b4470 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:36.410404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091c8a5-d28c-498f-b902-1339f51b4470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:36.410673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091c8a5-d28c-498f-b902-1339f51b4470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:36.412057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091c8a5-d28c-498f-b902-1339f51b4470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:36.413617 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091c8a5-d28c-498f-b902-1339f51b4470 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:36.425545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 966/1937] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:36.439692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75466bd5-2e24-42d5-a391-a159bef740f0 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:36.451572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75466bd5-2e24-42d5-a391-a159bef740f0 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:36.457253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d68e5a-e662-4e2d-b5e5-0a20f08f0285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:36.458756 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d68e5a-e662-4e2d-b5e5-0a20f08f0285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:36.459243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d68e5a-e662-4e2d-b5e5-0a20f08f0285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:36.460102 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d68e5a-e662-4e2d-b5e5-0a20f08f0285 admin admin] PATH_INFO: `/v3/projects/5423c2f5fd3440eca1fab6bf1fda4fc3/users/a1b1fce7436d45ddb92d52f129673ee2/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:36.476622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d68e5a-e662-4e2d-b5e5-0a20f08f0285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5423c2f5fd3440eca1fab6bf1fda4fc3, user_id=a1b1fce7436d45ddb92d52f129673ee2, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:36.476622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d68e5a-e662-4e2d-b5e5-0a20f08f0285 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:36.478563 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 972/1938] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:36 2022] PUT /identity/v3/projects/5423c2f5fd3440eca1fab6bf1fda4fc3/users/a1b1fce7436d45ddb92d52f129673ee2/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:36.488787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb218b-c34c-47f2-8fb1-2028f06c5e62 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:36.489142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb218b-c34c-47f2-8fb1-2028f06c5e62 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:36.489626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb218b-c34c-47f2-8fb1-2028f06c5e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:36.518666 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6fbb218b-c34c-47f2-8fb1-2028f06c5e62 None None] MFA Rules not processed for user `a1b1fce7436d45ddb92d52f129673ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:36.519871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6fbb218b-c34c-47f2-8fb1-2028f06c5e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:36.605758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 967/1939] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:36 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:36.829957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d68e5a-e662-4e2d-b5e5-0a20f08f0285 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:36.887025 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d68e5a-e662-4e2d-b5e5-0a20f08f0285 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:36.890665 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b6e8c-6b4a-4f04-b91a-0418136ce5bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:36.891269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b6e8c-6b4a-4f04-b91a-0418136ce5bd service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:36.891548 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b6e8c-6b4a-4f04-b91a-0418136ce5bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:36.891822 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b6e8c-6b4a-4f04-b91a-0418136ce5bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:36.900868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b6e8c-6b4a-4f04-b91a-0418136ce5bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:36.902320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b6e8c-6b4a-4f04-b91a-0418136ce5bd service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:36.912887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 973/1940] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:36 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:37.140112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:37.386541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:37.571338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb218b-c34c-47f2-8fb1-2028f06c5e62 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:37.638133 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb218b-c34c-47f2-8fb1-2028f06c5e62 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:37.643400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e29ad-a67c-4084-ae76-503a667f1f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:37.644175 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e29ad-a67c-4084-ae76-503a667f1f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:37.645510 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e29ad-a67c-4084-ae76-503a667f1f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:37.646201 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e29ad-a67c-4084-ae76-503a667f1f24 admin admin] PATH_INFO: `/v3/users/722e7f565f69494a9f42150f9bc99855` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:37.648015 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e29ad-a67c-4084-ae76-503a667f1f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=722e7f565f69494a9f42150f9bc99855)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:37.650947 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e29ad-a67c-4084-ae76-503a667f1f24 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:37.920277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1c5e29ad-a67c-4084-ae76-503a667f1f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722e7f565f69494a9f42150f9bc99855'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:37.927662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1c5e29ad-a67c-4084-ae76-503a667f1f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722e7f565f69494a9f42150f9bc99855'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:37.939759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1c5e29ad-a67c-4084-ae76-503a667f1f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722e7f565f69494a9f42150f9bc99855'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:38.088467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1c5e29ad-a67c-4084-ae76-503a667f1f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722e7f565f69494a9f42150f9bc99855'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:38.089309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1c5e29ad-a67c-4084-ae76-503a667f1f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722e7f565f69494a9f42150f9bc99855'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:38.100706 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 968/1941] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:37 2022] DELETE /identity/v3/users/722e7f565f69494a9f42150f9bc99855 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:38.102434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe72696-0cfb-4ebd-8731-86b8752d684a None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:38.102959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe72696-0cfb-4ebd-8731-86b8752d684a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:38.102959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe72696-0cfb-4ebd-8731-86b8752d684a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:38.128734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-dbe72696-0cfb-4ebd-8731-86b8752d684a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:38.130561 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-dbe72696-0cfb-4ebd-8731-86b8752d684a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:38.204450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 974/1942] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:38.211853 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e29ad-a67c-4084-ae76-503a667f1f24 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:38.223574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1c5e29ad-a67c-4084-ae76-503a667f1f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:38.312573 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e29ad-a67c-4084-ae76-503a667f1f24 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:38.316280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca77268-866a-4f8d-973e-59a1d91d5a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:38.316891 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca77268-866a-4f8d-973e-59a1d91d5a4f service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:38.317748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca77268-866a-4f8d-973e-59a1d91d5a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:38.318077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca77268-866a-4f8d-973e-59a1d91d5a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:38.327186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca77268-866a-4f8d-973e-59a1d91d5a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:38.328766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca77268-866a-4f8d-973e-59a1d91d5a4f service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:38.345174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 969/1943] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:38.589648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:38.955332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:38.962282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe72696-0cfb-4ebd-8731-86b8752d684a None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:38.965311 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-dbe72696-0cfb-4ebd-8731-86b8752d684a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:38.975742 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe72696-0cfb-4ebd-8731-86b8752d684a None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:38.980218 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:38.980847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:38.981276 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:38.981554 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] PATH_INFO: `/v3/projects/d103aec2459343818f9ff54304f02c8f` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:38.982708 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d103aec2459343818f9ff54304f02c8f)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:38.984603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:39.097806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd103aec2459343818f9ff54304f02c8f', 'request_id': 'req-a210d211-382a-4283-b13b-2928d891becb'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:39.121906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd103aec2459343818f9ff54304f02c8f', 'request_id': 'req-a210d211-382a-4283-b13b-2928d891becb'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:39.244384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd103aec2459343818f9ff54304f02c8f', 'request_id': 'req-a210d211-382a-4283-b13b-2928d891becb'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:39.267075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] The token cache is being invalidate because project d103aec2459343818f9ff54304f02c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:39.267438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:39.268190 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:39.270017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 975/1944] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:38 2022] DELETE /identity/v3/projects/d103aec2459343818f9ff54304f02c8f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:39.274297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca77268-866a-4f8d-973e-59a1d91d5a4f service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:39.284821 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca77268-866a-4f8d-973e-59a1d91d5a4f service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:39.353702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c0ae2-f48a-4b60-a374-677f904b24ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:39.354502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0ae2-f48a-4b60-a374-677f904b24ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:39.354824 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0ae2-f48a-4b60-a374-677f904b24ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:39.355154 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0ae2-f48a-4b60-a374-677f904b24ac admin admin] PATH_INFO: `/v3/users/a1b1fce7436d45ddb92d52f129673ee2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:39.356296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c0ae2-f48a-4b60-a374-677f904b24ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b1fce7436d45ddb92d52f129673ee2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:39.358238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c0ae2-f48a-4b60-a374-677f904b24ac admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:39.572966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-744c0ae2-f48a-4b60-a374-677f904b24ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b1fce7436d45ddb92d52f129673ee2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:39.579877 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-744c0ae2-f48a-4b60-a374-677f904b24ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b1fce7436d45ddb92d52f129673ee2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:39.592519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-744c0ae2-f48a-4b60-a374-677f904b24ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b1fce7436d45ddb92d52f129673ee2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:39.659994 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-744c0ae2-f48a-4b60-a374-677f904b24ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b1fce7436d45ddb92d52f129673ee2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:39.660643 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-744c0ae2-f48a-4b60-a374-677f904b24ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b1fce7436d45ddb92d52f129673ee2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:39.667982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 970/1945] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:39 2022] DELETE /identity/v3/users/a1b1fce7436d45ddb92d52f129673ee2 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:40.097885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:40.164067 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:40.164067 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:40.173585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210d211-382a-4283-b13b-2928d891becb admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:40.236688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f956a-7766-46f7-961a-d37ecdc93ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:40.237380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f956a-7766-46f7-961a-d37ecdc93ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:40.237710 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f956a-7766-46f7-961a-d37ecdc93ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:40.237949 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f956a-7766-46f7-961a-d37ecdc93ccf admin admin] PATH_INFO: `/v3/projects/5423c2f5fd3440eca1fab6bf1fda4fc3` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:40.239851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f956a-7766-46f7-961a-d37ecdc93ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5423c2f5fd3440eca1fab6bf1fda4fc3)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:40.241867 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f956a-7766-46f7-961a-d37ecdc93ccf admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:40.320893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:40.383361 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-0a3f956a-7766-46f7-961a-d37ecdc93ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5423c2f5fd3440eca1fab6bf1fda4fc3', 'request_id': 'req-0a3f956a-7766-46f7-961a-d37ecdc93ccf'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:40.390724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-0a3f956a-7766-46f7-961a-d37ecdc93ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5423c2f5fd3440eca1fab6bf1fda4fc3', 'request_id': 'req-0a3f956a-7766-46f7-961a-d37ecdc93ccf'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:40.517065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-0a3f956a-7766-46f7-961a-d37ecdc93ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5423c2f5fd3440eca1fab6bf1fda4fc3', 'request_id': 'req-0a3f956a-7766-46f7-961a-d37ecdc93ccf'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:40.528445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-0a3f956a-7766-46f7-961a-d37ecdc93ccf admin admin] The token cache is being invalidate because project 5423c2f5fd3440eca1fab6bf1fda4fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:40.528731 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-0a3f956a-7766-46f7-961a-d37ecdc93ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:40.529374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-0a3f956a-7766-46f7-961a-d37ecdc93ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:40.530847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 976/1946] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:40 2022] DELETE /identity/v3/projects/5423c2f5fd3440eca1fab6bf1fda4fc3 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:40.536517 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad99ef-9b24-4832-a93b-2c2d52eb512f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:40.536806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad99ef-9b24-4832-a93b-2c2d52eb512f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:40.537122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad99ef-9b24-4832-a93b-2c2d52eb512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:40.556770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-01ad99ef-9b24-4832-a93b-2c2d52eb512f None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:40.557940 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-01ad99ef-9b24-4832-a93b-2c2d52eb512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:40.617509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 971/1947] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:40.625538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b115cd-d764-43f9-adb6-9160bacf8a39 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:40.625902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b115cd-d764-43f9-adb6-9160bacf8a39 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:40.626177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b115cd-d764-43f9-adb6-9160bacf8a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:40.646878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-35b115cd-d764-43f9-adb6-9160bacf8a39 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:40.648086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-35b115cd-d764-43f9-adb6-9160bacf8a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:40.656013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 977/1948] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:40.660301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad99ef-9b24-4832-a93b-2c2d52eb512f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:40.670440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad99ef-9b24-4832-a93b-2c2d52eb512f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:40.675082 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed7499-9f05-4600-8f43-489d7d2bca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:40.675670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7499-9f05-4600-8f43-489d7d2bca90 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:40.675942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7499-9f05-4600-8f43-489d7d2bca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:40.676212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7499-9f05-4600-8f43-489d7d2bca90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:40.680723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed7499-9f05-4600-8f43-489d7d2bca90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:40.680723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed7499-9f05-4600-8f43-489d7d2bca90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:40.680723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed7499-9f05-4600-8f43-489d7d2bca90 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:40.691107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 972/1949] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:41:40.696087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b115cd-d764-43f9-adb6-9160bacf8a39 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:40.705519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b115cd-d764-43f9-adb6-9160bacf8a39 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:40.710348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9bdc8-cea2-4438-8325-e529e2f71c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:40.710940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9bdc8-cea2-4438-8325-e529e2f71c55 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:40.711234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9bdc8-cea2-4438-8325-e529e2f71c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:40.711485 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9bdc8-cea2-4438-8325-e529e2f71c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:40.712142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9bdc8-cea2-4438-8325-e529e2f71c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:40.714116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9bdc8-cea2-4438-8325-e529e2f71c55 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:40.802297 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 978/1950] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:40 2022] POST /identity/v3/projects => generated 359 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:40.806993 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed7499-9f05-4600-8f43-489d7d2bca90 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:40.816920 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed7499-9f05-4600-8f43-489d7d2bca90 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:40.873219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2e1a5-7353-41b6-b01d-9ba26e4bb42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:40.873823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2e1a5-7353-41b6-b01d-9ba26e4bb42c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:40.874103 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2e1a5-7353-41b6-b01d-9ba26e4bb42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:40.874374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2e1a5-7353-41b6-b01d-9ba26e4bb42c admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:40.875016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2e1a5-7353-41b6-b01d-9ba26e4bb42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:40.876935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2e1a5-7353-41b6-b01d-9ba26e4bb42c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:41.005815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 973/1951] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:40 2022] POST /identity/v3/users => generated 280 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:41.007031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9bdc8-cea2-4438-8325-e529e2f71c55 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:41.017247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9bdc8-cea2-4438-8325-e529e2f71c55 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:41.022065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee13ccb-555e-410d-95ae-8f128a27302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:41.022673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee13ccb-555e-410d-95ae-8f128a27302c admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:41.022952 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee13ccb-555e-410d-95ae-8f128a27302c admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:41.023224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee13ccb-555e-410d-95ae-8f128a27302c admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:41.025698 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee13ccb-555e-410d-95ae-8f128a27302c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:41.026943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee13ccb-555e-410d-95ae-8f128a27302c admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:41.038288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 979/1952] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:41.042699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2e1a5-7353-41b6-b01d-9ba26e4bb42c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:41.060984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2e1a5-7353-41b6-b01d-9ba26e4bb42c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:41.071198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23649e41-2546-43f3-9842-ee94f2aca07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:41.071874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23649e41-2546-43f3-9842-ee94f2aca07b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:41.072157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23649e41-2546-43f3-9842-ee94f2aca07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:41.072432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23649e41-2546-43f3-9842-ee94f2aca07b admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:41.073152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23649e41-2546-43f3-9842-ee94f2aca07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:41.074789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23649e41-2546-43f3-9842-ee94f2aca07b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:41.088386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 974/1953] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:41.092285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee13ccb-555e-410d-95ae-8f128a27302c admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:41.103145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee13ccb-555e-410d-95ae-8f128a27302c admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:41.107849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22d88a-e262-4edf-840e-7c6e711c2bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:41.108508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22d88a-e262-4edf-840e-7c6e711c2bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:41.108784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22d88a-e262-4edf-840e-7c6e711c2bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:41.109088 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22d88a-e262-4edf-840e-7c6e711c2bfb admin admin] PATH_INFO: `/v3/projects/ec2d123c4890427bae0c2aed3ebaf70e/users/a44cd4761644462cb0161e67f9062de7/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:41.124637 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22d88a-e262-4edf-840e-7c6e711c2bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2d123c4890427bae0c2aed3ebaf70e, user_id=a44cd4761644462cb0161e67f9062de7, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:41.128914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22d88a-e262-4edf-840e-7c6e711c2bfb admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:41.256060 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 980/1954] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:41 2022] PUT /identity/v3/projects/ec2d123c4890427bae0c2aed3ebaf70e/users/a44cd4761644462cb0161e67f9062de7/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:41.268782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7f72-8786-444d-8949-78e61a6ad2dc None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:41.269260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7f72-8786-444d-8949-78e61a6ad2dc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:41.269535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7f72-8786-444d-8949-78e61a6ad2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:41.303330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-324f7f72-8786-444d-8949-78e61a6ad2dc None None] MFA Rules not processed for user `a44cd4761644462cb0161e67f9062de7`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:41.305079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-324f7f72-8786-444d-8949-78e61a6ad2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:41.386224 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 975/1955] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:41.557491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:41.590634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22d88a-e262-4edf-840e-7c6e711c2bfb admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:41.593565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-de22d88a-e262-4edf-840e-7c6e711c2bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:41.676138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f7f72-8786-444d-8949-78e61a6ad2dc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:41.678441 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-324f7f72-8786-444d-8949-78e61a6ad2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:41.691135 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22d88a-e262-4edf-840e-7c6e711c2bfb admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:41.696885 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5cf50-3f49-4346-b570-8a128627505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:41.698384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5cf50-3f49-4346-b570-8a128627505f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:41.698894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5cf50-3f49-4346-b570-8a128627505f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:41.699374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5cf50-3f49-4346-b570-8a128627505f admin admin] PATH_INFO: `/v3/users/1ab6880cd4e94bcc90b00841c59fcc0b` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:41.700839 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5cf50-3f49-4346-b570-8a128627505f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab6880cd4e94bcc90b00841c59fcc0b)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:41.703723 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5cf50-3f49-4346-b570-8a128627505f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:41.743257 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f7f72-8786-444d-8949-78e61a6ad2dc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:41.747261 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29c775-52dd-4886-853d-bf17520f30b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:41.747889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c775-52dd-4886-853d-bf17520f30b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:41.748161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c775-52dd-4886-853d-bf17520f30b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:41.748595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c775-52dd-4886-853d-bf17520f30b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:41.766088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29c775-52dd-4886-853d-bf17520f30b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:41.767748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29c775-52dd-4886-853d-bf17520f30b4 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:41.777958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 976/1956] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:41.799886 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29c775-52dd-4886-853d-bf17520f30b4 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:41.811512 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29c775-52dd-4886-853d-bf17520f30b4 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:41.818420 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df9a00-6d3f-4695-ab04-069f953a0a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:41.821360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df9a00-6d3f-4695-ab04-069f953a0a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:41.821360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df9a00-6d3f-4695-ab04-069f953a0a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:41.821360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df9a00-6d3f-4695-ab04-069f953a0a09 admin admin] PATH_INFO: `/v3/users/a44cd4761644462cb0161e67f9062de7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:41.821360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df9a00-6d3f-4695-ab04-069f953a0a09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a44cd4761644462cb0161e67f9062de7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:41.823119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df9a00-6d3f-4695-ab04-069f953a0a09 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:41.901957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bea5cf50-3f49-4346-b570-8a128627505f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab6880cd4e94bcc90b00841c59fcc0b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:41.983664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bea5cf50-3f49-4346-b570-8a128627505f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab6880cd4e94bcc90b00841c59fcc0b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:41.984395 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bea5cf50-3f49-4346-b570-8a128627505f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab6880cd4e94bcc90b00841c59fcc0b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:41.992540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bea5cf50-3f49-4346-b570-8a128627505f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab6880cd4e94bcc90b00841c59fcc0b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:42.006738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bea5cf50-3f49-4346-b570-8a128627505f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab6880cd4e94bcc90b00841c59fcc0b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:42.019437 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 981/1957] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:41 2022] DELETE /identity/v3/users/1ab6880cd4e94bcc90b00841c59fcc0b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:42.019437 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5cf50-3f49-4346-b570-8a128627505f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:42.019437 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-bea5cf50-3f49-4346-b570-8a128627505f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:42.033686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b7df9a00-6d3f-4695-ab04-069f953a0a09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a44cd4761644462cb0161e67f9062de7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:42.038738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:42.050384 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b7df9a00-6d3f-4695-ab04-069f953a0a09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a44cd4761644462cb0161e67f9062de7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:42.084072 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b7df9a00-6d3f-4695-ab04-069f953a0a09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a44cd4761644462cb0161e67f9062de7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:42.106871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5cf50-3f49-4346-b570-8a128627505f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:42.113280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec923312-23b3-48ed-81cd-a748f4efb75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:42.114465 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec923312-23b3-48ed-81cd-a748f4efb75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:42.115054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec923312-23b3-48ed-81cd-a748f4efb75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:42.116059 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec923312-23b3-48ed-81cd-a748f4efb75d admin admin] PATH_INFO: `/v3/users/6ed5796d8871406abd3a48f8340f9f1e` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:42.117471 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec923312-23b3-48ed-81cd-a748f4efb75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed5796d8871406abd3a48f8340f9f1e)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:42.119475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec923312-23b3-48ed-81cd-a748f4efb75d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:42.168814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b7df9a00-6d3f-4695-ab04-069f953a0a09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a44cd4761644462cb0161e67f9062de7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:42.169544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b7df9a00-6d3f-4695-ab04-069f953a0a09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a44cd4761644462cb0161e67f9062de7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:42.176846 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 977/1958] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:41 2022] DELETE /identity/v3/users/a44cd4761644462cb0161e67f9062de7 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:42.179213 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063b68e-65f7-4300-8c40-ec6b1a37e827 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:42.179709 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063b68e-65f7-4300-8c40-ec6b1a37e827 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:42.180373 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063b68e-65f7-4300-8c40-ec6b1a37e827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:42.202660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1063b68e-65f7-4300-8c40-ec6b1a37e827 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:42.217168 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1063b68e-65f7-4300-8c40-ec6b1a37e827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:42.272108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 978/1959] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:42.272108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27c373-da39-4167-8ba5-dbd853e30e2c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:42.272108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27c373-da39-4167-8ba5-dbd853e30e2c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:42.272108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27c373-da39-4167-8ba5-dbd853e30e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:42.290692 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0e27c373-da39-4167-8ba5-dbd853e30e2c None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:42.291934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0e27c373-da39-4167-8ba5-dbd853e30e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:42.299924 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 979/1960] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:42.304212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27c373-da39-4167-8ba5-dbd853e30e2c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:42.304212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0e27c373-da39-4167-8ba5-dbd853e30e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:42.364702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27c373-da39-4167-8ba5-dbd853e30e2c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:42.368440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a2e30-b294-4db3-8614-557b4c7e0561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:42.369085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a2e30-b294-4db3-8614-557b4c7e0561 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:42.369360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a2e30-b294-4db3-8614-557b4c7e0561 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:42.369629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a2e30-b294-4db3-8614-557b4c7e0561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:42.380462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a2e30-b294-4db3-8614-557b4c7e0561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:42.382121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a2e30-b294-4db3-8614-557b4c7e0561 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:42.392546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 980/1961] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:42.393208 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a2e30-b294-4db3-8614-557b4c7e0561 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:42.401358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a2e30-b294-4db3-8614-557b4c7e0561 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:42.405088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9a199-8920-4c96-ba3b-a77ad075d33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:42.405617 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9a199-8920-4c96-ba3b-a77ad075d33d service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:42.411978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9a199-8920-4c96-ba3b-a77ad075d33d service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:42.412308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9a199-8920-4c96-ba3b-a77ad075d33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:42.427011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9a199-8920-4c96-ba3b-a77ad075d33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:42.428468 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9a199-8920-4c96-ba3b-a77ad075d33d service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:42.436794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ec923312-23b3-48ed-81cd-a748f4efb75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed5796d8871406abd3a48f8340f9f1e'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:42.439595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 981/1962] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:42.528683 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ec923312-23b3-48ed-81cd-a748f4efb75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed5796d8871406abd3a48f8340f9f1e'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:42.529780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ec923312-23b3-48ed-81cd-a748f4efb75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed5796d8871406abd3a48f8340f9f1e'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:42.539432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ec923312-23b3-48ed-81cd-a748f4efb75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed5796d8871406abd3a48f8340f9f1e'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:42.557453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ec923312-23b3-48ed-81cd-a748f4efb75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed5796d8871406abd3a48f8340f9f1e'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:42.575364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 982/1963] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:42 2022] DELETE /identity/v3/users/6ed5796d8871406abd3a48f8340f9f1e => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:42.579992 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f93a9-54bf-40d4-8fe5-874c2ee0dfd3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:42.580284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f93a9-54bf-40d4-8fe5-874c2ee0dfd3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:42.580563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f93a9-54bf-40d4-8fe5-874c2ee0dfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:42.608821 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0d9f93a9-54bf-40d4-8fe5-874c2ee0dfd3 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:42.610196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0d9f93a9-54bf-40d4-8fe5-874c2ee0dfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:42.712589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 982/1964] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:42.737649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec923312-23b3-48ed-81cd-a748f4efb75d admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:42.740302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ec923312-23b3-48ed-81cd-a748f4efb75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:42.836333 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec923312-23b3-48ed-81cd-a748f4efb75d admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:42.842370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b955bbb-8083-4216-8216-70bdc4d31a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:42.843290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b955bbb-8083-4216-8216-70bdc4d31a1a service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:42.843677 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b955bbb-8083-4216-8216-70bdc4d31a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:42.844016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b955bbb-8083-4216-8216-70bdc4d31a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:42.858370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b955bbb-8083-4216-8216-70bdc4d31a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:42.859891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b955bbb-8083-4216-8216-70bdc4d31a1a service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:42.885215 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 983/1965] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:42.982184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f93a9-54bf-40d4-8fe5-874c2ee0dfd3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:42.983735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0d9f93a9-54bf-40d4-8fe5-874c2ee0dfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:43.000775 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f93a9-54bf-40d4-8fe5-874c2ee0dfd3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:43.006256 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:43.006907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:43.007189 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:43.007466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] PATH_INFO: `/v3/projects/eec663c659ae475c9cdc33eecba5ce51` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:43.008612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec663c659ae475c9cdc33eecba5ce51)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:43.010659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:43.075533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b955bbb-8083-4216-8216-70bdc4d31a1a service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:43.077405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5b955bbb-8083-4216-8216-70bdc4d31a1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:43.095991 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b955bbb-8083-4216-8216-70bdc4d31a1a service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:43.110577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bf9df-752a-4904-8a98-9ba96aebef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:43.110577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bf9df-752a-4904-8a98-9ba96aebef85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:43.110577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bf9df-752a-4904-8a98-9ba96aebef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:43.110987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bf9df-752a-4904-8a98-9ba96aebef85 admin admin] PATH_INFO: `/v3/projects/ec2d123c4890427bae0c2aed3ebaf70e` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:43.112274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bf9df-752a-4904-8a98-9ba96aebef85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec2d123c4890427bae0c2aed3ebaf70e)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:43.115003 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bf9df-752a-4904-8a98-9ba96aebef85 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:43.124828 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec663c659ae475c9cdc33eecba5ce51', 'request_id': 'req-ef6c3210-9955-445c-8280-d8979e0231b6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.132601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec663c659ae475c9cdc33eecba5ce51', 'request_id': 'req-ef6c3210-9955-445c-8280-d8979e0231b6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.141148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec663c659ae475c9cdc33eecba5ce51', 'request_id': 'req-ef6c3210-9955-445c-8280-d8979e0231b6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.240577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] The token cache is being invalidate because project eec663c659ae475c9cdc33eecba5ce51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:43.240877 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.244520 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.248125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 983/1966] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:42 2022] DELETE /identity/v3/projects/eec663c659ae475c9cdc33eecba5ce51 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:43.252106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:43.254579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:43.264627 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3c8bf9df-752a-4904-8a98-9ba96aebef85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec2d123c4890427bae0c2aed3ebaf70e', 'request_id': 'req-3c8bf9df-752a-4904-8a98-9ba96aebef85'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.273289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3c8bf9df-752a-4904-8a98-9ba96aebef85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec2d123c4890427bae0c2aed3ebaf70e', 'request_id': 'req-3c8bf9df-752a-4904-8a98-9ba96aebef85'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.326834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:43.341425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c3210-9955-445c-8280-d8979e0231b6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:43.383241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3c8bf9df-752a-4904-8a98-9ba96aebef85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec2d123c4890427bae0c2aed3ebaf70e', 'request_id': 'req-3c8bf9df-752a-4904-8a98-9ba96aebef85'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.394968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3c8bf9df-752a-4904-8a98-9ba96aebef85 admin admin] The token cache is being invalidate because project ec2d123c4890427bae0c2aed3ebaf70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:43.395251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3c8bf9df-752a-4904-8a98-9ba96aebef85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.395884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3c8bf9df-752a-4904-8a98-9ba96aebef85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.397407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 984/1967] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:43 2022] DELETE /identity/v3/projects/ec2d123c4890427bae0c2aed3ebaf70e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:43.402055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4d035-36ee-4d70-96d9-af4dc99548b4 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:43.402360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4d035-36ee-4d70-96d9-af4dc99548b4 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:43.402634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4d035-36ee-4d70-96d9-af4dc99548b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:43.406157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492215c-4cb2-4f5e-ba3f-679445d84cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:43.406926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492215c-4cb2-4f5e-ba3f-679445d84cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:43.407291 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492215c-4cb2-4f5e-ba3f-679445d84cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:43.407628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492215c-4cb2-4f5e-ba3f-679445d84cc2 admin admin] PATH_INFO: `/v3/users/fb2b6a35ebde453c8860427233c34631` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:43.408857 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492215c-4cb2-4f5e-ba3f-679445d84cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2b6a35ebde453c8860427233c34631)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:43.412017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492215c-4cb2-4f5e-ba3f-679445d84cc2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:43.423608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-afc4d035-36ee-4d70-96d9-af4dc99548b4 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:43.424843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-afc4d035-36ee-4d70-96d9-af4dc99548b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:43.435713 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 985/1968] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:43.443112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cb95e-13b8-4807-ba9b-1eb8deaf4932 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:43.443686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cb95e-13b8-4807-ba9b-1eb8deaf4932 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:43.443686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cb95e-13b8-4807-ba9b-1eb8deaf4932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:43.465373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-562cb95e-13b8-4807-ba9b-1eb8deaf4932 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:43.466725 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-562cb95e-13b8-4807-ba9b-1eb8deaf4932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:43.475404 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 986/1969] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:43.480066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cb95e-13b8-4807-ba9b-1eb8deaf4932 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:43.490359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cb95e-13b8-4807-ba9b-1eb8deaf4932 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:43.495437 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e76a0-4fb3-415a-993e-27a44328418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:43.496097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e76a0-4fb3-415a-993e-27a44328418f admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:43.496428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e76a0-4fb3-415a-993e-27a44328418f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:43.496731 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e76a0-4fb3-415a-993e-27a44328418f admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:43.497445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e76a0-4fb3-415a-993e-27a44328418f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:43.497780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e76a0-4fb3-415a-993e-27a44328418f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:43.500020 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e76a0-4fb3-415a-993e-27a44328418f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:43.513663 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 987/1970] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:41:43.527033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e76a0-4fb3-415a-993e-27a44328418f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:43.528961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-785e76a0-4fb3-415a-993e-27a44328418f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:43.554127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e76a0-4fb3-415a-993e-27a44328418f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:43.562296 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:43.563588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:43.563869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:43.564140 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] PATH_INFO: `/v3/projects/0925c1cadde34dbd9b458b639696cfee` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:43.565323 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0925c1cadde34dbd9b458b639696cfee)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:43.567380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:43.620811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7492215c-4cb2-4f5e-ba3f-679445d84cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2b6a35ebde453c8860427233c34631'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.628396 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7492215c-4cb2-4f5e-ba3f-679445d84cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2b6a35ebde453c8860427233c34631'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.640482 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7492215c-4cb2-4f5e-ba3f-679445d84cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2b6a35ebde453c8860427233c34631'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.694142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0925c1cadde34dbd9b458b639696cfee', 'request_id': 'req-466143c0-d962-445f-92a2-338aab387c33'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.700864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0925c1cadde34dbd9b458b639696cfee', 'request_id': 'req-466143c0-d962-445f-92a2-338aab387c33'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.703919 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:43.705890 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7492215c-4cb2-4f5e-ba3f-679445d84cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2b6a35ebde453c8860427233c34631'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.706573 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7492215c-4cb2-4f5e-ba3f-679445d84cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2b6a35ebde453c8860427233c34631'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.716894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 984/1971] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:43 2022] DELETE /identity/v3/users/fb2b6a35ebde453c8860427233c34631 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:43.717761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492215c-4cb2-4f5e-ba3f-679445d84cc2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:43.719238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7492215c-4cb2-4f5e-ba3f-679445d84cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:43.778728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0925c1cadde34dbd9b458b639696cfee', 'request_id': 'req-466143c0-d962-445f-92a2-338aab387c33'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.792483 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] The token cache is being invalidate because project 0925c1cadde34dbd9b458b639696cfee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:43.793067 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.793934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:43.795556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 988/1972] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:43 2022] DELETE /identity/v3/projects/0925c1cadde34dbd9b458b639696cfee => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:43.800269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:43.802322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:43.806865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492215c-4cb2-4f5e-ba3f-679445d84cc2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:43.818258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcdd89-5103-4fa1-8bb3-40eb83d700d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:43.818611 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcdd89-5103-4fa1-8bb3-40eb83d700d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:43.819043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcdd89-5103-4fa1-8bb3-40eb83d700d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:43.819320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcdd89-5103-4fa1-8bb3-40eb83d700d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:43.819993 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcdd89-5103-4fa1-8bb3-40eb83d700d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:43.822034 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcdd89-5103-4fa1-8bb3-40eb83d700d4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:43.876388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466143c0-d962-445f-92a2-338aab387c33 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:43.883015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d1f63-b5d6-4977-9c7b-305c4acee1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:43.883654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1f63-b5d6-4977-9c7b-305c4acee1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:43.883950 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1f63-b5d6-4977-9c7b-305c4acee1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:43.884213 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1f63-b5d6-4977-9c7b-305c4acee1a0 admin admin] PATH_INFO: `/v3/users/07e38944acfc4709926c9dd8faa0cc9a` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:43.885734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d1f63-b5d6-4977-9c7b-305c4acee1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e38944acfc4709926c9dd8faa0cc9a)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:43.887684 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d1f63-b5d6-4977-9c7b-305c4acee1a0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:43.945929 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 985/1973] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:43 2022] POST /identity/v3/projects => generated 371 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:43.948245 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcdd89-5103-4fa1-8bb3-40eb83d700d4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:43.950416 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3dfcdd89-5103-4fa1-8bb3-40eb83d700d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:44.044309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcdd89-5103-4fa1-8bb3-40eb83d700d4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:44.049087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39459c5-651c-45df-b518-2d5d3637d087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:44.049987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39459c5-651c-45df-b518-2d5d3637d087 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:44.055594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39459c5-651c-45df-b518-2d5d3637d087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:44.055594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39459c5-651c-45df-b518-2d5d3637d087 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:44.055594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39459c5-651c-45df-b518-2d5d3637d087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:44.055594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39459c5-651c-45df-b518-2d5d3637d087 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:44.152154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-453d1f63-b5d6-4977-9c7b-305c4acee1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e38944acfc4709926c9dd8faa0cc9a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:44.174717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 986/1974] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:43 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:44.181554 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39459c5-651c-45df-b518-2d5d3637d087 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:44.192752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39459c5-651c-45df-b518-2d5d3637d087 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:44.198897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a93411-76cd-42c6-8230-fc2502397918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:44.198897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a93411-76cd-42c6-8230-fc2502397918 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:44.198897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a93411-76cd-42c6-8230-fc2502397918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:44.198897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a93411-76cd-42c6-8230-fc2502397918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:44.199269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a93411-76cd-42c6-8230-fc2502397918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:44.200879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a93411-76cd-42c6-8230-fc2502397918 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:44.216722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 987/1975] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:44.220665 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a93411-76cd-42c6-8230-fc2502397918 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:44.234567 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a93411-76cd-42c6-8230-fc2502397918 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:44.237687 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-453d1f63-b5d6-4977-9c7b-305c4acee1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e38944acfc4709926c9dd8faa0cc9a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:44.239954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-453d1f63-b5d6-4977-9c7b-305c4acee1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e38944acfc4709926c9dd8faa0cc9a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:44.241701 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143922da-bc07-406f-afc8-a3cbefb90814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:44.241701 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143922da-bc07-406f-afc8-a3cbefb90814 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:44.242464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143922da-bc07-406f-afc8-a3cbefb90814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:44.242464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143922da-bc07-406f-afc8-a3cbefb90814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:44.243029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143922da-bc07-406f-afc8-a3cbefb90814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:44.246434 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143922da-bc07-406f-afc8-a3cbefb90814 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:44.260370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-453d1f63-b5d6-4977-9c7b-305c4acee1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e38944acfc4709926c9dd8faa0cc9a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:44.264387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 988/1976] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:44.264387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143922da-bc07-406f-afc8-a3cbefb90814 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:44.264387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-143922da-bc07-406f-afc8-a3cbefb90814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:44.281399 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143922da-bc07-406f-afc8-a3cbefb90814 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:44.289836 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:44.290590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:44.290976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:44.291368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7 admin admin] PATH_INFO: `/v3/projects/4fe2e27dd7944dfab78d5859b237d311` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:44.292720 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe2e27dd7944dfab78d5859b237d311)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:44.295054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:44.295294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-453d1f63-b5d6-4977-9c7b-305c4acee1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e38944acfc4709926c9dd8faa0cc9a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:44.313516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 989/1977] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:43 2022] DELETE /identity/v3/users/07e38944acfc4709926c9dd8faa0cc9a => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:44.313516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d1f63-b5d6-4977-9c7b-305c4acee1a0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:44.313935 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-453d1f63-b5d6-4977-9c7b-305c4acee1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:44.391714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d1f63-b5d6-4977-9c7b-305c4acee1a0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:44.397807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f2861-156d-4703-b8f0-678f0e055c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:44.398595 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f2861-156d-4703-b8f0-678f0e055c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:44.399137 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f2861-156d-4703-b8f0-678f0e055c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:44.399493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f2861-156d-4703-b8f0-678f0e055c43 admin admin] PATH_INFO: `/v3/projects/9ac94e862b86434b97af260688f8ef71/users/924902491c284ea7b7da4f69b36c9df7/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:44.422446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f2861-156d-4703-b8f0-678f0e055c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac94e862b86434b97af260688f8ef71, user_id=924902491c284ea7b7da4f69b36c9df7, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:44.427727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f2861-156d-4703-b8f0-678f0e055c43 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:44.436470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe2e27dd7944dfab78d5859b237d311', 'request_id': 'req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:44.444725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe2e27dd7944dfab78d5859b237d311', 'request_id': 'req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:44.450930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe2e27dd7944dfab78d5859b237d311', 'request_id': 'req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:44.494414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 990/1978] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:44 2022] PUT /identity/v3/projects/9ac94e862b86434b97af260688f8ef71/users/924902491c284ea7b7da4f69b36c9df7/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:44.505347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84e791-4176-4cc2-b2cf-beaf928e57e7 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:44.505821 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84e791-4176-4cc2-b2cf-beaf928e57e7 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:44.506275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84e791-4176-4cc2-b2cf-beaf928e57e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:44.512830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7 admin admin] The token cache is being invalidate because project 4fe2e27dd7944dfab78d5859b237d311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:44.513325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:44.514088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f5d560f9-2c32-4d0a-9f5a-6df4b29b32f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:44.516017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 989/1979] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:44 2022] DELETE /identity/v3/projects/4fe2e27dd7944dfab78d5859b237d311 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:44.520955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a98e72-fa97-457b-9b02-3925107ab377 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:44.521987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a98e72-fa97-457b-9b02-3925107ab377 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:44.521987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a98e72-fa97-457b-9b02-3925107ab377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:44.538716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ac84e791-4176-4cc2-b2cf-beaf928e57e7 None None] MFA Rules not processed for user `924902491c284ea7b7da4f69b36c9df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:44.539943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ac84e791-4176-4cc2-b2cf-beaf928e57e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:44.541560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b1a98e72-fa97-457b-9b02-3925107ab377 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:44.542802 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b1a98e72-fa97-457b-9b02-3925107ab377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:44.644341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 990/1980] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:44.654950 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89543654-5cd5-495f-93a0-446adf208b9c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:44.655448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89543654-5cd5-495f-93a0-446adf208b9c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:44.657320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89543654-5cd5-495f-93a0-446adf208b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:44.667188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 991/1981] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:44.679802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84e791-4176-4cc2-b2cf-beaf928e57e7 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:44.681314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ac84e791-4176-4cc2-b2cf-beaf928e57e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:44.688009 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-89543654-5cd5-495f-93a0-446adf208b9c None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:44.689505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-89543654-5cd5-495f-93a0-446adf208b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:44.709204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 991/1982] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:44.710490 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89543654-5cd5-495f-93a0-446adf208b9c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:44.720123 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89543654-5cd5-495f-93a0-446adf208b9c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:44.726919 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cf685-d2bc-41ef-81b2-871f6ac1291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:44.732302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cf685-d2bc-41ef-81b2-871f6ac1291e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:44.732302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cf685-d2bc-41ef-81b2-871f6ac1291e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:44.732302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cf685-d2bc-41ef-81b2-871f6ac1291e admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:44.732302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cf685-d2bc-41ef-81b2-871f6ac1291e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:44.732302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cf685-d2bc-41ef-81b2-871f6ac1291e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:44.732302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cf685-d2bc-41ef-81b2-871f6ac1291e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:44.756896 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 992/1983] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:41:44.764488 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cf685-d2bc-41ef-81b2-871f6ac1291e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:44.775432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cf685-d2bc-41ef-81b2-871f6ac1291e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:44.780780 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dc8fe-5777-4275-a632-873e22a360c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:44.781467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc8fe-5777-4275-a632-873e22a360c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:44.781752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc8fe-5777-4275-a632-873e22a360c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:44.782144 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc8fe-5777-4275-a632-873e22a360c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:44.782782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dc8fe-5777-4275-a632-873e22a360c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:44.784840 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dc8fe-5777-4275-a632-873e22a360c8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:44.791961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84e791-4176-4cc2-b2cf-beaf928e57e7 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:44.804069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55840047-cb92-48d3-8d0e-17bea553072d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ba9aba795f423a8ffabe419b64507a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:44.804069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55840047-cb92-48d3-8d0e-17bea553072d service glance] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:44.804069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55840047-cb92-48d3-8d0e-17bea553072d service glance] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:44.804069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55840047-cb92-48d3-8d0e-17bea553072d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:44.813164 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55840047-cb92-48d3-8d0e-17bea553072d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:44.814623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55840047-cb92-48d3-8d0e-17bea553072d service glance] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:44.824864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 992/1984] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:41:44.854984 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55840047-cb92-48d3-8d0e-17bea553072d service glance] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:44.856671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-55840047-cb92-48d3-8d0e-17bea553072d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:44.871605 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55840047-cb92-48d3-8d0e-17bea553072d service glance] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:44.876436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b74669-d78d-4820-9f02-20669f23334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:44.877513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b74669-d78d-4820-9f02-20669f23334c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:44.877938 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b74669-d78d-4820-9f02-20669f23334c admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:44.878356 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b74669-d78d-4820-9f02-20669f23334c admin admin] PATH_INFO: `/v3/projects/22ae8f29adbd417699993f47121f2144` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:44.880366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b74669-d78d-4820-9f02-20669f23334c admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ae8f29adbd417699993f47121f2144)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:44.882502 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b74669-d78d-4820-9f02-20669f23334c admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:44.907626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 993/1985] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:44 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:44.911338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dc8fe-5777-4275-a632-873e22a360c8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:44.991117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dc8fe-5777-4275-a632-873e22a360c8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:44.996069 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878b93e-e2ba-4002-a229-455f3c399d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:44.996679 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878b93e-e2ba-4002-a229-455f3c399d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:44.996963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878b93e-e2ba-4002-a229-455f3c399d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:44.997336 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878b93e-e2ba-4002-a229-455f3c399d89 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:44.997982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878b93e-e2ba-4002-a229-455f3c399d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:44.999921 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878b93e-e2ba-4002-a229-455f3c399d89 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:45.039897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-62b74669-d78d-4820-9f02-20669f23334c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ae8f29adbd417699993f47121f2144', 'request_id': 'req-62b74669-d78d-4820-9f02-20669f23334c'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:45.046985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-62b74669-d78d-4820-9f02-20669f23334c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ae8f29adbd417699993f47121f2144', 'request_id': 'req-62b74669-d78d-4820-9f02-20669f23334c'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:45.074520 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:45.107595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 994/1986] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:44 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:45.108925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878b93e-e2ba-4002-a229-455f3c399d89 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:45.119163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878b93e-e2ba-4002-a229-455f3c399d89 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:45.144284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-62b74669-d78d-4820-9f02-20669f23334c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ae8f29adbd417699993f47121f2144', 'request_id': 'req-62b74669-d78d-4820-9f02-20669f23334c'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:45.162693 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-62b74669-d78d-4820-9f02-20669f23334c admin admin] The token cache is being invalidate because project 22ae8f29adbd417699993f47121f2144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:45.163164 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-62b74669-d78d-4820-9f02-20669f23334c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:45.164065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-62b74669-d78d-4820-9f02-20669f23334c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:45.168967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 993/1987] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:44 2022] DELETE /identity/v3/projects/22ae8f29adbd417699993f47121f2144 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:45.180849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead9c0-fa57-4420-8ad5-0bca3dc6d213 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.181259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead9c0-fa57-4420-8ad5-0bca3dc6d213 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.181629 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead9c0-fa57-4420-8ad5-0bca3dc6d213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.204922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-86ead9c0-fa57-4420-8ad5-0bca3dc6d213 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:45.206288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-86ead9c0-fa57-4420-8ad5-0bca3dc6d213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:45.220923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717f21f-4112-4376-9085-f510d8ea31c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:45.222147 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f21f-4112-4376-9085-f510d8ea31c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.224158 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f21f-4112-4376-9085-f510d8ea31c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.224633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f21f-4112-4376-9085-f510d8ea31c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.225377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717f21f-4112-4376-9085-f510d8ea31c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:45.228615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717f21f-4112-4376-9085-f510d8ea31c8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:45.248827 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 995/1988] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:45.252253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717f21f-4112-4376-9085-f510d8ea31c8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:45.267308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4717f21f-4112-4376-9085-f510d8ea31c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:45.282425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 994/1989] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:45.282690 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717f21f-4112-4376-9085-f510d8ea31c8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:45.290648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb57c3-48eb-4aff-b14f-0f644be41fb6 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.291138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb57c3-48eb-4aff-b14f-0f644be41fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.291466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb57c3-48eb-4aff-b14f-0f644be41fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.293569 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a06470-7c33-4834-a74f-5539ffbf29cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:45.294400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a06470-7c33-4834-a74f-5539ffbf29cc admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.294690 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a06470-7c33-4834-a74f-5539ffbf29cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.294962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a06470-7c33-4834-a74f-5539ffbf29cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.295647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a06470-7c33-4834-a74f-5539ffbf29cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:45.297304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a06470-7c33-4834-a74f-5539ffbf29cc admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:45.313184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 996/1990] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:45.314314 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a06470-7c33-4834-a74f-5539ffbf29cc admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:45.314906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-39fb57c3-48eb-4aff-b14f-0f644be41fb6 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:45.316347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-39fb57c3-48eb-4aff-b14f-0f644be41fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:45.326525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a06470-7c33-4834-a74f-5539ffbf29cc admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:45.327191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 995/1991] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:45.331711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb57c3-48eb-4aff-b14f-0f644be41fb6 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:45.332121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af945681-cade-419e-9ebf-63ed068dc957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:45.332949 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af945681-cade-419e-9ebf-63ed068dc957 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.333255 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af945681-cade-419e-9ebf-63ed068dc957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.333519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af945681-cade-419e-9ebf-63ed068dc957 admin admin] PATH_INFO: `/v3/projects/49dacf9c77ac40429ffbf1fae1f64032/users/a5125ebabe9142aea1d60fafe757ade8/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.342303 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb57c3-48eb-4aff-b14f-0f644be41fb6 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:45.347188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:45.351695 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af945681-cade-419e-9ebf-63ed068dc957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49dacf9c77ac40429ffbf1fae1f64032, user_id=a5125ebabe9142aea1d60fafe757ade8, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:45.352866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf9e56-8a86-4a2e-aeee-863332921f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:45.355655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf9e56-8a86-4a2e-aeee-863332921f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.355655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf9e56-8a86-4a2e-aeee-863332921f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.355655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf9e56-8a86-4a2e-aeee-863332921f03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.355655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf9e56-8a86-4a2e-aeee-863332921f03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:45.355969 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af945681-cade-419e-9ebf-63ed068dc957 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:45.356055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf9e56-8a86-4a2e-aeee-863332921f03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:45.356856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf9e56-8a86-4a2e-aeee-863332921f03 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:45.370003 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 996/1992] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:41:45.374282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf9e56-8a86-4a2e-aeee-863332921f03 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:45.384555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf9e56-8a86-4a2e-aeee-863332921f03 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:45.389239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd22f37-6943-4420-a4cd-ba214fe5fb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:45.389870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd22f37-6943-4420-a4cd-ba214fe5fb26 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.390141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd22f37-6943-4420-a4cd-ba214fe5fb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.390409 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd22f37-6943-4420-a4cd-ba214fe5fb26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.391061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd22f37-6943-4420-a4cd-ba214fe5fb26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:45.393080 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd22f37-6943-4420-a4cd-ba214fe5fb26 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:45.442869 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 997/1993] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:45 2022] PUT /identity/v3/projects/49dacf9c77ac40429ffbf1fae1f64032/users/a5125ebabe9142aea1d60fafe757ade8/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:45.453567 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd64475-fdd5-40d2-8298-bb22ce0463df None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.458502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd64475-fdd5-40d2-8298-bb22ce0463df None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.458502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd64475-fdd5-40d2-8298-bb22ce0463df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.483334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8cd64475-fdd5-40d2-8298-bb22ce0463df None None] MFA Rules not processed for user `a5125ebabe9142aea1d60fafe757ade8`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:45.484448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8cd64475-fdd5-40d2-8298-bb22ce0463df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:45.495945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 997/1994] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:45 2022] POST /identity/v3/projects => generated 399 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:45.500007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd22f37-6943-4420-a4cd-ba214fe5fb26 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:45.554861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 998/1995] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:45.559401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd64475-fdd5-40d2-8298-bb22ce0463df None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:45.566304 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd22f37-6943-4420-a4cd-ba214fe5fb26 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:45.571011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e659f-c6d7-4fd4-9f6f-c7e95caed44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:45.571627 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e659f-c6d7-4fd4-9f6f-c7e95caed44a admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.571901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e659f-c6d7-4fd4-9f6f-c7e95caed44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.572256 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e659f-c6d7-4fd4-9f6f-c7e95caed44a admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.572819 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e659f-c6d7-4fd4-9f6f-c7e95caed44a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:45.574764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e659f-c6d7-4fd4-9f6f-c7e95caed44a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:45.620703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd64475-fdd5-40d2-8298-bb22ce0463df None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:45.625383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6e3b2-8332-4071-99f7-090f996dba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:45.625984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6e3b2-8332-4071-99f7-090f996dba1c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.626263 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6e3b2-8332-4071-99f7-090f996dba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.626536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6e3b2-8332-4071-99f7-090f996dba1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.627162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6e3b2-8332-4071-99f7-090f996dba1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:45.629150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6e3b2-8332-4071-99f7-090f996dba1c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:45.666694 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 998/1996] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:45 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:45.670865 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e659f-c6d7-4fd4-9f6f-c7e95caed44a admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:45.682994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e659f-c6d7-4fd4-9f6f-c7e95caed44a admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:45.688716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407d30c-9eaa-4342-bf64-2ec22a4b11c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:45.689771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407d30c-9eaa-4342-bf64-2ec22a4b11c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.690157 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407d30c-9eaa-4342-bf64-2ec22a4b11c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.690503 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407d30c-9eaa-4342-bf64-2ec22a4b11c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.691220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407d30c-9eaa-4342-bf64-2ec22a4b11c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:45.697859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407d30c-9eaa-4342-bf64-2ec22a4b11c0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:45.704120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 999/1997] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:45.709738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407d30c-9eaa-4342-bf64-2ec22a4b11c0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:45.719584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407d30c-9eaa-4342-bf64-2ec22a4b11c0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:45.724859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bea9a-1077-41e2-a9c7-91a4a155d085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:45.726400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bea9a-1077-41e2-a9c7-91a4a155d085 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.726400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bea9a-1077-41e2-a9c7-91a4a155d085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.726400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bea9a-1077-41e2-a9c7-91a4a155d085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.726859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bea9a-1077-41e2-a9c7-91a4a155d085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:45.728365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bea9a-1077-41e2-a9c7-91a4a155d085 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:45.740426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1000/1998] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:45.744904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bea9a-1077-41e2-a9c7-91a4a155d085 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:45.755820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bea9a-1077-41e2-a9c7-91a4a155d085 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:45.761322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc79500-abd6-4156-a1b0-6ceb7153f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:45.762131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc79500-abd6-4156-a1b0-6ceb7153f5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.762414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc79500-abd6-4156-a1b0-6ceb7153f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.762689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc79500-abd6-4156-a1b0-6ceb7153f5bf admin admin] PATH_INFO: `/v3/projects/d3c8edfc70fa41bf8b834eddaf96dc16/users/e66424df4ee642b6a8d8dd03a1bcf909/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.765843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 999/1999] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:45 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:45.769275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6e3b2-8332-4071-99f7-090f996dba1c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:45.787338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc79500-abd6-4156-a1b0-6ceb7153f5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c8edfc70fa41bf8b834eddaf96dc16, user_id=e66424df4ee642b6a8d8dd03a1bcf909, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:45.791734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc79500-abd6-4156-a1b0-6ceb7153f5bf admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:45.854514 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6e3b2-8332-4071-99f7-090f996dba1c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:45.859249 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5c91e-4539-446e-a102-394dda804549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:45.859852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5c91e-4539-446e-a102-394dda804549 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.860129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5c91e-4539-446e-a102-394dda804549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.860402 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5c91e-4539-446e-a102-394dda804549 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.861060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5c91e-4539-446e-a102-394dda804549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:45.862979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5c91e-4539-446e-a102-394dda804549 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:45.871811 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1001/2000] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:45 2022] PUT /identity/v3/projects/d3c8edfc70fa41bf8b834eddaf96dc16/users/e66424df4ee642b6a8d8dd03a1bcf909/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:45.873462 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc79500-abd6-4156-a1b0-6ceb7153f5bf admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:45.875374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2dc79500-abd6-4156-a1b0-6ceb7153f5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:45.942554 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc79500-abd6-4156-a1b0-6ceb7153f5bf admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:45.947328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf27065-1463-44df-90fb-90df1714ad5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:45.947956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf27065-1463-44df-90fb-90df1714ad5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.948236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf27065-1463-44df-90fb-90df1714ad5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.948513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf27065-1463-44df-90fb-90df1714ad5d admin admin] PATH_INFO: `/v3/users/1c0486fe03d34ac18f81ad0fc57e5468` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:45.949688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf27065-1463-44df-90fb-90df1714ad5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c0486fe03d34ac18f81ad0fc57e5468)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:45.951611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf27065-1463-44df-90fb-90df1714ad5d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:45.988516 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1000/2001] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:45 2022] POST /identity/v3/users => generated 300 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:45.989800 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773612cc-a581-4386-aa31-a6cd06159007 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:45.990085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773612cc-a581-4386-aa31-a6cd06159007 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:45.990355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773612cc-a581-4386-aa31-a6cd06159007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:46.016795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-773612cc-a581-4386-aa31-a6cd06159007 None None] MFA Rules not processed for user `e66424df4ee642b6a8d8dd03a1bcf909`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:46.018029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-773612cc-a581-4386-aa31-a6cd06159007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:46.082827 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1001/2002] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:46.084573 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773612cc-a581-4386-aa31-a6cd06159007 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:46.094863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773612cc-a581-4386-aa31-a6cd06159007 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:46.100123 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22c078-e245-4024-9875-ac1e3ba82409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:46.100713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22c078-e245-4024-9875-ac1e3ba82409 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:46.100984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22c078-e245-4024-9875-ac1e3ba82409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:46.101272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22c078-e245-4024-9875-ac1e3ba82409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:46.101906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22c078-e245-4024-9875-ac1e3ba82409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:46.103492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22c078-e245-4024-9875-ac1e3ba82409 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:46.113162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1002/2003] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:46.115742 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22c078-e245-4024-9875-ac1e3ba82409 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:46.125371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22c078-e245-4024-9875-ac1e3ba82409 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:46.130285 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3f53e-f325-4d74-8385-965b80084caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:46.130862 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3f53e-f325-4d74-8385-965b80084caa admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:46.131136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3f53e-f325-4d74-8385-965b80084caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:46.131400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3f53e-f325-4d74-8385-965b80084caa admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:46.132021 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3f53e-f325-4d74-8385-965b80084caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:46.133962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3f53e-f325-4d74-8385-965b80084caa admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:46.168032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:46.180834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-aaf27065-1463-44df-90fb-90df1714ad5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c0486fe03d34ac18f81ad0fc57e5468'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:46.221200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1003/2004] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:46 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:46.222081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3f53e-f325-4d74-8385-965b80084caa admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:46.242654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-aaf27065-1463-44df-90fb-90df1714ad5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c0486fe03d34ac18f81ad0fc57e5468'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:46.243226 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-aaf27065-1463-44df-90fb-90df1714ad5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c0486fe03d34ac18f81ad0fc57e5468'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:46.250765 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-aaf27065-1463-44df-90fb-90df1714ad5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c0486fe03d34ac18f81ad0fc57e5468'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:46.264414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-aaf27065-1463-44df-90fb-90df1714ad5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c0486fe03d34ac18f81ad0fc57e5468'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:46.271320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1002/2005] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:45 2022] DELETE /identity/v3/users/1c0486fe03d34ac18f81ad0fc57e5468 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:46.274844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf27065-1463-44df-90fb-90df1714ad5d admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:46.276335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-aaf27065-1463-44df-90fb-90df1714ad5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:46.292121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3f53e-f325-4d74-8385-965b80084caa admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:46.355716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf27065-1463-44df-90fb-90df1714ad5d admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:46.360856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b296b7b-2012-48b9-8579-773b8f780bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:46.361569 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b296b7b-2012-48b9-8579-773b8f780bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:46.361848 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b296b7b-2012-48b9-8579-773b8f780bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:46.362119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b296b7b-2012-48b9-8579-773b8f780bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:46.362928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b296b7b-2012-48b9-8579-773b8f780bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:46.365429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b296b7b-2012-48b9-8579-773b8f780bb1 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:46.396920 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd83a9-3e90-441f-a977-d0d4ad7e696f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:46.397647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd83a9-3e90-441f-a977-d0d4ad7e696f admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:46.397932 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd83a9-3e90-441f-a977-d0d4ad7e696f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:46.398435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd83a9-3e90-441f-a977-d0d4ad7e696f admin admin] PATH_INFO: `/v3/projects/a7a259aac4bb448da1d1401fbebdcea1/users/cb32ade571034596b25c635e40b4b53e/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:46.415250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd83a9-3e90-441f-a977-d0d4ad7e696f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a259aac4bb448da1d1401fbebdcea1, user_id=cb32ade571034596b25c635e40b4b53e, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:46.418684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd83a9-3e90-441f-a977-d0d4ad7e696f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:46.462114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1003/2006] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:46 2022] POST /identity/v3/users => generated 307 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:46.463529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1974a0-8e3a-4385-b61c-5b0366808b0d None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:46.463820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1974a0-8e3a-4385-b61c-5b0366808b0d None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:46.464155 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1974a0-8e3a-4385-b61c-5b0366808b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:46.486106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-5c1974a0-8e3a-4385-b61c-5b0366808b0d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:46.487362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5c1974a0-8e3a-4385-b61c-5b0366808b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:46.505659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1004/2007] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:46 2022] PUT /identity/v3/projects/a7a259aac4bb448da1d1401fbebdcea1/users/cb32ade571034596b25c635e40b4b53e/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:46.511786 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd83a9-3e90-441f-a977-d0d4ad7e696f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:46.513300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1004/2008] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:46.515385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1974a0-8e3a-4385-b61c-5b0366808b0d None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:46.517918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5c1974a0-8e3a-4385-b61c-5b0366808b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:46.537701 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1974a0-8e3a-4385-b61c-5b0366808b0d None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:46.626734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:46.629893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f2aad-2810-47d4-989d-7d52a43178da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:46.630746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f2aad-2810-47d4-989d-7d52a43178da admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:46.631917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f2aad-2810-47d4-989d-7d52a43178da admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:46.633200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f2aad-2810-47d4-989d-7d52a43178da admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:46.634278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f2aad-2810-47d4-989d-7d52a43178da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:46.636460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f2aad-2810-47d4-989d-7d52a43178da admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:46.636610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd83a9-3e90-441f-a977-d0d4ad7e696f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:46.642054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2d6e-66de-4604-8350-6db9ab348fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:46.642743 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2d6e-66de-4604-8350-6db9ab348fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:46.643007 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2d6e-66de-4604-8350-6db9ab348fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:46.643274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2d6e-66de-4604-8350-6db9ab348fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:46.644816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb2d6e-66de-4604-8350-6db9ab348fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:46.646230 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb2d6e-66de-4604-8350-6db9ab348fcf admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:46.650042 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1005/2009] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:46.651016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f2aad-2810-47d4-989d-7d52a43178da admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:46.654669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1d0f2aad-2810-47d4-989d-7d52a43178da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:46.658396 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1005/2010] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:46.659361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2d6e-66de-4604-8350-6db9ab348fcf admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:46.674478 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2d6e-66de-4604-8350-6db9ab348fcf admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:46.681495 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90541e-1f04-4c65-a42c-a2f10dbe9b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:46.682173 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:46.682622 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90541e-1f04-4c65-a42c-a2f10dbe9b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:46.682970 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90541e-1f04-4c65-a42c-a2f10dbe9b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:46.683252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90541e-1f04-4c65-a42c-a2f10dbe9b68 admin admin] PATH_INFO: `/v3/projects/a7a259aac4bb448da1d1401fbebdcea1/users/cb32ade571034596b25c635e40b4b53e/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:46.691219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90541e-1f04-4c65-a42c-a2f10dbe9b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a259aac4bb448da1d1401fbebdcea1, user_id=cb32ade571034596b25c635e40b4b53e, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:46.691219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90541e-1f04-4c65-a42c-a2f10dbe9b68 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:46.709574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1006/2011] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:46 2022] PUT /identity/v3/projects/a7a259aac4bb448da1d1401fbebdcea1/users/cb32ade571034596b25c635e40b4b53e/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:46.709574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90541e-1f04-4c65-a42c-a2f10dbe9b68 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:46.733155 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f2aad-2810-47d4-989d-7d52a43178da admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:46.792366 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90541e-1f04-4c65-a42c-a2f10dbe9b68 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:46.793279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5018a61-3c57-4279-af77-89a94e270a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:46.793904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018a61-3c57-4279-af77-89a94e270a54 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:46.794234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018a61-3c57-4279-af77-89a94e270a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:46.794452 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018a61-3c57-4279-af77-89a94e270a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:46.798425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d039bb8-867d-4a73-aec4-8989877644a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:46.799129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d039bb8-867d-4a73-aec4-8989877644a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:46.799409 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d039bb8-867d-4a73-aec4-8989877644a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:46.800400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d039bb8-867d-4a73-aec4-8989877644a2 admin admin] PATH_INFO: `/v3/projects/9c0ad910b62641608b1475d533902a5d/users/2cc7136694a84b13b2217f63c5cfd919/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:46.805413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5018a61-3c57-4279-af77-89a94e270a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:46.806900 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5018a61-3c57-4279-af77-89a94e270a54 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:46.821617 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d039bb8-867d-4a73-aec4-8989877644a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0ad910b62641608b1475d533902a5d, user_id=2cc7136694a84b13b2217f63c5cfd919, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:46.824097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1006/2012] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:46.824297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d039bb8-867d-4a73-aec4-8989877644a2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:46.830940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd88070-8bbd-4eaf-9330-b1116156ae74 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:46.831417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd88070-8bbd-4eaf-9330-b1116156ae74 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:46.831665 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:46.831867 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd88070-8bbd-4eaf-9330-b1116156ae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:46.870465 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-9bd88070-8bbd-4eaf-9330-b1116156ae74 None None] MFA Rules not processed for user `cb32ade571034596b25c635e40b4b53e`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:46.871876 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9bd88070-8bbd-4eaf-9330-b1116156ae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:46.916587 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1007/2013] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:46 2022] PUT /identity/v3/projects/9c0ad910b62641608b1475d533902a5d/users/2cc7136694a84b13b2217f63c5cfd919/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:46.920456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d039bb8-867d-4a73-aec4-8989877644a2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:46.940087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:46.977066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1007/2014] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:46.986176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd88070-8bbd-4eaf-9330-b1116156ae74 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:46.990293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9bd88070-8bbd-4eaf-9330-b1116156ae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:47.012355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d039bb8-867d-4a73-aec4-8989877644a2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:47.017771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b38369-5c5d-4b0a-95ac-3f3e25da7906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:47.021601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b38369-5c5d-4b0a-95ac-3f3e25da7906 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:47.021942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b38369-5c5d-4b0a-95ac-3f3e25da7906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:47.022221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b38369-5c5d-4b0a-95ac-3f3e25da7906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:47.023013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b38369-5c5d-4b0a-95ac-3f3e25da7906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:47.030767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b38369-5c5d-4b0a-95ac-3f3e25da7906 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:47.044625 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1008/2015] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:47.046898 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b38369-5c5d-4b0a-95ac-3f3e25da7906 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:47.070717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b38369-5c5d-4b0a-95ac-3f3e25da7906 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:47.074728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9a2e3-f1b9-48fc-a971-e56de55cb55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:47.075414 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9a2e3-f1b9-48fc-a971-e56de55cb55c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:47.075662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9a2e3-f1b9-48fc-a971-e56de55cb55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:47.075934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9a2e3-f1b9-48fc-a971-e56de55cb55c admin admin] PATH_INFO: `/v3/projects/9c0ad910b62641608b1475d533902a5d/users/2cc7136694a84b13b2217f63c5cfd919/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:47.078014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9a2e3-f1b9-48fc-a971-e56de55cb55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0ad910b62641608b1475d533902a5d, user_id=2cc7136694a84b13b2217f63c5cfd919, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:47.080722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9a2e3-f1b9-48fc-a971-e56de55cb55c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:47.083176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd88070-8bbd-4eaf-9330-b1116156ae74 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:47.088616 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:47.101168 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1009/2016] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:47 2022] PUT /identity/v3/projects/9c0ad910b62641608b1475d533902a5d/users/2cc7136694a84b13b2217f63c5cfd919/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:47.111358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:47.123081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a67f6-2260-4124-a897-515e1a25ddf8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:47.123615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a67f6-2260-4124-a897-515e1a25ddf8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:47.123884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a67f6-2260-4124-a897-515e1a25ddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:47.162698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6c7a67f6-2260-4124-a897-515e1a25ddf8 None None] MFA Rules not processed for user `2cc7136694a84b13b2217f63c5cfd919`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:47.164102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6c7a67f6-2260-4124-a897-515e1a25ddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:47.175837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d245bc0-4d15-4742-ac1d-6d99988363dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:47.177045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d245bc0-4d15-4742-ac1d-6d99988363dc service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:47.177346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d245bc0-4d15-4742-ac1d-6d99988363dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:47.177599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d245bc0-4d15-4742-ac1d-6d99988363dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:47.184276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:47.245141 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1010/2017] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:47 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:47.249017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d245bc0-4d15-4742-ac1d-6d99988363dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:47.250607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d245bc0-4d15-4742-ac1d-6d99988363dc service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:47.256409 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a67f6-2260-4124-a897-515e1a25ddf8 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:47.257966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6c7a67f6-2260-4124-a897-515e1a25ddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:47.260879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1008/2018] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:41:47.344744 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d245bc0-4d15-4742-ac1d-6d99988363dc service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:47.353418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a67f6-2260-4124-a897-515e1a25ddf8 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:47.358748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7af401-ced6-4c6d-8737-f2a6c6ce89e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:47.359703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7af401-ced6-4c6d-8737-f2a6c6ce89e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:47.359703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7af401-ced6-4c6d-8737-f2a6c6ce89e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:47.359990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7af401-ced6-4c6d-8737-f2a6c6ce89e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:47.364016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d245bc0-4d15-4742-ac1d-6d99988363dc service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:47.372688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7af401-ced6-4c6d-8737-f2a6c6ce89e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:47.374709 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7af401-ced6-4c6d-8737-f2a6c6ce89e0 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:47.387718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1011/2019] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:47 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:47.427815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687440c6-7573-4bcd-8178-0540b5eab0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:47.428815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687440c6-7573-4bcd-8178-0540b5eab0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:47.429228 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687440c6-7573-4bcd-8178-0540b5eab0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:47.429568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687440c6-7573-4bcd-8178-0540b5eab0ea admin admin] PATH_INFO: `/v3/users/a5125ebabe9142aea1d60fafe757ade8` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:47.430802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687440c6-7573-4bcd-8178-0540b5eab0ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5125ebabe9142aea1d60fafe757ade8)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:47.432784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687440c6-7573-4bcd-8178-0540b5eab0ea admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:47.459674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:47.713606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7af401-ced6-4c6d-8737-f2a6c6ce89e0 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:47.713606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0e7af401-ced6-4c6d-8737-f2a6c6ce89e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:47.743885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7af401-ced6-4c6d-8737-f2a6c6ce89e0 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:47.748852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8737b-43a3-4444-b4ce-89d10bc60751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:47.751030 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8737b-43a3-4444-b4ce-89d10bc60751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:47.751030 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8737b-43a3-4444-b4ce-89d10bc60751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:47.751030 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8737b-43a3-4444-b4ce-89d10bc60751 admin admin] PATH_INFO: `/v3/projects/41682abe02fe44be8b47d5c0fae73760` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:47.751433 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8737b-43a3-4444-b4ce-89d10bc60751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41682abe02fe44be8b47d5c0fae73760)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:47.753277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8737b-43a3-4444-b4ce-89d10bc60751 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:48.178719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-687440c6-7573-4bcd-8178-0540b5eab0ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5125ebabe9142aea1d60fafe757ade8'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:48.183968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-76b8737b-43a3-4444-b4ce-89d10bc60751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41682abe02fe44be8b47d5c0fae73760', 'request_id': 'req-76b8737b-43a3-4444-b4ce-89d10bc60751'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:48.190794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-76b8737b-43a3-4444-b4ce-89d10bc60751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41682abe02fe44be8b47d5c0fae73760', 'request_id': 'req-76b8737b-43a3-4444-b4ce-89d10bc60751'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:48.198620 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-76b8737b-43a3-4444-b4ce-89d10bc60751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41682abe02fe44be8b47d5c0fae73760', 'request_id': 'req-76b8737b-43a3-4444-b4ce-89d10bc60751'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:48.282803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-687440c6-7573-4bcd-8178-0540b5eab0ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5125ebabe9142aea1d60fafe757ade8'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:48.283536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-687440c6-7573-4bcd-8178-0540b5eab0ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5125ebabe9142aea1d60fafe757ade8'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:48.291581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-687440c6-7573-4bcd-8178-0540b5eab0ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5125ebabe9142aea1d60fafe757ade8'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:48.304393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-687440c6-7573-4bcd-8178-0540b5eab0ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5125ebabe9142aea1d60fafe757ade8'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:48.310415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1009/2020] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:47 2022] DELETE /identity/v3/users/a5125ebabe9142aea1d60fafe757ade8 => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:48.325402 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687440c6-7573-4bcd-8178-0540b5eab0ea admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:48.325402 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-687440c6-7573-4bcd-8178-0540b5eab0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:48.374939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687440c6-7573-4bcd-8178-0540b5eab0ea admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:48.378588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c6f5f-fa5b-401e-86aa-1b0142f52665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:48.383585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c6f5f-fa5b-401e-86aa-1b0142f52665 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:48.383585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c6f5f-fa5b-401e-86aa-1b0142f52665 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:48.383585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c6f5f-fa5b-401e-86aa-1b0142f52665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:48.383585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-072c6f5f-fa5b-401e-86aa-1b0142f52665 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:48.385497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-76b8737b-43a3-4444-b4ce-89d10bc60751 admin admin] The token cache is being invalidate because project 41682abe02fe44be8b47d5c0fae73760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:48.385889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-76b8737b-43a3-4444-b4ce-89d10bc60751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:48.386623 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-76b8737b-43a3-4444-b4ce-89d10bc60751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:48.388650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1012/2021] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:47 2022] DELETE /identity/v3/projects/41682abe02fe44be8b47d5c0fae73760 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:48.389882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7125251-9218-4391-8245-c805f93b180a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:48.390161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7125251-9218-4391-8245-c805f93b180a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:48.390427 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7125251-9218-4391-8245-c805f93b180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:48.410731 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c7125251-9218-4391-8245-c805f93b180a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:48.411999 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c7125251-9218-4391-8245-c805f93b180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:48.454900 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c6f5f-fa5b-401e-86aa-1b0142f52665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:48.456356 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c6f5f-fa5b-401e-86aa-1b0142f52665 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:48.464152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:48.469711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1010/2022] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:48.469711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6244487-1817-4a2c-b6f3-0d918c425f3c None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:48.469711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6244487-1817-4a2c-b6f3-0d918c425f3c None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:48.469711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6244487-1817-4a2c-b6f3-0d918c425f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:48.492557 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-a6244487-1817-4a2c-b6f3-0d918c425f3c None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:48.494264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a6244487-1817-4a2c-b6f3-0d918c425f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:48.520658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1013/2023] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:48.531506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7125251-9218-4391-8245-c805f93b180a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:48.533312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c7125251-9218-4391-8245-c805f93b180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:48.606861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1011/2024] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:48.615265 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d13b7a-f26f-4075-9e3b-0b9af984c399 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:48.620251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d13b7a-f26f-4075-9e3b-0b9af984c399 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:48.620251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d13b7a-f26f-4075-9e3b-0b9af984c399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:48.647535 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-32d13b7a-f26f-4075-9e3b-0b9af984c399 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:48.648875 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-32d13b7a-f26f-4075-9e3b-0b9af984c399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:48.687307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1012/2025] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:48.687307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d13b7a-f26f-4075-9e3b-0b9af984c399 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:48.707322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d13b7a-f26f-4075-9e3b-0b9af984c399 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:48.710974 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7125251-9218-4391-8245-c805f93b180a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:48.721138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d034f6a-092e-4958-8166-f0c92e227442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:48.725367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034f6a-092e-4958-8166-f0c92e227442 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:48.725704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034f6a-092e-4958-8166-f0c92e227442 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:48.725985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034f6a-092e-4958-8166-f0c92e227442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:48.733749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c841f-ab13-4648-af9d-2ca266c079bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:48.734441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c841f-ab13-4648-af9d-2ca266c079bc admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:48.734720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c841f-ab13-4648-af9d-2ca266c079bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:48.734992 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c841f-ab13-4648-af9d-2ca266c079bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:48.736530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c841f-ab13-4648-af9d-2ca266c079bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:48.736843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c841f-ab13-4648-af9d-2ca266c079bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:48.742111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c841f-ab13-4648-af9d-2ca266c079bc admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:48.745751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d034f6a-092e-4958-8166-f0c92e227442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:48.747301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d034f6a-092e-4958-8166-f0c92e227442 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:48.759598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1013/2026] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:41:48.766385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c841f-ab13-4648-af9d-2ca266c079bc admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:48.768787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1014/2027] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:41:48.779996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c841f-ab13-4648-af9d-2ca266c079bc admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:48.798320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcaf92-6690-4454-9863-72074205e2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:48.798949 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcaf92-6690-4454-9863-72074205e2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:48.799226 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcaf92-6690-4454-9863-72074205e2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:48.799499 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcaf92-6690-4454-9863-72074205e2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:48.800222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcaf92-6690-4454-9863-72074205e2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:48.804026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcaf92-6690-4454-9863-72074205e2a7 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:48.860598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:48.903364 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d034f6a-092e-4958-8166-f0c92e227442 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:48.904085 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1014/2028] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:48 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:48.934795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d034f6a-092e-4958-8166-f0c92e227442 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:48.952248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:49.033506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c4ee1-70b9-408b-9ec9-7625fec8ad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:49.034301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c4ee1-70b9-408b-9ec9-7625fec8ad10 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:49.034585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c4ee1-70b9-408b-9ec9-7625fec8ad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:49.034858 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c4ee1-70b9-408b-9ec9-7625fec8ad10 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:49.038197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c4ee1-70b9-408b-9ec9-7625fec8ad10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:49.040771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c4ee1-70b9-408b-9ec9-7625fec8ad10 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:49.166184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1015/2029] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:48 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:49.171870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcaf92-6690-4454-9863-72074205e2a7 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:49.185213 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcaf92-6690-4454-9863-72074205e2a7 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:49.193582 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75ba9c-c20d-43ff-9a0e-231caf9bf076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:49.193582 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75ba9c-c20d-43ff-9a0e-231caf9bf076 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:49.193582 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75ba9c-c20d-43ff-9a0e-231caf9bf076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:49.194055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75ba9c-c20d-43ff-9a0e-231caf9bf076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:49.195114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75ba9c-c20d-43ff-9a0e-231caf9bf076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:49.196959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75ba9c-c20d-43ff-9a0e-231caf9bf076 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:49.210608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1015/2030] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:49.214754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c4ee1-70b9-408b-9ec9-7625fec8ad10 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:49.231134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c4ee1-70b9-408b-9ec9-7625fec8ad10 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:49.238722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb2607-0547-4b9c-9cd5-f4a7678d71ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:49.239803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb2607-0547-4b9c-9cd5-f4a7678d71ef admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:49.240468 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb2607-0547-4b9c-9cd5-f4a7678d71ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:49.241447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb2607-0547-4b9c-9cd5-f4a7678d71ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:49.244803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb2607-0547-4b9c-9cd5-f4a7678d71ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:49.252874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb2607-0547-4b9c-9cd5-f4a7678d71ef admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:49.276725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1016/2031] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:49.280917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75ba9c-c20d-43ff-9a0e-231caf9bf076 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:49.297100 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75ba9c-c20d-43ff-9a0e-231caf9bf076 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:49.297248 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47453-de22-47b5-a9d2-7aa2e819363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:49.297829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47453-de22-47b5-a9d2-7aa2e819363d admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:49.298104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47453-de22-47b5-a9d2-7aa2e819363d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:49.298373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47453-de22-47b5-a9d2-7aa2e819363d admin admin] PATH_INFO: `/v3/projects/4e1c0b6d0b7a4478b749da21a0d2bbb0/users/cdf38c17d4a04d46b9ed83252292b63d/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:49.314406 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47453-de22-47b5-a9d2-7aa2e819363d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1c0b6d0b7a4478b749da21a0d2bbb0, user_id=cdf38c17d4a04d46b9ed83252292b63d, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:49.318274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47453-de22-47b5-a9d2-7aa2e819363d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:49.360602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb2607-0547-4b9c-9cd5-f4a7678d71ef admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:49.362460 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bbeb2607-0547-4b9c-9cd5-f4a7678d71ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:49.383543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb2607-0547-4b9c-9cd5-f4a7678d71ef admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:49.385817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:49.386667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:49.387016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:49.388148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] PATH_INFO: `/v3/projects/49dacf9c77ac40429ffbf1fae1f64032` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:49.389514 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49dacf9c77ac40429ffbf1fae1f64032)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:49.391980 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:49.421722 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1016/2032] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:49 2022] PUT /identity/v3/projects/4e1c0b6d0b7a4478b749da21a0d2bbb0/users/cdf38c17d4a04d46b9ed83252292b63d/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:49.423465 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f5a28-b0b5-4a8f-b3d6-e6de866b5356 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:49.424163 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f5a28-b0b5-4a8f-b3d6-e6de866b5356 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:49.424644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f5a28-b0b5-4a8f-b3d6-e6de866b5356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:49.489475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-f15f5a28-b0b5-4a8f-b3d6-e6de866b5356 None None] MFA Rules not processed for user `cdf38c17d4a04d46b9ed83252292b63d`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:49.490733 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f15f5a28-b0b5-4a8f-b3d6-e6de866b5356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:49.563739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49dacf9c77ac40429ffbf1fae1f64032', 'request_id': 'req-9e9e2ad7-da90-40f5-9124-4d2955ca2600'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:49.579920 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49dacf9c77ac40429ffbf1fae1f64032', 'request_id': 'req-9e9e2ad7-da90-40f5-9124-4d2955ca2600'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:49.590056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49dacf9c77ac40429ffbf1fae1f64032', 'request_id': 'req-9e9e2ad7-da90-40f5-9124-4d2955ca2600'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:49.592147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1017/2033] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:49.597301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f5a28-b0b5-4a8f-b3d6-e6de866b5356 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:49.677211 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f5a28-b0b5-4a8f-b3d6-e6de866b5356 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:49.686135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] The token cache is being invalidate because project 49dacf9c77ac40429ffbf1fae1f64032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:49.686422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:49.689653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:49.693299 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1017/2034] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:49 2022] DELETE /identity/v3/projects/49dacf9c77ac40429ffbf1fae1f64032 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:49.697012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:49.699279 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:49.783751 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8b1a8-4f4b-49fa-aabe-53fa683ab12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:49.784537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8b1a8-4f4b-49fa-aabe-53fa683ab12c admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:49.784916 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8b1a8-4f4b-49fa-aabe-53fa683ab12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:49.786399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8b1a8-4f4b-49fa-aabe-53fa683ab12c admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:49.786864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8b1a8-4f4b-49fa-aabe-53fa683ab12c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:49.788916 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8b1a8-4f4b-49fa-aabe-53fa683ab12c admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:49.808367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e2ad7-da90-40f5-9124-4d2955ca2600 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:49.813278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f27e58-3d09-4d8e-8c61-b8fc92806293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:49.813917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f27e58-3d09-4d8e-8c61-b8fc92806293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:49.814192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f27e58-3d09-4d8e-8c61-b8fc92806293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:49.814461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f27e58-3d09-4d8e-8c61-b8fc92806293 admin admin] PATH_INFO: `/v3/users/cb32ade571034596b25c635e40b4b53e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:49.815603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f27e58-3d09-4d8e-8c61-b8fc92806293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb32ade571034596b25c635e40b4b53e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:49.817602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f27e58-3d09-4d8e-8c61-b8fc92806293 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:49.892943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1018/2035] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:49 2022] POST /identity/v3/projects => generated 377 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:49.897825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8b1a8-4f4b-49fa-aabe-53fa683ab12c admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:49.899387 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-e9b8b1a8-4f4b-49fa-aabe-53fa683ab12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:49.966362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8b1a8-4f4b-49fa-aabe-53fa683ab12c admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:49.971063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b07a2-45ec-423e-8e93-aecfc0c7b841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:49.971754 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b07a2-45ec-423e-8e93-aecfc0c7b841 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:49.972037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b07a2-45ec-423e-8e93-aecfc0c7b841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:49.972313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b07a2-45ec-423e-8e93-aecfc0c7b841 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:49.973460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b07a2-45ec-423e-8e93-aecfc0c7b841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:49.975447 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b07a2-45ec-423e-8e93-aecfc0c7b841 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:50.163046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1019/2036] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:49 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:50.171121 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b07a2-45ec-423e-8e93-aecfc0c7b841 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:50.173672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f6f27e58-3d09-4d8e-8c61-b8fc92806293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb32ade571034596b25c635e40b4b53e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:50.187966 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b07a2-45ec-423e-8e93-aecfc0c7b841 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:50.190359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f6f27e58-3d09-4d8e-8c61-b8fc92806293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb32ade571034596b25c635e40b4b53e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:50.201641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76b909-771e-44f4-8aef-6c4ed9a39f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:50.203503 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76b909-771e-44f4-8aef-6c4ed9a39f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:50.204521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76b909-771e-44f4-8aef-6c4ed9a39f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:50.204631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f6f27e58-3d09-4d8e-8c61-b8fc92806293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb32ade571034596b25c635e40b4b53e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:50.205261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76b909-771e-44f4-8aef-6c4ed9a39f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:50.211373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76b909-771e-44f4-8aef-6c4ed9a39f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:50.211373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76b909-771e-44f4-8aef-6c4ed9a39f05 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:50.222202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1020/2037] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:50.226829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76b909-771e-44f4-8aef-6c4ed9a39f05 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:50.237010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76b909-771e-44f4-8aef-6c4ed9a39f05 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:50.245109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc8271-f39d-413e-a72c-dfec1aab35ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:50.245858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8271-f39d-413e-a72c-dfec1aab35ca admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:50.246200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8271-f39d-413e-a72c-dfec1aab35ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:50.246588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8271-f39d-413e-a72c-dfec1aab35ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:50.247319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc8271-f39d-413e-a72c-dfec1aab35ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:50.249046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc8271-f39d-413e-a72c-dfec1aab35ca admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:50.260738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1021/2038] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:50.265111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc8271-f39d-413e-a72c-dfec1aab35ca admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:50.276017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc8271-f39d-413e-a72c-dfec1aab35ca admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:50.280582 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4ba76-0611-4662-b7bf-b26c001aeaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:50.281248 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4ba76-0611-4662-b7bf-b26c001aeaff admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:50.281527 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4ba76-0611-4662-b7bf-b26c001aeaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:50.281796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4ba76-0611-4662-b7bf-b26c001aeaff admin admin] PATH_INFO: `/v3/projects/b66d7e0790d241108c6e0dbf8c6b48a1/users/b99aa10aeab04d19a6e5a5fb913770b1/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:50.287987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f6f27e58-3d09-4d8e-8c61-b8fc92806293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb32ade571034596b25c635e40b4b53e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:50.288923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f6f27e58-3d09-4d8e-8c61-b8fc92806293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb32ade571034596b25c635e40b4b53e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:50.297726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1018/2039] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:49 2022] DELETE /identity/v3/users/cb32ade571034596b25c635e40b4b53e => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:50.299414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4ba76-0611-4662-b7bf-b26c001aeaff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66d7e0790d241108c6e0dbf8c6b48a1, user_id=b99aa10aeab04d19a6e5a5fb913770b1, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:50.302501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4ba76-0611-4662-b7bf-b26c001aeaff admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:50.386551 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1022/2040] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:50 2022] PUT /identity/v3/projects/b66d7e0790d241108c6e0dbf8c6b48a1/users/b99aa10aeab04d19a6e5a5fb913770b1/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:50.401146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bdf70-afbc-4cab-bb03-87f559a4d1c7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:50.407473 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bdf70-afbc-4cab-bb03-87f559a4d1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:50.407473 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bdf70-afbc-4cab-bb03-87f559a4d1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:50.432003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ca5bdf70-afbc-4cab-bb03-87f559a4d1c7 None None] MFA Rules not processed for user `b99aa10aeab04d19a6e5a5fb913770b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:50.433643 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ca5bdf70-afbc-4cab-bb03-87f559a4d1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:50.549274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4ba76-0611-4662-b7bf-b26c001aeaff admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:50.549966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1019/2041] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:50.551567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f2c4ba76-0611-4662-b7bf-b26c001aeaff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:50.575122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:50.673447 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4ba76-0611-4662-b7bf-b26c001aeaff admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:50.674787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dce2a9-7a5c-4fe3-855f-c5ba732733c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:50.676093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dce2a9-7a5c-4fe3-855f-c5ba732733c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:50.676591 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dce2a9-7a5c-4fe3-855f-c5ba732733c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:50.676973 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dce2a9-7a5c-4fe3-855f-c5ba732733c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:50.678051 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dce2a9-7a5c-4fe3-855f-c5ba732733c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:50.680530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dce2a9-7a5c-4fe3-855f-c5ba732733c2 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:50.737430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:50.806583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1023/2042] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:50 2022] POST /identity/v3/projects => generated 377 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:50.810492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bdf70-afbc-4cab-bb03-87f559a4d1c7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:50.824483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bdf70-afbc-4cab-bb03-87f559a4d1c7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:50.924888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c89e1b-1790-4f08-9f16-0831cc5a5674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:50.924888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c89e1b-1790-4f08-9f16-0831cc5a5674 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:50.924888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c89e1b-1790-4f08-9f16-0831cc5a5674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:50.924888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c89e1b-1790-4f08-9f16-0831cc5a5674 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:50.925295 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c89e1b-1790-4f08-9f16-0831cc5a5674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:50.926738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c89e1b-1790-4f08-9f16-0831cc5a5674 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:50.986757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dce2a9-7a5c-4fe3-855f-c5ba732733c2 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:50.989163 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a6dce2a9-7a5c-4fe3-855f-c5ba732733c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:51.003879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dce2a9-7a5c-4fe3-855f-c5ba732733c2 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:51.015515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fc156-c6ce-473a-9e7e-6c562d822f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:51.018556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fc156-c6ce-473a-9e7e-6c562d822f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.018556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fc156-c6ce-473a-9e7e-6c562d822f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.018556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fc156-c6ce-473a-9e7e-6c562d822f95 admin admin] PATH_INFO: `/v3/projects/a7a259aac4bb448da1d1401fbebdcea1` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.018556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fc156-c6ce-473a-9e7e-6c562d822f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a259aac4bb448da1d1401fbebdcea1)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:51.020496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fc156-c6ce-473a-9e7e-6c562d822f95 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:51.027182 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1020/2043] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:50 2022] POST /identity/v3/users => generated 295 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:51.031124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c89e1b-1790-4f08-9f16-0831cc5a5674 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:51.045061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c89e1b-1790-4f08-9f16-0831cc5a5674 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:51.054053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62955226-4e2a-47bc-bfe2-7ed47d9048f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:51.055281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955226-4e2a-47bc-bfe2-7ed47d9048f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.055893 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955226-4e2a-47bc-bfe2-7ed47d9048f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.056771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955226-4e2a-47bc-bfe2-7ed47d9048f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.058401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62955226-4e2a-47bc-bfe2-7ed47d9048f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:51.060882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62955226-4e2a-47bc-bfe2-7ed47d9048f6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:51.078407 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1021/2044] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:51.080413 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62955226-4e2a-47bc-bfe2-7ed47d9048f6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:51.093376 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62955226-4e2a-47bc-bfe2-7ed47d9048f6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:51.103082 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48850b-8f65-42e3-a6b7-fab9402d5183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:51.104032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48850b-8f65-42e3-a6b7-fab9402d5183 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.104718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48850b-8f65-42e3-a6b7-fab9402d5183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.105115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48850b-8f65-42e3-a6b7-fab9402d5183 admin admin] PATH_INFO: `/v3/projects/352d40b2e8eb46fbaf807f120f8c6e24/users/657dbb50bff1404c8e768296f1ec051c/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.127313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48850b-8f65-42e3-a6b7-fab9402d5183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=352d40b2e8eb46fbaf807f120f8c6e24, user_id=657dbb50bff1404c8e768296f1ec051c, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:51.136456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48850b-8f65-42e3-a6b7-fab9402d5183 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:51.223676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1022/2045] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:51 2022] PUT /identity/v3/projects/352d40b2e8eb46fbaf807f120f8c6e24/users/657dbb50bff1404c8e768296f1ec051c/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:51.227585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48850b-8f65-42e3-a6b7-fab9402d5183 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:51.229866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e09fc156-c6ce-473a-9e7e-6c562d822f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a259aac4bb448da1d1401fbebdcea1', 'request_id': 'req-e09fc156-c6ce-473a-9e7e-6c562d822f95'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:51.244762 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e09fc156-c6ce-473a-9e7e-6c562d822f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a259aac4bb448da1d1401fbebdcea1', 'request_id': 'req-e09fc156-c6ce-473a-9e7e-6c562d822f95'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:51.323561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48850b-8f65-42e3-a6b7-fab9402d5183 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:51.329219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b638c3-ffb2-4bff-8855-c4c81881b468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:51.329843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b638c3-ffb2-4bff-8855-c4c81881b468 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.330254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b638c3-ffb2-4bff-8855-c4c81881b468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.330531 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b638c3-ffb2-4bff-8855-c4c81881b468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.331220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b638c3-ffb2-4bff-8855-c4c81881b468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:51.334737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e09fc156-c6ce-473a-9e7e-6c562d822f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a259aac4bb448da1d1401fbebdcea1', 'request_id': 'req-e09fc156-c6ce-473a-9e7e-6c562d822f95'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:51.334881 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b638c3-ffb2-4bff-8855-c4c81881b468 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:51.349483 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e09fc156-c6ce-473a-9e7e-6c562d822f95 admin admin] The token cache is being invalidate because project a7a259aac4bb448da1d1401fbebdcea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:51.352890 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1023/2046] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:51.353046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e09fc156-c6ce-473a-9e7e-6c562d822f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:51.353046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e09fc156-c6ce-473a-9e7e-6c562d822f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:51.353046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1024/2047] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:50 2022] DELETE /identity/v3/projects/a7a259aac4bb448da1d1401fbebdcea1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:51.357497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b638c3-ffb2-4bff-8855-c4c81881b468 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:51.357920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675bfc3-5b7d-4299-a74f-b7ae8da41566 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.358203 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675bfc3-5b7d-4299-a74f-b7ae8da41566 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.358533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675bfc3-5b7d-4299-a74f-b7ae8da41566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.359349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-22b638c3-ffb2-4bff-8855-c4c81881b468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:51.373864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b638c3-ffb2-4bff-8855-c4c81881b468 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:51.379598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445cc67-8cd2-4ce5-90be-4d29029ec81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:51.379992 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-f675bfc3-5b7d-4299-a74f-b7ae8da41566 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:51.380386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445cc67-8cd2-4ce5-90be-4d29029ec81d admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.380675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445cc67-8cd2-4ce5-90be-4d29029ec81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.380956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445cc67-8cd2-4ce5-90be-4d29029ec81d admin admin] PATH_INFO: `/v3/projects/352d40b2e8eb46fbaf807f120f8c6e24/users/657dbb50bff1404c8e768296f1ec051c/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.381266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f675bfc3-5b7d-4299-a74f-b7ae8da41566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:51.382966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445cc67-8cd2-4ce5-90be-4d29029ec81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=352d40b2e8eb46fbaf807f120f8c6e24, user_id=657dbb50bff1404c8e768296f1ec051c, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:51.385756 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445cc67-8cd2-4ce5-90be-4d29029ec81d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:51.393030 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1025/2048] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:51.398159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab029a9-808d-4c0a-b129-0ce6fc17f0d7 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.398426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab029a9-808d-4c0a-b129-0ce6fc17f0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.398639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1024/2049] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:51 2022] PUT /identity/v3/projects/352d40b2e8eb46fbaf807f120f8c6e24/users/657dbb50bff1404c8e768296f1ec051c/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:51.398740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab029a9-808d-4c0a-b129-0ce6fc17f0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.408521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198300c-8f39-4152-999c-205105f7bd33 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.408807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198300c-8f39-4152-999c-205105f7bd33 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.409126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198300c-8f39-4152-999c-205105f7bd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.429900 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-aab029a9-808d-4c0a-b129-0ce6fc17f0d7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:51.431902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-aab029a9-808d-4c0a-b129-0ce6fc17f0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:51.449657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9198300c-8f39-4152-999c-205105f7bd33 None None] MFA Rules not processed for user `657dbb50bff1404c8e768296f1ec051c`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:51.450970 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9198300c-8f39-4152-999c-205105f7bd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:51.532673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1026/2050] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:51.537348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab029a9-808d-4c0a-b129-0ce6fc17f0d7 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:51.551451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab029a9-808d-4c0a-b129-0ce6fc17f0d7 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:51.561345 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f3c3b-c43e-478e-9788-202ea76deb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:51.562171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f3c3b-c43e-478e-9788-202ea76deb7d admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.562873 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f3c3b-c43e-478e-9788-202ea76deb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.563295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f3c3b-c43e-478e-9788-202ea76deb7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.564575 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f3c3b-c43e-478e-9788-202ea76deb7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:51.565760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f3c3b-c43e-478e-9788-202ea76deb7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:51.569488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f3c3b-c43e-478e-9788-202ea76deb7d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:51.571418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1025/2051] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:51.580029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e48ae-1a29-47ac-b02d-6475828b2435 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.580327 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e48ae-1a29-47ac-b02d-6475828b2435 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.580603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e48ae-1a29-47ac-b02d-6475828b2435 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.582915 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1026/2052] 10.222.0.50 () {54 vars in 921 bytes} [Sat Sep 17 04:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:41:51.585849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e48ae-1a29-47ac-b02d-6475828b2435 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:51.590874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-792e48ae-1a29-47ac-b02d-6475828b2435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:51.594291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1027/2053] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:41:51.603126 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f3c3b-c43e-478e-9788-202ea76deb7d admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:51.623351 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f3c3b-c43e-478e-9788-202ea76deb7d admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:51.631815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26ccf9-ff04-4c1e-966d-2183ffc72c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:51.632581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ccf9-ff04-4c1e-966d-2183ffc72c17 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.632985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ccf9-ff04-4c1e-966d-2183ffc72c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.634755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ccf9-ff04-4c1e-966d-2183ffc72c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.650878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26ccf9-ff04-4c1e-966d-2183ffc72c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:51.650878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26ccf9-ff04-4c1e-966d-2183ffc72c17 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:51.669801 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e48ae-1a29-47ac-b02d-6475828b2435 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:51.674264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d1405-7999-4623-948f-98eea434e6ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:51.675068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d1405-7999-4623-948f-98eea434e6ba service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.675340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d1405-7999-4623-948f-98eea434e6ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.676182 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d1405-7999-4623-948f-98eea434e6ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.678443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-472d1405-7999-4623-948f-98eea434e6ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:51.739903 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d1405-7999-4623-948f-98eea434e6ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:51.741732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d1405-7999-4623-948f-98eea434e6ba service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:51.759712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1027/2054] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:51.759712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96500c-1ecc-4315-b87c-a5f614861fb6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.759712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96500c-1ecc-4315-b87c-a5f614861fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.759712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96500c-1ecc-4315-b87c-a5f614861fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.778667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1028/2055] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:51 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:51.778667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26ccf9-ff04-4c1e-966d-2183ffc72c17 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:51.780168 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ae96500c-1ecc-4315-b87c-a5f614861fb6 None None] MFA Rules not processed for user `931a947711a2468baaeef701bbee60c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:51.781228 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1a26ccf9-ff04-4c1e-966d-2183ffc72c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:51.781415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ae96500c-1ecc-4315-b87c-a5f614861fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:51.854580 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1028/2056] 10.222.0.50 () {58 vars in 1018 bytes} [Sat Sep 17 04:41:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:51.855445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96500c-1ecc-4315-b87c-a5f614861fb6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:51.858948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26ccf9-ff04-4c1e-966d-2183ffc72c17 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:51.866643 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96500c-1ecc-4315-b87c-a5f614861fb6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:51.869643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca752d-ce15-4d88-919b-ae81f7db1050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:51.870269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca752d-ce15-4d88-919b-ae81f7db1050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.870545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca752d-ce15-4d88-919b-ae81f7db1050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.870985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca752d-ce15-4d88-919b-ae81f7db1050 admin admin] PATH_INFO: `/v3/users/f29dce2bfd7a4553900e92acf531dd68` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.872132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1da6b7-eba8-49aa-85b6-d78c1089b5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:51.872321 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca752d-ce15-4d88-919b-ae81f7db1050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29dce2bfd7a4553900e92acf531dd68)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:51.872934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da6b7-eba8-49aa-85b6-d78c1089b5ec admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:51.873316 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da6b7-eba8-49aa-85b6-d78c1089b5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:51.873571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da6b7-eba8-49aa-85b6-d78c1089b5ec admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:51.874482 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1da6b7-eba8-49aa-85b6-d78c1089b5ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:51.876428 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1da6b7-eba8-49aa-85b6-d78c1089b5ec admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:51.876753 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca752d-ce15-4d88-919b-ae81f7db1050 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:51.905420 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:51.995062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1029/2057] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:51 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:51.995739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1da6b7-eba8-49aa-85b6-d78c1089b5ec admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:51.997427 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4a1da6b7-eba8-49aa-85b6-d78c1089b5ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:52.012240 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1da6b7-eba8-49aa-85b6-d78c1089b5ec admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:52.017372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b4387-c9a2-4fab-9795-cede51b2479a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931a947711a2468baaeef701bbee60c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:52.024456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b4387-c9a2-4fab-9795-cede51b2479a service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:52.024456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b4387-c9a2-4fab-9795-cede51b2479a service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:52.024456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b4387-c9a2-4fab-9795-cede51b2479a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:52.027818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b4387-c9a2-4fab-9795-cede51b2479a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:52.029593 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b4387-c9a2-4fab-9795-cede51b2479a service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:52.041025 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1030/2058] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:52.041877 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b4387-c9a2-4fab-9795-cede51b2479a service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:52.051774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b4387-c9a2-4fab-9795-cede51b2479a service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:52.057234 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90122a7-b7ef-4a54-ae41-fc2f12d8bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:52.059122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90122a7-b7ef-4a54-ae41-fc2f12d8bda1 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:52.059122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90122a7-b7ef-4a54-ae41-fc2f12d8bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:52.059122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90122a7-b7ef-4a54-ae41-fc2f12d8bda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:52.059122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90122a7-b7ef-4a54-ae41-fc2f12d8bda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:52.060826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90122a7-b7ef-4a54-ae41-fc2f12d8bda1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:52.073688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1031/2059] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:52.077350 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90122a7-b7ef-4a54-ae41-fc2f12d8bda1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:52.087433 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:52.090953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90122a7-b7ef-4a54-ae41-fc2f12d8bda1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:52.092943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2eca752d-ce15-4d88-919b-ae81f7db1050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29dce2bfd7a4553900e92acf531dd68'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:52.095900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831fbb7-bb2c-4703-9185-8dc56909a0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:52.096501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831fbb7-bb2c-4703-9185-8dc56909a0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:52.096778 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831fbb7-bb2c-4703-9185-8dc56909a0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:52.097078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831fbb7-bb2c-4703-9185-8dc56909a0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:52.098298 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831fbb7-bb2c-4703-9185-8dc56909a0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:52.099932 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831fbb7-bb2c-4703-9185-8dc56909a0c7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:52.111516 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1032/2060] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:52.116842 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831fbb7-bb2c-4703-9185-8dc56909a0c7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:52.127170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831fbb7-bb2c-4703-9185-8dc56909a0c7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:52.131993 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb42f9f-0aea-44ec-a14f-c5aff49aea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:52.132633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb42f9f-0aea-44ec-a14f-c5aff49aea7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:52.132907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb42f9f-0aea-44ec-a14f-c5aff49aea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:52.133203 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb42f9f-0aea-44ec-a14f-c5aff49aea7a admin admin] PATH_INFO: `/v3/projects/ac2624a1c504413d91def3017e332c2a/users/dab19bfad32d4581a9752146f9b67a7f/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:52.148049 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb42f9f-0aea-44ec-a14f-c5aff49aea7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2624a1c504413d91def3017e332c2a, user_id=dab19bfad32d4581a9752146f9b67a7f, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:52.151159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb42f9f-0aea-44ec-a14f-c5aff49aea7a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:52.184496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2eca752d-ce15-4d88-919b-ae81f7db1050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29dce2bfd7a4553900e92acf531dd68'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:52.185469 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2eca752d-ce15-4d88-919b-ae81f7db1050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29dce2bfd7a4553900e92acf531dd68'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:52.194419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2eca752d-ce15-4d88-919b-ae81f7db1050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29dce2bfd7a4553900e92acf531dd68'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:52.207409 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2eca752d-ce15-4d88-919b-ae81f7db1050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29dce2bfd7a4553900e92acf531dd68'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:52.213848 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1029/2061] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:51 2022] DELETE /identity/v3/users/f29dce2bfd7a4553900e92acf531dd68 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:52.278506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1033/2062] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:52 2022] PUT /identity/v3/projects/ac2624a1c504413d91def3017e332c2a/users/dab19bfad32d4581a9752146f9b67a7f/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:52.288893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd10850-61b5-4abe-8f94-1649229ae8bf None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:52.289441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd10850-61b5-4abe-8f94-1649229ae8bf None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:52.289529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd10850-61b5-4abe-8f94-1649229ae8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:52.320415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-afd10850-61b5-4abe-8f94-1649229ae8bf None None] MFA Rules not processed for user `dab19bfad32d4581a9752146f9b67a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:52.321677 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-afd10850-61b5-4abe-8f94-1649229ae8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:52.475879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1030/2063] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:52.486405 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb42f9f-0aea-44ec-a14f-c5aff49aea7a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:52.488259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ddb42f9f-0aea-44ec-a14f-c5aff49aea7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:52.514459 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd10850-61b5-4abe-8f94-1649229ae8bf None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:52.517967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-afd10850-61b5-4abe-8f94-1649229ae8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:52.601990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb42f9f-0aea-44ec-a14f-c5aff49aea7a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:52.607974 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40d81d-1b40-4b3c-950d-0c71041ebac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:52.608598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40d81d-1b40-4b3c-950d-0c71041ebac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:52.608875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40d81d-1b40-4b3c-950d-0c71041ebac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:52.609206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40d81d-1b40-4b3c-950d-0c71041ebac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:52.609854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40d81d-1b40-4b3c-950d-0c71041ebac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:52.612013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40d81d-1b40-4b3c-950d-0c71041ebac7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:52.629570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd10850-61b5-4abe-8f94-1649229ae8bf None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:52.634348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d0820-7a66-4d19-975b-470f821e2ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:52.634988 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0820-7a66-4d19-975b-470f821e2ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:52.635272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0820-7a66-4d19-975b-470f821e2ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:52.635550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0820-7a66-4d19-975b-470f821e2ac2 admin admin] PATH_INFO: `/v3/projects/9ab08ceadcea48d5984d92b129bc7775` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:52.636680 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d0820-7a66-4d19-975b-470f821e2ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ab08ceadcea48d5984d92b129bc7775)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:52.638666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d0820-7a66-4d19-975b-470f821e2ac2 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:52.735761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1034/2064] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:52 2022] POST /identity/v3/projects => generated 387 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:52.740591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40d81d-1b40-4b3c-950d-0c71041ebac7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:52.747028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ea1d0820-7a66-4d19-975b-470f821e2ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ab08ceadcea48d5984d92b129bc7775', 'request_id': 'req-ea1d0820-7a66-4d19-975b-470f821e2ac2'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:52.755901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ea1d0820-7a66-4d19-975b-470f821e2ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ab08ceadcea48d5984d92b129bc7775', 'request_id': 'req-ea1d0820-7a66-4d19-975b-470f821e2ac2'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:52.819204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40d81d-1b40-4b3c-950d-0c71041ebac7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:52.824552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc795a20-733e-4663-8257-a74756cfdd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:52.829251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc795a20-733e-4663-8257-a74756cfdd2d admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:52.829640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc795a20-733e-4663-8257-a74756cfdd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:52.829996 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc795a20-733e-4663-8257-a74756cfdd2d admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:52.830753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc795a20-733e-4663-8257-a74756cfdd2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:52.832831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc795a20-733e-4663-8257-a74756cfdd2d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:52.856840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ea1d0820-7a66-4d19-975b-470f821e2ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ab08ceadcea48d5984d92b129bc7775', 'request_id': 'req-ea1d0820-7a66-4d19-975b-470f821e2ac2'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:52.868926 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ea1d0820-7a66-4d19-975b-470f821e2ac2 admin admin] The token cache is being invalidate because project 9ab08ceadcea48d5984d92b129bc7775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:52.869255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ea1d0820-7a66-4d19-975b-470f821e2ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:52.869958 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ea1d0820-7a66-4d19-975b-470f821e2ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:52.871550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1031/2065] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:52 2022] DELETE /identity/v3/projects/9ab08ceadcea48d5984d92b129bc7775 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:52.876290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec30d4-eb31-4358-862c-23c643f539e8 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:52.876581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec30d4-eb31-4358-862c-23c643f539e8 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:52.876890 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec30d4-eb31-4358-862c-23c643f539e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:52.898584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-d6ec30d4-eb31-4358-862c-23c643f539e8 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:52.899794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d6ec30d4-eb31-4358-862c-23c643f539e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:52.907746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1032/2066] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:52.915849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181efca-97c4-45f9-a3f7-8443865b91fb None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:52.916128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181efca-97c4-45f9-a3f7-8443865b91fb None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:52.916397 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181efca-97c4-45f9-a3f7-8443865b91fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:52.935949 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-f181efca-97c4-45f9-a3f7-8443865b91fb None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:52.942150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f181efca-97c4-45f9-a3f7-8443865b91fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:52.945155 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1033/2067] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:52.949137 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181efca-97c4-45f9-a3f7-8443865b91fb None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:52.957794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181efca-97c4-45f9-a3f7-8443865b91fb None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:52.962639 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bc5b4-af05-4611-a994-3affc50eb22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:52.966800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bc5b4-af05-4611-a994-3affc50eb22a admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:52.966800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bc5b4-af05-4611-a994-3affc50eb22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:52.966800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bc5b4-af05-4611-a994-3affc50eb22a admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:52.966800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bc5b4-af05-4611-a994-3affc50eb22a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:52.966800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bc5b4-af05-4611-a994-3affc50eb22a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:52.966800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bc5b4-af05-4611-a994-3affc50eb22a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:52.969917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1035/2068] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:52 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:52.974501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc795a20-733e-4663-8257-a74756cfdd2d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:52.976158 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cc795a20-733e-4663-8257-a74756cfdd2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:52.979347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1034/2069] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:41:52.983805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bc5b4-af05-4611-a994-3affc50eb22a admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:52.992974 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc795a20-733e-4663-8257-a74756cfdd2d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:52.995270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bc5b4-af05-4611-a994-3affc50eb22a admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:52.997970 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a0ab3-bcaf-4a8c-aa5a-273fa3f452d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:52.998535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a0ab3-bcaf-4a8c-aa5a-273fa3f452d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:52.998811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a0ab3-bcaf-4a8c-aa5a-273fa3f452d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:52.999081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a0ab3-bcaf-4a8c-aa5a-273fa3f452d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:52.999725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a0ab3-bcaf-4a8c-aa5a-273fa3f452d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:52.999891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211df6a-9501-4260-904c-e4063618d90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:53.000540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211df6a-9501-4260-904c-e4063618d90d admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:53.000813 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211df6a-9501-4260-904c-e4063618d90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:53.001118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211df6a-9501-4260-904c-e4063618d90d admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:53.006948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a0ab3-bcaf-4a8c-aa5a-273fa3f452d3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:53.007060 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211df6a-9501-4260-904c-e4063618d90d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:53.007060 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211df6a-9501-4260-904c-e4063618d90d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:53.012297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1036/2070] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:53.016502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a0ab3-bcaf-4a8c-aa5a-273fa3f452d3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:53.027227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a0ab3-bcaf-4a8c-aa5a-273fa3f452d3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:53.032093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41111d5-bae8-49b4-a5f8-280836557731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:53.032794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41111d5-bae8-49b4-a5f8-280836557731 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:53.033115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41111d5-bae8-49b4-a5f8-280836557731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:53.033390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41111d5-bae8-49b4-a5f8-280836557731 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:53.034029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41111d5-bae8-49b4-a5f8-280836557731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:53.036367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41111d5-bae8-49b4-a5f8-280836557731 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:53.046659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1037/2071] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:53.051768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41111d5-bae8-49b4-a5f8-280836557731 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:53.061258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41111d5-bae8-49b4-a5f8-280836557731 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:53.065906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c224-3e66-4942-bc04-5ba87b375b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:53.066782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c224-3e66-4942-bc04-5ba87b375b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:53.067071 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c224-3e66-4942-bc04-5ba87b375b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:53.067373 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c224-3e66-4942-bc04-5ba87b375b52 admin admin] PATH_INFO: `/v3/projects/efa4e46347b641749a93ad38dcb52e72/users/cc79ced69a93440d921142c39120fcf0/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:53.081770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8c224-3e66-4942-bc04-5ba87b375b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa4e46347b641749a93ad38dcb52e72, user_id=cc79ced69a93440d921142c39120fcf0, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:53.091201 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8c224-3e66-4942-bc04-5ba87b375b52 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:53.158238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1035/2072] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:52 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:53.163431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211df6a-9501-4260-904c-e4063618d90d admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:53.179872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:53.185251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1038/2073] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:53 2022] PUT /identity/v3/projects/efa4e46347b641749a93ad38dcb52e72/users/cc79ced69a93440d921142c39120fcf0/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:53.200523 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55687d9f-41b2-42ce-af76-d459f610486e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:53.200802 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55687d9f-41b2-42ce-af76-d459f610486e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:53.201083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55687d9f-41b2-42ce-af76-d459f610486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:53.232549 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211df6a-9501-4260-904c-e4063618d90d admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:53.239053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-55687d9f-41b2-42ce-af76-d459f610486e None None] MFA Rules not processed for user `cc79ced69a93440d921142c39120fcf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:53.240251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-55687d9f-41b2-42ce-af76-d459f610486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:53.292688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbbe66-b85f-435b-9acd-8ee4cbc62d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:53.293557 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbbe66-b85f-435b-9acd-8ee4cbc62d1e admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:53.293755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbbe66-b85f-435b-9acd-8ee4cbc62d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:53.294031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbbe66-b85f-435b-9acd-8ee4cbc62d1e admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:53.294678 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbbe66-b85f-435b-9acd-8ee4cbc62d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:53.297349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbbe66-b85f-435b-9acd-8ee4cbc62d1e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:53.320289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1039/2074] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:53.324720 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55687d9f-41b2-42ce-af76-d459f610486e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:53.335455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55687d9f-41b2-42ce-af76-d459f610486e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:53.340140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d08dc-620c-4ee5-b93c-7fb3b2abbd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:53.340714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d08dc-620c-4ee5-b93c-7fb3b2abbd7c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:53.341880 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d08dc-620c-4ee5-b93c-7fb3b2abbd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:53.341880 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d08dc-620c-4ee5-b93c-7fb3b2abbd7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:53.342073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d08dc-620c-4ee5-b93c-7fb3b2abbd7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:53.343966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d08dc-620c-4ee5-b93c-7fb3b2abbd7c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:53.361537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:53.418073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1036/2075] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:53 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:53.422118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbbe66-b85f-435b-9acd-8ee4cbc62d1e admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:53.432407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbbe66-b85f-435b-9acd-8ee4cbc62d1e admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:53.437013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd2449-34b8-41b6-a933-f4e17bda7cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:53.437623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd2449-34b8-41b6-a933-f4e17bda7cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:53.437905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd2449-34b8-41b6-a933-f4e17bda7cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:53.438462 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd2449-34b8-41b6-a933-f4e17bda7cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:53.438847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd2449-34b8-41b6-a933-f4e17bda7cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:53.440593 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd2449-34b8-41b6-a933-f4e17bda7cf8 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:53.449204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1040/2076] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:53 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:53.457354 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1037/2077] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:53.460450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d08dc-620c-4ee5-b93c-7fb3b2abbd7c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:53.461649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd2449-34b8-41b6-a933-f4e17bda7cf8 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:53.471454 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd2449-34b8-41b6-a933-f4e17bda7cf8 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:53.545073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58936f8e-9987-415b-92f0-34c4e6a6e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:53.545764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58936f8e-9987-415b-92f0-34c4e6a6e290 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:53.546171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58936f8e-9987-415b-92f0-34c4e6a6e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:53.546564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58936f8e-9987-415b-92f0-34c4e6a6e290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:53.548115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58936f8e-9987-415b-92f0-34c4e6a6e290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:53.550020 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58936f8e-9987-415b-92f0-34c4e6a6e290 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:53.558119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d08dc-620c-4ee5-b93c-7fb3b2abbd7c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:53.562748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1038/2078] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:53.572575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590833c-1a90-403a-995a-2f7ab1b7d74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:53.572575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590833c-1a90-403a-995a-2f7ab1b7d74b admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:53.572760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58936f8e-9987-415b-92f0-34c4e6a6e290 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:53.572835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590833c-1a90-403a-995a-2f7ab1b7d74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:53.572835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590833c-1a90-403a-995a-2f7ab1b7d74b admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:53.572835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590833c-1a90-403a-995a-2f7ab1b7d74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:53.572835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590833c-1a90-403a-995a-2f7ab1b7d74b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:53.584294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58936f8e-9987-415b-92f0-34c4e6a6e290 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:53.593755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a42480-fc45-44e4-925c-ecd8fc0e2042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:53.594425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a42480-fc45-44e4-925c-ecd8fc0e2042 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:53.594706 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a42480-fc45-44e4-925c-ecd8fc0e2042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:53.594983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a42480-fc45-44e4-925c-ecd8fc0e2042 admin admin] PATH_INFO: `/v3/projects/be0eecb808a147ae83c30745133de87a/users/255138cca3254c5f939112b74a04011f/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:53.614583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a42480-fc45-44e4-925c-ecd8fc0e2042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0eecb808a147ae83c30745133de87a, user_id=255138cca3254c5f939112b74a04011f, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:53.617666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a42480-fc45-44e4-925c-ecd8fc0e2042 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:53.684411 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1041/2079] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:53 2022] POST /identity/v3/users => generated 300 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:53.689303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590833c-1a90-403a-995a-2f7ab1b7d74b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:53.700250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590833c-1a90-403a-995a-2f7ab1b7d74b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:53.705401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce485a5-8fb5-4e72-bacf-86451c437b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:53.706003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce485a5-8fb5-4e72-bacf-86451c437b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:53.706286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce485a5-8fb5-4e72-bacf-86451c437b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:53.706574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce485a5-8fb5-4e72-bacf-86451c437b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:53.707840 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce485a5-8fb5-4e72-bacf-86451c437b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:53.709473 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce485a5-8fb5-4e72-bacf-86451c437b7d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:53.712565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1039/2080] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:53 2022] PUT /identity/v3/projects/be0eecb808a147ae83c30745133de87a/users/255138cca3254c5f939112b74a04011f/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:53.719258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17382c5b-2dba-4165-9680-84cbd5946f8e None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:53.719547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17382c5b-2dba-4165-9680-84cbd5946f8e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:53.719855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17382c5b-2dba-4165-9680-84cbd5946f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:53.723837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1042/2081] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:53.727939 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce485a5-8fb5-4e72-bacf-86451c437b7d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:53.744284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce485a5-8fb5-4e72-bacf-86451c437b7d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:53.750600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-17382c5b-2dba-4165-9680-84cbd5946f8e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:53.752107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-17382c5b-2dba-4165-9680-84cbd5946f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:53.803860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:53.812798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:53.819372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed976ab-f92a-483f-b706-4d067e045a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:53.820038 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed976ab-f92a-483f-b706-4d067e045a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:53.820315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed976ab-f92a-483f-b706-4d067e045a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:53.820586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed976ab-f92a-483f-b706-4d067e045a81 admin admin] PATH_INFO: `/v3/projects/6c6183d6daea4080b926c6ba3716eb37/users/f995ad791f374ecd930b7ae0cbdd4ca3/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:53.826276 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1040/2082] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:53.830780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17382c5b-2dba-4165-9680-84cbd5946f8e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:53.832843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-17382c5b-2dba-4165-9680-84cbd5946f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:53.837178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed976ab-f92a-483f-b706-4d067e045a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6183d6daea4080b926c6ba3716eb37, user_id=f995ad791f374ecd930b7ae0cbdd4ca3, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:53.839952 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed976ab-f92a-483f-b706-4d067e045a81 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:53.896084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17382c5b-2dba-4165-9680-84cbd5946f8e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:53.899872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a308f-d841-4a22-ba2a-a11b07f6cde6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:53.900480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a308f-d841-4a22-ba2a-a11b07f6cde6 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:53.900982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a308f-d841-4a22-ba2a-a11b07f6cde6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:53.901135 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a308f-d841-4a22-ba2a-a11b07f6cde6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:53.902806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6f4a308f-d841-4a22-ba2a-a11b07f6cde6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:53.926587 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1043/2083] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:53 2022] PUT /identity/v3/projects/6c6183d6daea4080b926c6ba3716eb37/users/f995ad791f374ecd930b7ae0cbdd4ca3/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:53.928707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed976ab-f92a-483f-b706-4d067e045a81 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:53.931768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eed976ab-f92a-483f-b706-4d067e045a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:53.943972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:53.977295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a308f-d841-4a22-ba2a-a11b07f6cde6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:53.978799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a308f-d841-4a22-ba2a-a11b07f6cde6 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:53.989589 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1041/2084] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:53.990470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a308f-d841-4a22-ba2a-a11b07f6cde6 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:54.002109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a308f-d841-4a22-ba2a-a11b07f6cde6 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:54.003162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed976ab-f92a-483f-b706-4d067e045a81 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:54.007740 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa12e9-03d2-48d8-9199-84eef95f335b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:54.008426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa12e9-03d2-48d8-9199-84eef95f335b service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:54.008780 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa12e9-03d2-48d8-9199-84eef95f335b service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:54.009277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa12e9-03d2-48d8-9199-84eef95f335b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:54.063172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:54.104630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7578f40-4a31-443e-8f2b-0187cea9b082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:54.105580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7578f40-4a31-443e-8f2b-0187cea9b082 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:54.105938 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7578f40-4a31-443e-8f2b-0187cea9b082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:54.106291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7578f40-4a31-443e-8f2b-0187cea9b082 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:54.107057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7578f40-4a31-443e-8f2b-0187cea9b082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:54.108767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7578f40-4a31-443e-8f2b-0187cea9b082 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:54.121191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1042/2085] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:54.126114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7578f40-4a31-443e-8f2b-0187cea9b082 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:54.129587 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa12e9-03d2-48d8-9199-84eef95f335b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:54.131297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa12e9-03d2-48d8-9199-84eef95f335b service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:54.137160 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7578f40-4a31-443e-8f2b-0187cea9b082 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:54.141956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66c09a-ab56-412d-a17d-8ff21bbf0833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:54.142623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66c09a-ab56-412d-a17d-8ff21bbf0833 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:54.142915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66c09a-ab56-412d-a17d-8ff21bbf0833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:54.143207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66c09a-ab56-412d-a17d-8ff21bbf0833 admin admin] PATH_INFO: `/v3/projects/6c6183d6daea4080b926c6ba3716eb37/users/f995ad791f374ecd930b7ae0cbdd4ca3/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:54.143594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1044/2086] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:54.156346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66c09a-ab56-412d-a17d-8ff21bbf0833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6183d6daea4080b926c6ba3716eb37, user_id=f995ad791f374ecd930b7ae0cbdd4ca3, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:54.159169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66c09a-ab56-412d-a17d-8ff21bbf0833 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:54.173089 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1043/2087] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:54 2022] PUT /identity/v3/projects/6c6183d6daea4080b926c6ba3716eb37/users/f995ad791f374ecd930b7ae0cbdd4ca3/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:54.186831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afa386-5a7c-4930-90b0-956860e61656 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:54.187120 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afa386-5a7c-4930-90b0-956860e61656 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:54.187395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afa386-5a7c-4930-90b0-956860e61656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:54.217827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66c09a-ab56-412d-a17d-8ff21bbf0833 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:54.219771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2a66c09a-ab56-412d-a17d-8ff21bbf0833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:54.221431 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e2afa386-5a7c-4930-90b0-956860e61656 None None] MFA Rules not processed for user `f995ad791f374ecd930b7ae0cbdd4ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:54.223516 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e2afa386-5a7c-4930-90b0-956860e61656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:54.304904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66c09a-ab56-412d-a17d-8ff21bbf0833 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:54.307515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1045/2088] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:54.310387 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eec60-0770-47e3-82a5-d92d83da78ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:54.311360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eec60-0770-47e3-82a5-d92d83da78ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:54.311713 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eec60-0770-47e3-82a5-d92d83da78ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:54.312082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eec60-0770-47e3-82a5-d92d83da78ef admin admin] PATH_INFO: `/v3/users/e66424df4ee642b6a8d8dd03a1bcf909` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:54.317042 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eec60-0770-47e3-82a5-d92d83da78ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66424df4ee642b6a8d8dd03a1bcf909)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:54.317042 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eec60-0770-47e3-82a5-d92d83da78ef admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:54.319222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afa386-5a7c-4930-90b0-956860e61656 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:54.320603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e2afa386-5a7c-4930-90b0-956860e61656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:54.385504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afa386-5a7c-4930-90b0-956860e61656 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:54.389377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304005ac-208b-4f04-bf4d-4f79736d30b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:54.389974 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304005ac-208b-4f04-bf4d-4f79736d30b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:54.390247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304005ac-208b-4f04-bf4d-4f79736d30b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:54.390512 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304005ac-208b-4f04-bf4d-4f79736d30b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:54.400374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304005ac-208b-4f04-bf4d-4f79736d30b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:54.402130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304005ac-208b-4f04-bf4d-4f79736d30b3 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:54.412914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1046/2089] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:41:54.542934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:54.591673 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-af1eec60-0770-47e3-82a5-d92d83da78ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66424df4ee642b6a8d8dd03a1bcf909'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:54.681201 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-af1eec60-0770-47e3-82a5-d92d83da78ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66424df4ee642b6a8d8dd03a1bcf909'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:54.682333 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-af1eec60-0770-47e3-82a5-d92d83da78ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66424df4ee642b6a8d8dd03a1bcf909'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:54.694432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-af1eec60-0770-47e3-82a5-d92d83da78ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66424df4ee642b6a8d8dd03a1bcf909'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:54.712312 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-af1eec60-0770-47e3-82a5-d92d83da78ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66424df4ee642b6a8d8dd03a1bcf909'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:54.718706 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1044/2090] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:54 2022] DELETE /identity/v3/users/e66424df4ee642b6a8d8dd03a1bcf909 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:54.723185 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a9f10-a2d4-4c7d-8249-bccb629d6389 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:54.723744 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a9f10-a2d4-4c7d-8249-bccb629d6389 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:54.723837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a9f10-a2d4-4c7d-8249-bccb629d6389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:54.744496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-120a9f10-a2d4-4c7d-8249-bccb629d6389 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:54.745847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-120a9f10-a2d4-4c7d-8249-bccb629d6389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:54.759008 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:54.845092 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1047/2091] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:54.852271 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eec60-0770-47e3-82a5-d92d83da78ef admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:54.861143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-af1eec60-0770-47e3-82a5-d92d83da78ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:54.918033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eec60-0770-47e3-82a5-d92d83da78ef admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:54.921709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d6097-69c2-4263-ad5a-8c80cda6edd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:54.922376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6097-69c2-4263-ad5a-8c80cda6edd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:54.922672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6097-69c2-4263-ad5a-8c80cda6edd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:54.922930 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6097-69c2-4263-ad5a-8c80cda6edd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:54.938906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d6097-69c2-4263-ad5a-8c80cda6edd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:54.942455 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d6097-69c2-4263-ad5a-8c80cda6edd9 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:54.962062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1045/2092] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:54.996462 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:55.178098 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:55.496742 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a9f10-a2d4-4c7d-8249-bccb629d6389 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:55.498443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-120a9f10-a2d4-4c7d-8249-bccb629d6389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:55.515557 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a9f10-a2d4-4c7d-8249-bccb629d6389 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:55.521424 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:55.525703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:55.525703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:55.525703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] PATH_INFO: `/v3/projects/d3c8edfc70fa41bf8b834eddaf96dc16` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:55.525703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c8edfc70fa41bf8b834eddaf96dc16)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:55.527343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:55.665158 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c8edfc70fa41bf8b834eddaf96dc16', 'request_id': 'req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:55.671684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c8edfc70fa41bf8b834eddaf96dc16', 'request_id': 'req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:55.678023 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c8edfc70fa41bf8b834eddaf96dc16', 'request_id': 'req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:55.774940 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] The token cache is being invalidate because project d3c8edfc70fa41bf8b834eddaf96dc16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:55.775853 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:55.779792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:55.781284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1048/2093] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:55 2022] DELETE /identity/v3/projects/d3c8edfc70fa41bf8b834eddaf96dc16 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:55.785778 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d6097-69c2-4263-ad5a-8c80cda6edd9 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:55.799784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d6097-69c2-4263-ad5a-8c80cda6edd9 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:55.919682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a19f3-06c7-4b9f-97ab-7b67f143009e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:55.920450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a19f3-06c7-4b9f-97ab-7b67f143009e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:55.920849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a19f3-06c7-4b9f-97ab-7b67f143009e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:55.921322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a19f3-06c7-4b9f-97ab-7b67f143009e admin admin] PATH_INFO: `/v3/users/2cc7136694a84b13b2217f63c5cfd919` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:55.922842 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a19f3-06c7-4b9f-97ab-7b67f143009e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc7136694a84b13b2217f63c5cfd919)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:55.925268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a19f3-06c7-4b9f-97ab-7b67f143009e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:55.944291 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:55.953190 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:56.018145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e120d3-4e0d-4076-b4cc-7fa2d5c3b34e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:56.022460 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1fed4-7751-4581-9c50-3dbe25943bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:56.023068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1fed4-7751-4581-9c50-3dbe25943bee service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:56.023347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1fed4-7751-4581-9c50-3dbe25943bee service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:56.023730 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1fed4-7751-4581-9c50-3dbe25943bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:56.025683 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c6a1fed4-7751-4581-9c50-3dbe25943bee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:56.102034 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1fed4-7751-4581-9c50-3dbe25943bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:56.103910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1fed4-7751-4581-9c50-3dbe25943bee service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:56.114779 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1049/2094] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:41:56.115934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1fed4-7751-4581-9c50-3dbe25943bee service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:56.117355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c6a1fed4-7751-4581-9c50-3dbe25943bee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:56.129605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1fed4-7751-4581-9c50-3dbe25943bee service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:56.134120 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fd1ba-2c7c-4dab-a70f-e511ed50843e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:56.136658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd1ba-2c7c-4dab-a70f-e511ed50843e service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:56.136658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd1ba-2c7c-4dab-a70f-e511ed50843e service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:56.136658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd1ba-2c7c-4dab-a70f-e511ed50843e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:56.137482 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-416fd1ba-2c7c-4dab-a70f-e511ed50843e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:56.186029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e07a19f3-06c7-4b9f-97ab-7b67f143009e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc7136694a84b13b2217f63c5cfd919'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:56.186999 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:56.223277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fd1ba-2c7c-4dab-a70f-e511ed50843e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:56.224746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fd1ba-2c7c-4dab-a70f-e511ed50843e service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:56.234207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1050/2095] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:56.262917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e07a19f3-06c7-4b9f-97ab-7b67f143009e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc7136694a84b13b2217f63c5cfd919'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:56.263656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e07a19f3-06c7-4b9f-97ab-7b67f143009e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc7136694a84b13b2217f63c5cfd919'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:56.273996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e07a19f3-06c7-4b9f-97ab-7b67f143009e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc7136694a84b13b2217f63c5cfd919'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:56.297722 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e07a19f3-06c7-4b9f-97ab-7b67f143009e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc7136694a84b13b2217f63c5cfd919'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:56.306441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1046/2096] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:41:55 2022] DELETE /identity/v3/users/2cc7136694a84b13b2217f63c5cfd919 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:56.493578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:56.978678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fd1ba-2c7c-4dab-a70f-e511ed50843e service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:56.980935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-416fd1ba-2c7c-4dab-a70f-e511ed50843e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:56.999704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fd1ba-2c7c-4dab-a70f-e511ed50843e service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:57.062891 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd851a7-65bd-49cb-8adb-2d5b84b05cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:57.063448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd851a7-65bd-49cb-8adb-2d5b84b05cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:57.063725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd851a7-65bd-49cb-8adb-2d5b84b05cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:57.063991 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd851a7-65bd-49cb-8adb-2d5b84b05cca admin admin] PATH_INFO: `/v3/projects/9c0ad910b62641608b1475d533902a5d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:57.065170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd851a7-65bd-49cb-8adb-2d5b84b05cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0ad910b62641608b1475d533902a5d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:57.067264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd851a7-65bd-49cb-8adb-2d5b84b05cca admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:57.197014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-abd851a7-65bd-49cb-8adb-2d5b84b05cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0ad910b62641608b1475d533902a5d', 'request_id': 'req-abd851a7-65bd-49cb-8adb-2d5b84b05cca'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:57.203563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-abd851a7-65bd-49cb-8adb-2d5b84b05cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0ad910b62641608b1475d533902a5d', 'request_id': 'req-abd851a7-65bd-49cb-8adb-2d5b84b05cca'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:57.213791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-abd851a7-65bd-49cb-8adb-2d5b84b05cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0ad910b62641608b1475d533902a5d', 'request_id': 'req-abd851a7-65bd-49cb-8adb-2d5b84b05cca'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:57.280330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-abd851a7-65bd-49cb-8adb-2d5b84b05cca admin admin] The token cache is being invalidate because project 9c0ad910b62641608b1475d533902a5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:41:57.280738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-abd851a7-65bd-49cb-8adb-2d5b84b05cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:57.289504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-abd851a7-65bd-49cb-8adb-2d5b84b05cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:41:57.289504 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1051/2097] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:41:56 2022] DELETE /identity/v3/projects/9c0ad910b62641608b1475d533902a5d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:57.291523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef9231-cc26-4c52-add5-30122497da62 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:57.291998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef9231-cc26-4c52-add5-30122497da62 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:57.292624 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef9231-cc26-4c52-add5-30122497da62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:57.319770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-3eef9231-cc26-4c52-add5-30122497da62 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:57.321262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-3eef9231-cc26-4c52-add5-30122497da62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:57.394639 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1047/2098] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:57.403754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7430043-3ffe-4cc1-93b0-464262dc3734 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:57.404036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7430043-3ffe-4cc1-93b0-464262dc3734 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:57.404307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7430043-3ffe-4cc1-93b0-464262dc3734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:57.432068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a7430043-3ffe-4cc1-93b0-464262dc3734 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:57.433270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a7430043-3ffe-4cc1-93b0-464262dc3734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:57.454408 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1052/2099] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:57.459712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef9231-cc26-4c52-add5-30122497da62 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:57.470290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef9231-cc26-4c52-add5-30122497da62 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:57.475852 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316ca7-b3d7-4c0c-a860-76bed1d4accc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:57.476701 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316ca7-b3d7-4c0c-a860-76bed1d4accc admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:57.477004 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316ca7-b3d7-4c0c-a860-76bed1d4accc admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:57.477349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316ca7-b3d7-4c0c-a860-76bed1d4accc admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:57.478001 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316ca7-b3d7-4c0c-a860-76bed1d4accc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:41:57.478366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316ca7-b3d7-4c0c-a860-76bed1d4accc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:57.479970 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316ca7-b3d7-4c0c-a860-76bed1d4accc admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:57.497053 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1048/2100] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:41:57.501376 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7430043-3ffe-4cc1-93b0-464262dc3734 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:57.522739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7430043-3ffe-4cc1-93b0-464262dc3734 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:57.528272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5544e-ab56-45cd-8bb7-fbfcee9e13c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:57.528889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5544e-ab56-45cd-8bb7-fbfcee9e13c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:57.529197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5544e-ab56-45cd-8bb7-fbfcee9e13c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:57.529465 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5544e-ab56-45cd-8bb7-fbfcee9e13c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:57.530905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5544e-ab56-45cd-8bb7-fbfcee9e13c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:57.533375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5544e-ab56-45cd-8bb7-fbfcee9e13c9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:57.623338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1053/2101] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:57 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:57.627992 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316ca7-b3d7-4c0c-a860-76bed1d4accc admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:57.646348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316ca7-b3d7-4c0c-a860-76bed1d4accc admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:57.727147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54d401-bb40-4e74-b6b1-6f218043bfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:57.727760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54d401-bb40-4e74-b6b1-6f218043bfbb admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:57.728039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54d401-bb40-4e74-b6b1-6f218043bfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:57.728375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54d401-bb40-4e74-b6b1-6f218043bfbb admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:57.729061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54d401-bb40-4e74-b6b1-6f218043bfbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:57.731507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54d401-bb40-4e74-b6b1-6f218043bfbb admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:57.865831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1049/2102] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:57 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:57.879115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5544e-ab56-45cd-8bb7-fbfcee9e13c9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:57.891724 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5544e-ab56-45cd-8bb7-fbfcee9e13c9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:57.897154 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c3c43-47f3-4b21-94ca-514a588cf8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:57.901754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c3c43-47f3-4b21-94ca-514a588cf8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:57.902312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c3c43-47f3-4b21-94ca-514a588cf8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:57.902812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c3c43-47f3-4b21-94ca-514a588cf8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:57.903687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c3c43-47f3-4b21-94ca-514a588cf8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:57.905910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c3c43-47f3-4b21-94ca-514a588cf8d2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:57.928326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1054/2103] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:57.929584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54d401-bb40-4e74-b6b1-6f218043bfbb admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:57.952234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54d401-bb40-4e74-b6b1-6f218043bfbb admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:57.965451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1681d-434e-4476-a594-f144b607aaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:57.966249 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1681d-434e-4476-a594-f144b607aaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:57.966535 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1681d-434e-4476-a594-f144b607aaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:57.966959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1681d-434e-4476-a594-f144b607aaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:57.967676 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1681d-434e-4476-a594-f144b607aaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:57.969610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1681d-434e-4476-a594-f144b607aaa3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:57.988778 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1050/2104] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:57.988778 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:57.990438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c3c43-47f3-4b21-94ca-514a588cf8d2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:58.013248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c3c43-47f3-4b21-94ca-514a588cf8d2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:58.013248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be257601-479c-4af6-8079-e3204cba0918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:58.013248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be257601-479c-4af6-8079-e3204cba0918 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:58.013596 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be257601-479c-4af6-8079-e3204cba0918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:58.014028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be257601-479c-4af6-8079-e3204cba0918 admin admin] PATH_INFO: `/v3/projects/2c266aef83b24ec8a5aa9da27d04da2d/users/6953b3a31d694a08a04097b9da52b6da/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:58.032604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be257601-479c-4af6-8079-e3204cba0918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c266aef83b24ec8a5aa9da27d04da2d, user_id=6953b3a31d694a08a04097b9da52b6da, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:58.035703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be257601-479c-4af6-8079-e3204cba0918 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:58.161572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:58.184785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1055/2105] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:57 2022] PUT /identity/v3/projects/2c266aef83b24ec8a5aa9da27d04da2d/users/6953b3a31d694a08a04097b9da52b6da/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:58.193979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774ece3-02e9-45fd-a89a-324c4d73ad09 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:58.194136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774ece3-02e9-45fd-a89a-324c4d73ad09 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:58.194376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774ece3-02e9-45fd-a89a-324c4d73ad09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:58.231276 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-8774ece3-02e9-45fd-a89a-324c4d73ad09 None None] MFA Rules not processed for user `6953b3a31d694a08a04097b9da52b6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:58.232906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8774ece3-02e9-45fd-a89a-324c4d73ad09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:58.358880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1051/2106] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:41:58.363892 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be257601-479c-4af6-8079-e3204cba0918 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:58.464798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be257601-479c-4af6-8079-e3204cba0918 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:58.472763 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43be138-3b43-406d-9981-3d39d922c6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:58.474113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43be138-3b43-406d-9981-3d39d922c6af admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:58.474113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43be138-3b43-406d-9981-3d39d922c6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:58.474291 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43be138-3b43-406d-9981-3d39d922c6af admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:58.474985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43be138-3b43-406d-9981-3d39d922c6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:58.478198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43be138-3b43-406d-9981-3d39d922c6af admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:58.621331 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1056/2107] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:41:58 2022] POST /identity/v3/projects => generated 381 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:41:58.625227 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774ece3-02e9-45fd-a89a-324c4d73ad09 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:58.639585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774ece3-02e9-45fd-a89a-324c4d73ad09 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:58.784421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add9fe1-43f1-4675-93d9-001b32a0b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:58.786448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add9fe1-43f1-4675-93d9-001b32a0b143 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:58.786886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add9fe1-43f1-4675-93d9-001b32a0b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:58.788006 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add9fe1-43f1-4675-93d9-001b32a0b143 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:58.789090 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add9fe1-43f1-4675-93d9-001b32a0b143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:58.791803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add9fe1-43f1-4675-93d9-001b32a0b143 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:58.891289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1052/2108] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:41:58 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:41:58.892866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43be138-3b43-406d-9981-3d39d922c6af admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:58.906309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43be138-3b43-406d-9981-3d39d922c6af admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:58.912509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b52d67-866e-44cb-80c2-512b1b127a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:58.913164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b52d67-866e-44cb-80c2-512b1b127a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:58.913440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b52d67-866e-44cb-80c2-512b1b127a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:58.913718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b52d67-866e-44cb-80c2-512b1b127a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:58.914417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b52d67-866e-44cb-80c2-512b1b127a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:58.916219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b52d67-866e-44cb-80c2-512b1b127a44 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:58.932840 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1057/2109] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:41:58.934147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add9fe1-43f1-4675-93d9-001b32a0b143 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:58.945855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add9fe1-43f1-4675-93d9-001b32a0b143 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:58.951015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945993b3-56b4-49e7-8a27-67a254578e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:58.954580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945993b3-56b4-49e7-8a27-67a254578e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:58.954580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945993b3-56b4-49e7-8a27-67a254578e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:58.954580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945993b3-56b4-49e7-8a27-67a254578e27 admin admin] PATH_INFO: `/v3/projects/f16d86177ae649bb992dfdffe199aa2e/users/93074fef1ab046058f946072b3fe9b43/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:58.970762 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945993b3-56b4-49e7-8a27-67a254578e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16d86177ae649bb992dfdffe199aa2e, user_id=93074fef1ab046058f946072b3fe9b43, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:58.974658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945993b3-56b4-49e7-8a27-67a254578e27 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:59.069724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1053/2110] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:58 2022] PUT /identity/v3/projects/f16d86177ae649bb992dfdffe199aa2e/users/93074fef1ab046058f946072b3fe9b43/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:41:59.070919 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b52d67-866e-44cb-80c2-512b1b127a44 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:59.089702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b52d67-866e-44cb-80c2-512b1b127a44 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:59.170626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca39fea-71a0-4e31-a13b-ce87d119245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:59.171292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca39fea-71a0-4e31-a13b-ce87d119245b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:59.171568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca39fea-71a0-4e31-a13b-ce87d119245b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:59.171836 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca39fea-71a0-4e31-a13b-ce87d119245b admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:59.172479 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca39fea-71a0-4e31-a13b-ce87d119245b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:59.174167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca39fea-71a0-4e31-a13b-ce87d119245b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:59.184354 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1058/2111] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:41:59.188490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945993b3-56b4-49e7-8a27-67a254578e27 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:59.199309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945993b3-56b4-49e7-8a27-67a254578e27 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:59.204046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cc840-969d-476f-be38-212aa54d581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:59.204696 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cc840-969d-476f-be38-212aa54d581f admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:59.204972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cc840-969d-476f-be38-212aa54d581f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:59.205271 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cc840-969d-476f-be38-212aa54d581f admin admin] PATH_INFO: `/v3/projects/f16d86177ae649bb992dfdffe199aa2e/users/93074fef1ab046058f946072b3fe9b43/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:59.209177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cc840-969d-476f-be38-212aa54d581f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16d86177ae649bb992dfdffe199aa2e, user_id=93074fef1ab046058f946072b3fe9b43, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:59.211360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cc840-969d-476f-be38-212aa54d581f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:59.223069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1054/2112] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:41:59 2022] PUT /identity/v3/projects/f16d86177ae649bb992dfdffe199aa2e/users/93074fef1ab046058f946072b3fe9b43/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:41:59.233588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d7bea-5b89-4869-b2b2-6cbed6f2cfdb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:59.234018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d7bea-5b89-4869-b2b2-6cbed6f2cfdb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:59.234392 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d7bea-5b89-4869-b2b2-6cbed6f2cfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:59.266051 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-765d7bea-5b89-4869-b2b2-6cbed6f2cfdb None None] MFA Rules not processed for user `93074fef1ab046058f946072b3fe9b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:41:59.268030 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-765d7bea-5b89-4869-b2b2-6cbed6f2cfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:59.419419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1059/2113] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:41:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:41:59.432606 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cc840-969d-476f-be38-212aa54d581f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:59.434476 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b51cc840-969d-476f-be38-212aa54d581f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:41:59.480701 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:41:59.499658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cc840-969d-476f-be38-212aa54d581f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:59.504687 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664395-cd56-449b-ac0a-d2f2261e659d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:59.505413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664395-cd56-449b-ac0a-d2f2261e659d service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:59.505692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664395-cd56-449b-ac0a-d2f2261e659d service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:59.505963 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664395-cd56-449b-ac0a-d2f2261e659d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:59.515812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664395-cd56-449b-ac0a-d2f2261e659d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:59.517401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664395-cd56-449b-ac0a-d2f2261e659d service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:59.528770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1055/2114] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:41:59.714267 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d7bea-5b89-4869-b2b2-6cbed6f2cfdb None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:41:59.728064 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d7bea-5b89-4869-b2b2-6cbed6f2cfdb None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:41:59.732117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eede9-7af1-41da-8687-1f75492dc73a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:41:59.732895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eede9-7af1-41da-8687-1f75492dc73a service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:41:59.733487 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eede9-7af1-41da-8687-1f75492dc73a service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:41:59.733825 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eede9-7af1-41da-8687-1f75492dc73a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:41:59.807190 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eede9-7af1-41da-8687-1f75492dc73a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:41:59.809786 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eede9-7af1-41da-8687-1f75492dc73a service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:41:59.845926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1060/2115] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:41:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:42:00.564897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=2,keystone:SELECT=83,keystone:DELETE=15 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:00.656974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b6d8f-7fb9-465f-8158-963d37736f5a None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:00.657508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b6d8f-7fb9-465f-8158-963d37736f5a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:00.658107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b6d8f-7fb9-465f-8158-963d37736f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:00.726975 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-1e9b6d8f-7fb9-465f-8158-963d37736f5a None None] MFA Rules not processed for user `255138cca3254c5f939112b74a04011f`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:00.728529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1e9b6d8f-7fb9-465f-8158-963d37736f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:00.814189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1056/2116] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:42:00.829474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eede9-7af1-41da-8687-1f75492dc73a service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:00.831251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c20eede9-7af1-41da-8687-1f75492dc73a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:00.904730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b6d8f-7fb9-465f-8158-963d37736f5a None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:00.961320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eede9-7af1-41da-8687-1f75492dc73a service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:00.969368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79731be7-9eea-4706-a9ce-52690cef56ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:00.970018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79731be7-9eea-4706-a9ce-52690cef56ce service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:00.971149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79731be7-9eea-4706-a9ce-52690cef56ce service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:00.971149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79731be7-9eea-4706-a9ce-52690cef56ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:00.979681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79731be7-9eea-4706-a9ce-52690cef56ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:00.981395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79731be7-9eea-4706-a9ce-52690cef56ce service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:00.990247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1061/2117] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:42:01.003468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b6d8f-7fb9-465f-8158-963d37736f5a None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:01.008599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8046d-e3c4-4d26-87d9-02e6a97a1a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:01.009285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8046d-e3c4-4d26-87d9-02e6a97a1a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:01.009561 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8046d-e3c4-4d26-87d9-02e6a97a1a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:01.009830 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8046d-e3c4-4d26-87d9-02e6a97a1a57 admin admin] PATH_INFO: `/v3/users/6953b3a31d694a08a04097b9da52b6da` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:01.011001 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8046d-e3c4-4d26-87d9-02e6a97a1a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6953b3a31d694a08a04097b9da52b6da)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:01.012942 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8046d-e3c4-4d26-87d9-02e6a97a1a57 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:01.076507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:01.302778 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-63d8046d-e3c4-4d26-87d9-02e6a97a1a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6953b3a31d694a08a04097b9da52b6da'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:01.393366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-63d8046d-e3c4-4d26-87d9-02e6a97a1a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6953b3a31d694a08a04097b9da52b6da'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:01.394587 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-63d8046d-e3c4-4d26-87d9-02e6a97a1a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6953b3a31d694a08a04097b9da52b6da'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:01.402494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-63d8046d-e3c4-4d26-87d9-02e6a97a1a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6953b3a31d694a08a04097b9da52b6da'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:01.415899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-63d8046d-e3c4-4d26-87d9-02e6a97a1a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6953b3a31d694a08a04097b9da52b6da'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:01.422347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1057/2118] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:42:00 2022] DELETE /identity/v3/users/6953b3a31d694a08a04097b9da52b6da => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:42:01.427763 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6b09c-47be-4a23-986c-eb4412e8545e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:01.428435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6b09c-47be-4a23-986c-eb4412e8545e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:01.428797 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6b09c-47be-4a23-986c-eb4412e8545e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:01.450116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3fe6b09c-47be-4a23-986c-eb4412e8545e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:01.453445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3fe6b09c-47be-4a23-986c-eb4412e8545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:01.562737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1062/2119] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:01.574250 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8046d-e3c4-4d26-87d9-02e6a97a1a57 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:01.576438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-63d8046d-e3c4-4d26-87d9-02e6a97a1a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:01.592215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6b09c-47be-4a23-986c-eb4412e8545e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:01.596934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3fe6b09c-47be-4a23-986c-eb4412e8545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:01.622028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6b09c-47be-4a23-986c-eb4412e8545e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:01.627210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf397ba-353e-4e80-9566-bf22e69bc87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:01.627899 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf397ba-353e-4e80-9566-bf22e69bc87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:01.628699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf397ba-353e-4e80-9566-bf22e69bc87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:01.629050 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf397ba-353e-4e80-9566-bf22e69bc87f admin admin] PATH_INFO: `/v3/users/cdf38c17d4a04d46b9ed83252292b63d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:01.630242 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf397ba-353e-4e80-9566-bf22e69bc87f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf38c17d4a04d46b9ed83252292b63d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:01.632222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf397ba-353e-4e80-9566-bf22e69bc87f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:01.711801 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8046d-e3c4-4d26-87d9-02e6a97a1a57 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:01.712777 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7985eee-d8da-4e6c-b2ab-14d5e1773c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:01.713415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7985eee-d8da-4e6c-b2ab-14d5e1773c50 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:01.714288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7985eee-d8da-4e6c-b2ab-14d5e1773c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:01.714738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7985eee-d8da-4e6c-b2ab-14d5e1773c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:01.726718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7985eee-d8da-4e6c-b2ab-14d5e1773c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:01.728418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7985eee-d8da-4e6c-b2ab-14d5e1773c50 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:01.742586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1058/2120] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:42:01.836430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9cf397ba-353e-4e80-9566-bf22e69bc87f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf38c17d4a04d46b9ed83252292b63d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:01.848518 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9cf397ba-353e-4e80-9566-bf22e69bc87f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf38c17d4a04d46b9ed83252292b63d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:01.871951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9cf397ba-353e-4e80-9566-bf22e69bc87f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf38c17d4a04d46b9ed83252292b63d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:01.976628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9cf397ba-353e-4e80-9566-bf22e69bc87f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf38c17d4a04d46b9ed83252292b63d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:01.977841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9cf397ba-353e-4e80-9566-bf22e69bc87f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf38c17d4a04d46b9ed83252292b63d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:01.987066 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1063/2121] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:42:01 2022] DELETE /identity/v3/users/cdf38c17d4a04d46b9ed83252292b63d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:01.992334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69654f9-c0b8-46bb-943d-636c8042ccf1 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:01.992720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69654f9-c0b8-46bb-943d-636c8042ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:01.993234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69654f9-c0b8-46bb-943d-636c8042ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:01.994349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf397ba-353e-4e80-9566-bf22e69bc87f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:01.995958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9cf397ba-353e-4e80-9566-bf22e69bc87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:02.015882 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-b69654f9-c0b8-46bb-943d-636c8042ccf1 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:02.017316 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b69654f9-c0b8-46bb-943d-636c8042ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:02.073873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf397ba-353e-4e80-9566-bf22e69bc87f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:02.078051 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c9144-7e5c-4bef-aa66-6dbbec6581c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:02.078913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c9144-7e5c-4bef-aa66-6dbbec6581c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:02.079363 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c9144-7e5c-4bef-aa66-6dbbec6581c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:02.079832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c9144-7e5c-4bef-aa66-6dbbec6581c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:02.083673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b68c9144-7e5c-4bef-aa66-6dbbec6581c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:02.121087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1059/2122] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:02.128156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69654f9-c0b8-46bb-943d-636c8042ccf1 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:02.132820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b69654f9-c0b8-46bb-943d-636c8042ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:02.192249 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c9144-7e5c-4bef-aa66-6dbbec6581c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:02.193987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c9144-7e5c-4bef-aa66-6dbbec6581c8 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:02.207246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1064/2123] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:42:02.218035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69654f9-c0b8-46bb-943d-636c8042ccf1 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:02.222911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983c4db-9bb7-4bf1-bfcc-0be60b127aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:02.223645 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983c4db-9bb7-4bf1-bfcc-0be60b127aca service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:02.223926 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983c4db-9bb7-4bf1-bfcc-0be60b127aca service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:02.224203 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983c4db-9bb7-4bf1-bfcc-0be60b127aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:02.236066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983c4db-9bb7-4bf1-bfcc-0be60b127aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:02.238333 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983c4db-9bb7-4bf1-bfcc-0be60b127aca service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:02.257200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1060/2124] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:42:02.308244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c9144-7e5c-4bef-aa66-6dbbec6581c8 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:02.311033 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b68c9144-7e5c-4bef-aa66-6dbbec6581c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:02.328527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c9144-7e5c-4bef-aa66-6dbbec6581c8 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:02.335068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:02.335802 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:02.336154 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:02.336500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] PATH_INFO: `/v3/projects/2c266aef83b24ec8a5aa9da27d04da2d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:02.337994 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c266aef83b24ec8a5aa9da27d04da2d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:02.340149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:02.473821 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c266aef83b24ec8a5aa9da27d04da2d', 'request_id': 'req-8270b7c1-85f1-47a4-8826-03ca1c5896db'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:02.481390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c266aef83b24ec8a5aa9da27d04da2d', 'request_id': 'req-8270b7c1-85f1-47a4-8826-03ca1c5896db'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:02.490214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c266aef83b24ec8a5aa9da27d04da2d', 'request_id': 'req-8270b7c1-85f1-47a4-8826-03ca1c5896db'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:02.572196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] The token cache is being invalidate because project 2c266aef83b24ec8a5aa9da27d04da2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:42:02.572692 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:02.573555 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:02.575754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1065/2125] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:42:02 2022] DELETE /identity/v3/projects/2c266aef83b24ec8a5aa9da27d04da2d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:02.579908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983c4db-9bb7-4bf1-bfcc-0be60b127aca service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:02.592294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983c4db-9bb7-4bf1-bfcc-0be60b127aca service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:02.669373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac8228-bd31-4d6c-9f07-be108214b80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:02.670205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac8228-bd31-4d6c-9f07-be108214b80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:02.670631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac8228-bd31-4d6c-9f07-be108214b80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:02.671423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac8228-bd31-4d6c-9f07-be108214b80e admin admin] PATH_INFO: `/v3/users/93074fef1ab046058f946072b3fe9b43` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:02.673083 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac8228-bd31-4d6c-9f07-be108214b80e admin admin] RBAC: Authorizing `identity:delete_user(user_id=93074fef1ab046058f946072b3fe9b43)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:02.675266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac8228-bd31-4d6c-9f07-be108214b80e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:02.839759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:02.841515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:02.865612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270b7c1-85f1-47a4-8826-03ca1c5896db admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:02.877700 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:02.878531 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:02.878878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:02.879384 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] PATH_INFO: `/v3/projects/4e1c0b6d0b7a4478b749da21a0d2bbb0` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:02.881715 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1c0b6d0b7a4478b749da21a0d2bbb0)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:02.883902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:02.957136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a8ac8228-bd31-4d6c-9f07-be108214b80e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93074fef1ab046058f946072b3fe9b43'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.068246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:03.104233 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a8ac8228-bd31-4d6c-9f07-be108214b80e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93074fef1ab046058f946072b3fe9b43'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.107268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a8ac8228-bd31-4d6c-9f07-be108214b80e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93074fef1ab046058f946072b3fe9b43'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.141972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a8ac8228-bd31-4d6c-9f07-be108214b80e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93074fef1ab046058f946072b3fe9b43'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.148045 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1c0b6d0b7a4478b749da21a0d2bbb0', 'request_id': 'req-b431711a-7da4-458e-a3ab-33dc00ece6c9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.159709 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1c0b6d0b7a4478b749da21a0d2bbb0', 'request_id': 'req-b431711a-7da4-458e-a3ab-33dc00ece6c9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.171001 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1c0b6d0b7a4478b749da21a0d2bbb0', 'request_id': 'req-b431711a-7da4-458e-a3ab-33dc00ece6c9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.173766 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a8ac8228-bd31-4d6c-9f07-be108214b80e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93074fef1ab046058f946072b3fe9b43'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.185590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1061/2126] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:42:02 2022] DELETE /identity/v3/users/93074fef1ab046058f946072b3fe9b43 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:03.259910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] The token cache is being invalidate because project 4e1c0b6d0b7a4478b749da21a0d2bbb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:42:03.260208 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.260876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.265358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1066/2127] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:42:02 2022] DELETE /identity/v3/projects/4e1c0b6d0b7a4478b749da21a0d2bbb0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:42:03.266761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac8228-bd31-4d6c-9f07-be108214b80e admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:03.268239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a8ac8228-bd31-4d6c-9f07-be108214b80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:03.365495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac8228-bd31-4d6c-9f07-be108214b80e admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:03.370148 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f729088-d272-4f1d-b679-5c3f9f2ba0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:03.370781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f729088-d272-4f1d-b679-5c3f9f2ba0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:03.371179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f729088-d272-4f1d-b679-5c3f9f2ba0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:03.371459 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f729088-d272-4f1d-b679-5c3f9f2ba0d5 admin admin] PATH_INFO: `/v3/users/b99aa10aeab04d19a6e5a5fb913770b1` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:03.372579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f729088-d272-4f1d-b679-5c3f9f2ba0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99aa10aeab04d19a6e5a5fb913770b1)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:03.374562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f729088-d272-4f1d-b679-5c3f9f2ba0d5 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:03.702577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8f729088-d272-4f1d-b679-5c3f9f2ba0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99aa10aeab04d19a6e5a5fb913770b1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.710655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:03.720391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:03.720391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:03.767713 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8f729088-d272-4f1d-b679-5c3f9f2ba0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99aa10aeab04d19a6e5a5fb913770b1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.769537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8f729088-d272-4f1d-b679-5c3f9f2ba0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99aa10aeab04d19a6e5a5fb913770b1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.778887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8f729088-d272-4f1d-b679-5c3f9f2ba0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99aa10aeab04d19a6e5a5fb913770b1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.803795 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8f729088-d272-4f1d-b679-5c3f9f2ba0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99aa10aeab04d19a6e5a5fb913770b1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:03.812709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1062/2128] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:42:03 2022] DELETE /identity/v3/users/b99aa10aeab04d19a6e5a5fb913770b1 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:03.826958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431711a-7da4-458e-a3ab-33dc00ece6c9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:03.893900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f14164-5315-40fb-b4ec-615d7bb62e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:03.894637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f14164-5315-40fb-b4ec-615d7bb62e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:03.894913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f14164-5315-40fb-b4ec-615d7bb62e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:03.895333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f14164-5315-40fb-b4ec-615d7bb62e12 admin admin] PATH_INFO: `/v3/projects/f16d86177ae649bb992dfdffe199aa2e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:03.896766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f14164-5315-40fb-b4ec-615d7bb62e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16d86177ae649bb992dfdffe199aa2e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:03.898939 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f14164-5315-40fb-b4ec-615d7bb62e12 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:04.079413 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-58f14164-5315-40fb-b4ec-615d7bb62e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16d86177ae649bb992dfdffe199aa2e', 'request_id': 'req-58f14164-5315-40fb-b4ec-615d7bb62e12'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:04.091127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-58f14164-5315-40fb-b4ec-615d7bb62e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16d86177ae649bb992dfdffe199aa2e', 'request_id': 'req-58f14164-5315-40fb-b4ec-615d7bb62e12'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:04.108030 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-58f14164-5315-40fb-b4ec-615d7bb62e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16d86177ae649bb992dfdffe199aa2e', 'request_id': 'req-58f14164-5315-40fb-b4ec-615d7bb62e12'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:04.195496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-58f14164-5315-40fb-b4ec-615d7bb62e12 admin admin] The token cache is being invalidate because project f16d86177ae649bb992dfdffe199aa2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:42:04.196539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-58f14164-5315-40fb-b4ec-615d7bb62e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:04.197714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-58f14164-5315-40fb-b4ec-615d7bb62e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:04.205650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1067/2129] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:42:03 2022] DELETE /identity/v3/projects/f16d86177ae649bb992dfdffe199aa2e => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:42:04.207961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf06e4-72e6-464f-840e-856543ce2848 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:04.208415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf06e4-72e6-464f-840e-856543ce2848 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:04.211968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf06e4-72e6-464f-840e-856543ce2848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:04.241219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-e9cf06e4-72e6-464f-840e-856543ce2848 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:04.244076 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-e9cf06e4-72e6-464f-840e-856543ce2848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:04.349681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1063/2130] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:42:04.358310 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b786107-f5b7-4e6f-a7d7-b8e2bf8106f7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:04.359035 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b786107-f5b7-4e6f-a7d7-b8e2bf8106f7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:04.359550 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b786107-f5b7-4e6f-a7d7-b8e2bf8106f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:04.396663 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5b786107-f5b7-4e6f-a7d7-b8e2bf8106f7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:04.398162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5b786107-f5b7-4e6f-a7d7-b8e2bf8106f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:04.407999 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1068/2131] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:04.420551 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf06e4-72e6-464f-840e-856543ce2848 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:04.441387 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf06e4-72e6-464f-840e-856543ce2848 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:04.446794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663c5a1-1d2f-4da1-8b11-8178a28eb357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:04.449635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c5a1-1d2f-4da1-8b11-8178a28eb357 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:04.449921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c5a1-1d2f-4da1-8b11-8178a28eb357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:04.450198 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c5a1-1d2f-4da1-8b11-8178a28eb357 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:04.450901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663c5a1-1d2f-4da1-8b11-8178a28eb357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:42:04.451193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663c5a1-1d2f-4da1-8b11-8178a28eb357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:04.457567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663c5a1-1d2f-4da1-8b11-8178a28eb357 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:04.486418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1064/2132] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:42:04.490622 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b786107-f5b7-4e6f-a7d7-b8e2bf8106f7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:04.502431 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b786107-f5b7-4e6f-a7d7-b8e2bf8106f7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:04.514353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a278a4-9f74-4bc5-8710-b42c1cb23e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:04.516226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a278a4-9f74-4bc5-8710-b42c1cb23e60 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:04.516491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a278a4-9f74-4bc5-8710-b42c1cb23e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:04.516760 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a278a4-9f74-4bc5-8710-b42c1cb23e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:04.517438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a278a4-9f74-4bc5-8710-b42c1cb23e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:04.523458 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a278a4-9f74-4bc5-8710-b42c1cb23e60 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:04.542086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63568f93-2215-4b09-9c60-883fedb51225 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:04.542393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63568f93-2215-4b09-9c60-883fedb51225 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:04.542640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63568f93-2215-4b09-9c60-883fedb51225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:04.585585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-63568f93-2215-4b09-9c60-883fedb51225 None None] MFA Rules not processed for user `255138cca3254c5f939112b74a04011f`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:04.586809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-63568f93-2215-4b09-9c60-883fedb51225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:04.636166 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1069/2133] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:42:04 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:42:04.657114 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a278a4-9f74-4bc5-8710-b42c1cb23e60 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:04.690923 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1065/2134] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:42:04.692169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63568f93-2215-4b09-9c60-883fedb51225 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:04.697159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-63568f93-2215-4b09-9c60-883fedb51225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:04.719205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63568f93-2215-4b09-9c60-883fedb51225 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:04.832259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a278a4-9f74-4bc5-8710-b42c1cb23e60 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:04.836366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:04.837238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:04.837678 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:04.837951 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] PATH_INFO: `/v3/projects/b66d7e0790d241108c6e0dbf8c6b48a1` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:04.839172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66d7e0790d241108c6e0dbf8c6b48a1)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:04.841326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:04.844231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba83025-8403-442c-800b-d8435faca9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:04.844849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba83025-8403-442c-800b-d8435faca9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:04.845312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba83025-8403-442c-800b-d8435faca9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:04.845759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba83025-8403-442c-800b-d8435faca9d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:04.846437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba83025-8403-442c-800b-d8435faca9d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:04.849010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba83025-8403-442c-800b-d8435faca9d3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:04.968438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1070/2135] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:42:04 2022] POST /identity/v3/users => generated 287 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:42:04.972894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba83025-8403-442c-800b-d8435faca9d3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:04.983745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba83025-8403-442c-800b-d8435faca9d3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:04.990328 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f7eb-d816-4ad6-817d-3a8372a7b787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:04.996507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f7eb-d816-4ad6-817d-3a8372a7b787 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:04.996507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f7eb-d816-4ad6-817d-3a8372a7b787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:04.996507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f7eb-d816-4ad6-817d-3a8372a7b787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:04.996507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615f7eb-d816-4ad6-817d-3a8372a7b787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:04.996507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615f7eb-d816-4ad6-817d-3a8372a7b787 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:05.022542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1071/2136] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:42:05.026609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f7eb-d816-4ad6-817d-3a8372a7b787 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:05.052409 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f7eb-d816-4ad6-817d-3a8372a7b787 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:05.054805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66d7e0790d241108c6e0dbf8c6b48a1', 'request_id': 'req-92e67e9a-8b04-440e-98b3-6f3a87e363d1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:05.068600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66d7e0790d241108c6e0dbf8c6b48a1', 'request_id': 'req-92e67e9a-8b04-440e-98b3-6f3a87e363d1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:05.142437 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66d7e0790d241108c6e0dbf8c6b48a1', 'request_id': 'req-92e67e9a-8b04-440e-98b3-6f3a87e363d1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:05.163736 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] The token cache is being invalidate because project b66d7e0790d241108c6e0dbf8c6b48a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:42:05.164112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:05.181265 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:05.181265 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1066/2137] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:42:04 2022] DELETE /identity/v3/projects/b66d7e0790d241108c6e0dbf8c6b48a1 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:05.181419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31dbb7-4f50-44da-a8ec-3851df302b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:05.181511 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:05.181608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31dbb7-4f50-44da-a8ec-3851df302b95 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:05.181608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31dbb7-4f50-44da-a8ec-3851df302b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:05.181608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31dbb7-4f50-44da-a8ec-3851df302b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:05.181608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31dbb7-4f50-44da-a8ec-3851df302b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:05.183573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:05.183728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31dbb7-4f50-44da-a8ec-3851df302b95 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:05.214826 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e67e9a-8b04-440e-98b3-6f3a87e363d1 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:05.220956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f81e2-a2de-4378-8a42-a6fb07f5f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:05.222238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f81e2-a2de-4378-8a42-a6fb07f5f50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:05.222749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f81e2-a2de-4378-8a42-a6fb07f5f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:05.223223 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f81e2-a2de-4378-8a42-a6fb07f5f50a admin admin] PATH_INFO: `/v3/users/657dbb50bff1404c8e768296f1ec051c` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:05.224705 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f81e2-a2de-4378-8a42-a6fb07f5f50a admin admin] RBAC: Authorizing `identity:delete_user(user_id=657dbb50bff1404c8e768296f1ec051c)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:05.225217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1072/2138] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:42:05.227433 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f81e2-a2de-4378-8a42-a6fb07f5f50a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:05.229430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31dbb7-4f50-44da-a8ec-3851df302b95 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:05.235244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ac31dbb7-4f50-44da-a8ec-3851df302b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:05.254229 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31dbb7-4f50-44da-a8ec-3851df302b95 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:05.264019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2ad83-4d59-422c-9135-6857ea6c9ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:05.264826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2ad83-4d59-422c-9135-6857ea6c9ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:05.265147 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2ad83-4d59-422c-9135-6857ea6c9ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:05.265598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2ad83-4d59-422c-9135-6857ea6c9ab5 admin admin] PATH_INFO: `/v3/projects/87be0e1a7fb2433b91c2173c224fa601/users/3de3aa8d48c14603b011dad12111e705/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:05.291194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2ad83-4d59-422c-9135-6857ea6c9ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87be0e1a7fb2433b91c2173c224fa601, user_id=3de3aa8d48c14603b011dad12111e705, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:05.294569 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2ad83-4d59-422c-9135-6857ea6c9ab5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:05.396318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1073/2139] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:42:05 2022] PUT /identity/v3/projects/87be0e1a7fb2433b91c2173c224fa601/users/3de3aa8d48c14603b011dad12111e705/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:05.406621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabf11b-f4fd-4711-8521-67f67388753c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:05.407081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabf11b-f4fd-4711-8521-67f67388753c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:05.407364 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabf11b-f4fd-4711-8521-67f67388753c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:05.442074 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8dabf11b-f4fd-4711-8521-67f67388753c None None] MFA Rules not processed for user `3de3aa8d48c14603b011dad12111e705`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:05.443856 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8dabf11b-f4fd-4711-8521-67f67388753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:05.507119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ec8f81e2-a2de-4378-8a42-a6fb07f5f50a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '657dbb50bff1404c8e768296f1ec051c'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:05.527868 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1074/2140] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:42:05.540241 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabf11b-f4fd-4711-8521-67f67388753c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:05.541947 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8dabf11b-f4fd-4711-8521-67f67388753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:05.591209 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ec8f81e2-a2de-4378-8a42-a6fb07f5f50a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '657dbb50bff1404c8e768296f1ec051c'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:05.592819 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ec8f81e2-a2de-4378-8a42-a6fb07f5f50a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '657dbb50bff1404c8e768296f1ec051c'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:05.604039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ec8f81e2-a2de-4378-8a42-a6fb07f5f50a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '657dbb50bff1404c8e768296f1ec051c'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:05.627120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ec8f81e2-a2de-4378-8a42-a6fb07f5f50a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '657dbb50bff1404c8e768296f1ec051c'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:05.627226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabf11b-f4fd-4711-8521-67f67388753c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:05.628131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1067/2141] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:42:05 2022] DELETE /identity/v3/users/657dbb50bff1404c8e768296f1ec051c => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:05.638515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c2c78-b358-43ab-a341-89758c87c0f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:05.639235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c2c78-b358-43ab-a341-89758c87c0f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:05.639581 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c2c78-b358-43ab-a341-89758c87c0f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:05.639917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c2c78-b358-43ab-a341-89758c87c0f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:05.641835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9f6c2c78-b358-43ab-a341-89758c87c0f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:05.662293 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c2c78-b358-43ab-a341-89758c87c0f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:05.663895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c2c78-b358-43ab-a341-89758c87c0f3 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:05.683674 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1075/2142] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:42:06.025211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:06.203350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f81e2-a2de-4378-8a42-a6fb07f5f50a admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:06.205145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ec8f81e2-a2de-4378-8a42-a6fb07f5f50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:06.288427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f81e2-a2de-4378-8a42-a6fb07f5f50a admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:06.293682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:06.294332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:06.294608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:06.294881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37 admin admin] PATH_INFO: `/v3/projects/352d40b2e8eb46fbaf807f120f8c6e24` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:06.296027 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=352d40b2e8eb46fbaf807f120f8c6e24)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:06.297984 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:06.483779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352d40b2e8eb46fbaf807f120f8c6e24', 'request_id': 'req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:06.496834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352d40b2e8eb46fbaf807f120f8c6e24', 'request_id': 'req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:06.593386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352d40b2e8eb46fbaf807f120f8c6e24', 'request_id': 'req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:06.605655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37 admin admin] The token cache is being invalidate because project 352d40b2e8eb46fbaf807f120f8c6e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:42:06.606415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:06.606922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ccc779fa-6dfe-470d-a76a-49bc4e5d5c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:06.608755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1068/2143] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:42:06 2022] DELETE /identity/v3/projects/352d40b2e8eb46fbaf807f120f8c6e24 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:42:06.614132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d563f56-d3e8-41b9-ae67-31805da31d45 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:06.614470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d563f56-d3e8-41b9-ae67-31805da31d45 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:06.614703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d563f56-d3e8-41b9-ae67-31805da31d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:06.637474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7d563f56-d3e8-41b9-ae67-31805da31d45 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:06.639029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7d563f56-d3e8-41b9-ae67-31805da31d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:06.708065 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1076/2144] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:06.716974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c4af9-c0d9-4249-8839-1934df1d0e6b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:06.717283 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c4af9-c0d9-4249-8839-1934df1d0e6b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:06.717554 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c4af9-c0d9-4249-8839-1934df1d0e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:06.739112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-0e5c4af9-c0d9-4249-8839-1934df1d0e6b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:06.740355 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-0e5c4af9-c0d9-4249-8839-1934df1d0e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:06.748327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1069/2145] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:06.753477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d563f56-d3e8-41b9-ae67-31805da31d45 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:06.763499 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d563f56-d3e8-41b9-ae67-31805da31d45 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:06.769030 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e93e5c-ddb1-4195-b581-56afef7404bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:06.769689 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e93e5c-ddb1-4195-b581-56afef7404bb admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:06.770005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e93e5c-ddb1-4195-b581-56afef7404bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:06.770275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e93e5c-ddb1-4195-b581-56afef7404bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:06.770926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e93e5c-ddb1-4195-b581-56afef7404bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:42:06.771255 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e93e5c-ddb1-4195-b581-56afef7404bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:06.772883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e93e5c-ddb1-4195-b581-56afef7404bb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:06.787294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1077/2146] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:42:06.791710 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c4af9-c0d9-4249-8839-1934df1d0e6b None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:06.801961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c4af9-c0d9-4249-8839-1934df1d0e6b None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:06.807059 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb713d-73c2-4c52-94ec-5a6e86e6bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:06.807663 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb713d-73c2-4c52-94ec-5a6e86e6bc31 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:06.807939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb713d-73c2-4c52-94ec-5a6e86e6bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:06.808206 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb713d-73c2-4c52-94ec-5a6e86e6bc31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:06.808843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb713d-73c2-4c52-94ec-5a6e86e6bc31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:06.810855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb713d-73c2-4c52-94ec-5a6e86e6bc31 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:06.815935 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:06.924039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1070/2147] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:42:06 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:42:06.929447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e93e5c-ddb1-4195-b581-56afef7404bb admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:06.943219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e93e5c-ddb1-4195-b581-56afef7404bb admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:07.001864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612560f-4259-4b0a-90e1-8d6e72d18258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:07.003173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612560f-4259-4b0a-90e1-8d6e72d18258 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:07.003446 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612560f-4259-4b0a-90e1-8d6e72d18258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:07.003718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612560f-4259-4b0a-90e1-8d6e72d18258 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:07.005212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612560f-4259-4b0a-90e1-8d6e72d18258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:07.006423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612560f-4259-4b0a-90e1-8d6e72d18258 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:07.110161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1078/2148] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:42:06 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:42:07.116207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb713d-73c2-4c52-94ec-5a6e86e6bc31 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:07.129537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb713d-73c2-4c52-94ec-5a6e86e6bc31 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:07.137675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2c607-205d-47cf-b923-aee3b3866c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:07.138346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2c607-205d-47cf-b923-aee3b3866c3d admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:07.138633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2c607-205d-47cf-b923-aee3b3866c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:07.142051 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2c607-205d-47cf-b923-aee3b3866c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:07.142051 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2c607-205d-47cf-b923-aee3b3866c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:07.142051 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2c607-205d-47cf-b923-aee3b3866c3d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:07.152792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1071/2149] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:42:07.156826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612560f-4259-4b0a-90e1-8d6e72d18258 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:07.182716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612560f-4259-4b0a-90e1-8d6e72d18258 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:07.191081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed365335-6465-4a3e-a4ef-56d4e14a4d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:07.191696 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed365335-6465-4a3e-a4ef-56d4e14a4d17 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:07.191974 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed365335-6465-4a3e-a4ef-56d4e14a4d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:07.192246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed365335-6465-4a3e-a4ef-56d4e14a4d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:07.192895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed365335-6465-4a3e-a4ef-56d4e14a4d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:07.194588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed365335-6465-4a3e-a4ef-56d4e14a4d17 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:07.207100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1079/2150] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:42:07.211589 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2c607-205d-47cf-b923-aee3b3866c3d admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:07.223042 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2c607-205d-47cf-b923-aee3b3866c3d admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:07.227942 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454d373-e6de-4304-863e-2d17b2e94846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:07.228665 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454d373-e6de-4304-863e-2d17b2e94846 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:07.228963 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454d373-e6de-4304-863e-2d17b2e94846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:07.229248 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454d373-e6de-4304-863e-2d17b2e94846 admin admin] PATH_INFO: `/v3/projects/9cbf398d9d6f4b349fae623115238bf6/users/c01e7e9c66a8429e840703d3c36f8c58/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:07.244579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454d373-e6de-4304-863e-2d17b2e94846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbf398d9d6f4b349fae623115238bf6, user_id=c01e7e9c66a8429e840703d3c36f8c58, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:07.247312 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454d373-e6de-4304-863e-2d17b2e94846 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:07.370172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1072/2151] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:42:07 2022] PUT /identity/v3/projects/9cbf398d9d6f4b349fae623115238bf6/users/c01e7e9c66a8429e840703d3c36f8c58/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:07.380663 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb751041-a898-4403-b631-8be59bedf7fe None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:07.381066 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb751041-a898-4403-b631-8be59bedf7fe None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:07.381396 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb751041-a898-4403-b631-8be59bedf7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:07.408577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-fb751041-a898-4403-b631-8be59bedf7fe None None] MFA Rules not processed for user `c01e7e9c66a8429e840703d3c36f8c58`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:07.410343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fb751041-a898-4403-b631-8be59bedf7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:07.479198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1080/2152] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:07.752170 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454d373-e6de-4304-863e-2d17b2e94846 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:07.754116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-e454d373-e6de-4304-863e-2d17b2e94846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:07.815623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454d373-e6de-4304-863e-2d17b2e94846 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:07.819345 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ada22-cdb6-4c69-9bec-ff47b201efd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:07.819944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ada22-cdb6-4c69-9bec-ff47b201efd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:07.820220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ada22-cdb6-4c69-9bec-ff47b201efd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:07.820482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ada22-cdb6-4c69-9bec-ff47b201efd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:07.829041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ada22-cdb6-4c69-9bec-ff47b201efd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:07.831008 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ada22-cdb6-4c69-9bec-ff47b201efd9 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:07.840281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1073/2153] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:42:07.866933 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb751041-a898-4403-b631-8be59bedf7fe None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:07.942307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb751041-a898-4403-b631-8be59bedf7fe None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:07.951359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9294d-8a96-4135-9133-de7e973e7228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:07.952270 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9294d-8a96-4135-9133-de7e973e7228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:07.952657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9294d-8a96-4135-9133-de7e973e7228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:07.952965 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9294d-8a96-4135-9133-de7e973e7228 admin admin] PATH_INFO: `/v3/users/c01e7e9c66a8429e840703d3c36f8c58` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:07.954428 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9294d-8a96-4135-9133-de7e973e7228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01e7e9c66a8429e840703d3c36f8c58)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:07.956763 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9294d-8a96-4135-9133-de7e973e7228 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:08.165933 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ada22-cdb6-4c69-9bec-ff47b201efd9 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:08.167443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-592ada22-cdb6-4c69-9bec-ff47b201efd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:08.183382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ada22-cdb6-4c69-9bec-ff47b201efd9 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:08.188915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef19e9-b349-46c1-9f99-785c1665bce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:08.189569 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef19e9-b349-46c1-9f99-785c1665bce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:08.189982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef19e9-b349-46c1-9f99-785c1665bce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:08.190151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef19e9-b349-46c1-9f99-785c1665bce0 admin admin] PATH_INFO: `/v3/users/dab19bfad32d4581a9752146f9b67a7f` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:08.194450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef19e9-b349-46c1-9f99-785c1665bce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab19bfad32d4581a9752146f9b67a7f)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:08.195305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef19e9-b349-46c1-9f99-785c1665bce0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:08.267154 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:08.270440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6ba9294d-8a96-4135-9133-de7e973e7228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01e7e9c66a8429e840703d3c36f8c58'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:08.278726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6ba9294d-8a96-4135-9133-de7e973e7228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01e7e9c66a8429e840703d3c36f8c58'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:08.294583 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6ba9294d-8a96-4135-9133-de7e973e7228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01e7e9c66a8429e840703d3c36f8c58'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:08.423798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6ba9294d-8a96-4135-9133-de7e973e7228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01e7e9c66a8429e840703d3c36f8c58'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:08.424941 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6ba9294d-8a96-4135-9133-de7e973e7228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01e7e9c66a8429e840703d3c36f8c58'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:08.433933 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1081/2154] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:42:07 2022] DELETE /identity/v3/users/c01e7e9c66a8429e840703d3c36f8c58 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:08.437753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77face-42ba-4b4f-88e6-c4608ce41d76 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:08.438039 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77face-42ba-4b4f-88e6-c4608ce41d76 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:08.438310 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77face-42ba-4b4f-88e6-c4608ce41d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:08.461623 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7f77face-42ba-4b4f-88e6-c4608ce41d76 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:08.463501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7f77face-42ba-4b4f-88e6-c4608ce41d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:08.485238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4cef19e9-b349-46c1-9f99-785c1665bce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab19bfad32d4581a9752146f9b67a7f'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:08.551608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1082/2155] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:42:08.563290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77face-42ba-4b4f-88e6-c4608ce41d76 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:08.564740 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7f77face-42ba-4b4f-88e6-c4608ce41d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:08.589629 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4cef19e9-b349-46c1-9f99-785c1665bce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab19bfad32d4581a9752146f9b67a7f'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:08.590701 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4cef19e9-b349-46c1-9f99-785c1665bce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab19bfad32d4581a9752146f9b67a7f'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:08.601889 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4cef19e9-b349-46c1-9f99-785c1665bce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab19bfad32d4581a9752146f9b67a7f'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:08.633148 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4cef19e9-b349-46c1-9f99-785c1665bce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab19bfad32d4581a9752146f9b67a7f'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:08.634218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77face-42ba-4b4f-88e6-c4608ce41d76 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:08.639818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cb992-690d-4689-95ac-da1d3fb5d44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:08.640960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb992-690d-4689-95ac-da1d3fb5d44a service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:08.641352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb992-690d-4689-95ac-da1d3fb5d44a service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:08.641691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb992-690d-4689-95ac-da1d3fb5d44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:08.644749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-025cb992-690d-4689-95ac-da1d3fb5d44a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:08.647111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1074/2156] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:42:08 2022] DELETE /identity/v3/users/dab19bfad32d4581a9752146f9b67a7f => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:08.652463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78265969-744c-4bcf-802d-671d784fd7de None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:08.654707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78265969-744c-4bcf-802d-671d784fd7de None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:08.655138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78265969-744c-4bcf-802d-671d784fd7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:08.663908 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cb992-690d-4689-95ac-da1d3fb5d44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:08.666978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cb992-690d-4689-95ac-da1d3fb5d44a service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:08.679113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1083/2157] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:42:08.683239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-78265969-744c-4bcf-802d-671d784fd7de None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:08.684618 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-78265969-744c-4bcf-802d-671d784fd7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:08.747643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1075/2158] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:08.760960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cb992-690d-4689-95ac-da1d3fb5d44a service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:08.763141 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-025cb992-690d-4689-95ac-da1d3fb5d44a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:08.777174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cb992-690d-4689-95ac-da1d3fb5d44a service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:08.829860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aef3ac-bed4-455d-ac13-49ef7198a81b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:08.831186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aef3ac-bed4-455d-ac13-49ef7198a81b service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:08.831583 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aef3ac-bed4-455d-ac13-49ef7198a81b service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:08.831983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aef3ac-bed4-455d-ac13-49ef7198a81b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:08.842910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aef3ac-bed4-455d-ac13-49ef7198a81b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:08.844360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aef3ac-bed4-455d-ac13-49ef7198a81b service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:08.857190 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1084/2159] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:42:09.361980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78265969-744c-4bcf-802d-671d784fd7de None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:09.363725 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-78265969-744c-4bcf-802d-671d784fd7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:09.376908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78265969-744c-4bcf-802d-671d784fd7de None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:09.385392 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdf49d-486d-427e-92f4-e47f61c4f29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:09.385865 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdf49d-486d-427e-92f4-e47f61c4f29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:09.386156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdf49d-486d-427e-92f4-e47f61c4f29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:09.386435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdf49d-486d-427e-92f4-e47f61c4f29f admin admin] PATH_INFO: `/v3/projects/9cbf398d9d6f4b349fae623115238bf6` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:09.388659 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdf49d-486d-427e-92f4-e47f61c4f29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cbf398d9d6f4b349fae623115238bf6)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:09.391141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdf49d-486d-427e-92f4-e47f61c4f29f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:09.417167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aef3ac-bed4-455d-ac13-49ef7198a81b service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:09.418922 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c1aef3ac-bed4-455d-ac13-49ef7198a81b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:09.436004 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:09.451855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aef3ac-bed4-455d-ac13-49ef7198a81b service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:09.466165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:09.466894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:09.467501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:09.467501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] PATH_INFO: `/v3/projects/ac2624a1c504413d91def3017e332c2a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:09.469188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2624a1c504413d91def3017e332c2a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:09.474642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:09.686134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-39cdf49d-486d-427e-92f4-e47f61c4f29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cbf398d9d6f4b349fae623115238bf6', 'request_id': 'req-39cdf49d-486d-427e-92f4-e47f61c4f29f'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:09.690575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2624a1c504413d91def3017e332c2a', 'request_id': 'req-c06ffc4b-d6c1-4ec5-b152-dee96222d041'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:09.698036 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2624a1c504413d91def3017e332c2a', 'request_id': 'req-c06ffc4b-d6c1-4ec5-b152-dee96222d041'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:09.698674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-39cdf49d-486d-427e-92f4-e47f61c4f29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cbf398d9d6f4b349fae623115238bf6', 'request_id': 'req-39cdf49d-486d-427e-92f4-e47f61c4f29f'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:09.704262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2624a1c504413d91def3017e332c2a', 'request_id': 'req-c06ffc4b-d6c1-4ec5-b152-dee96222d041'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:09.821425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-39cdf49d-486d-427e-92f4-e47f61c4f29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cbf398d9d6f4b349fae623115238bf6', 'request_id': 'req-39cdf49d-486d-427e-92f4-e47f61c4f29f'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:09.822501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:09.833061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-39cdf49d-486d-427e-92f4-e47f61c4f29f admin admin] The token cache is being invalidate because project 9cbf398d9d6f4b349fae623115238bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:42:09.833292 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-39cdf49d-486d-427e-92f4-e47f61c4f29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:09.833927 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-39cdf49d-486d-427e-92f4-e47f61c4f29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:09.835399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1076/2160] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:42:09 2022] DELETE /identity/v3/projects/9cbf398d9d6f4b349fae623115238bf6 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:09.840074 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c94ae-b7e1-40cb-8300-7cfd25c38c52 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:09.840353 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c94ae-b7e1-40cb-8300-7cfd25c38c52 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:09.840619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c94ae-b7e1-40cb-8300-7cfd25c38c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:09.859927 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-481c94ae-b7e1-40cb-8300-7cfd25c38c52 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:09.861189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-481c94ae-b7e1-40cb-8300-7cfd25c38c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:09.917711 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] The token cache is being invalidate because project ac2624a1c504413d91def3017e332c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:42:09.918214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:09.918971 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:09.920836 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1085/2161] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:42:09 2022] DELETE /identity/v3/projects/ac2624a1c504413d91def3017e332c2a => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:42:09.925397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:09.927192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:09.937061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1077/2162] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:42:09.942050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacd564-05a7-4b11-a584-0c29cfc9b78d None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:09.946587 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacd564-05a7-4b11-a584-0c29cfc9b78d None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:09.946587 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacd564-05a7-4b11-a584-0c29cfc9b78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:09.968131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-efacd564-05a7-4b11-a584-0c29cfc9b78d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:09.969481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-efacd564-05a7-4b11-a584-0c29cfc9b78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:09.978681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1078/2163] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:09.983361 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacd564-05a7-4b11-a584-0c29cfc9b78d None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:09.994163 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacd564-05a7-4b11-a584-0c29cfc9b78d None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:10.007870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2569e47-0b58-4cc8-aa66-3ec572585010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:10.008765 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2569e47-0b58-4cc8-aa66-3ec572585010 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:10.009092 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2569e47-0b58-4cc8-aa66-3ec572585010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:10.009385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2569e47-0b58-4cc8-aa66-3ec572585010 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:10.010105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2569e47-0b58-4cc8-aa66-3ec572585010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:42:10.010563 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2569e47-0b58-4cc8-aa66-3ec572585010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:10.012170 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2569e47-0b58-4cc8-aa66-3ec572585010 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:10.027918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1079/2164] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:42:10.034896 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2569e47-0b58-4cc8-aa66-3ec572585010 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:10.038156 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ffc4b-d6c1-4ec5-b152-dee96222d041 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:10.050223 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2569e47-0b58-4cc8-aa66-3ec572585010 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:10.050584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e432cd5-6cd5-4c09-8237-8bdc2fbfb6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:10.051239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e432cd5-6cd5-4c09-8237-8bdc2fbfb6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:10.051565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e432cd5-6cd5-4c09-8237-8bdc2fbfb6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:10.052089 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e432cd5-6cd5-4c09-8237-8bdc2fbfb6cb admin admin] PATH_INFO: `/v3/users/cc79ced69a93440d921142c39120fcf0` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:10.055198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e432cd5-6cd5-4c09-8237-8bdc2fbfb6cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc79ced69a93440d921142c39120fcf0)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:10.057209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e432cd5-6cd5-4c09-8237-8bdc2fbfb6cb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:10.060224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0589e-faaa-4adb-b462-3fb2c506ffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:10.061055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0589e-faaa-4adb-b462-3fb2c506ffd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:10.061452 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0589e-faaa-4adb-b462-3fb2c506ffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:10.061883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0589e-faaa-4adb-b462-3fb2c506ffd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:10.062792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0589e-faaa-4adb-b462-3fb2c506ffd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:10.066019 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0589e-faaa-4adb-b462-3fb2c506ffd9 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:10.192839 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1080/2165] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:42:10 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:42:10.197235 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0589e-faaa-4adb-b462-3fb2c506ffd9 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:10.270118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0589e-faaa-4adb-b462-3fb2c506ffd9 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:10.285833 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0d88-895d-4ca3-b361-a18b64402cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:10.286502 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0d88-895d-4ca3-b361-a18b64402cbf admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:10.286787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0d88-895d-4ca3-b361-a18b64402cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:10.287116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0d88-895d-4ca3-b361-a18b64402cbf admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:10.287811 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba0d88-895d-4ca3-b361-a18b64402cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:10.289846 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba0d88-895d-4ca3-b361-a18b64402cbf admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:10.308738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4e432cd5-6cd5-4c09-8237-8bdc2fbfb6cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc79ced69a93440d921142c39120fcf0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:10.318871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4e432cd5-6cd5-4c09-8237-8bdc2fbfb6cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc79ced69a93440d921142c39120fcf0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:10.336774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4e432cd5-6cd5-4c09-8237-8bdc2fbfb6cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc79ced69a93440d921142c39120fcf0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:10.434664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4e432cd5-6cd5-4c09-8237-8bdc2fbfb6cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc79ced69a93440d921142c39120fcf0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:10.440880 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4e432cd5-6cd5-4c09-8237-8bdc2fbfb6cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc79ced69a93440d921142c39120fcf0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:10.441636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1081/2166] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:42:10 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:42:10.444005 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0d88-895d-4ca3-b361-a18b64402cbf admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:10.447624 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-e5ba0d88-895d-4ca3-b361-a18b64402cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:10.466151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0d88-895d-4ca3-b361-a18b64402cbf admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:10.467387 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e02b51-ec4e-4f60-9b78-95aaa9ba20dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:10.468169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e02b51-ec4e-4f60-9b78-95aaa9ba20dc admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:10.468578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e02b51-ec4e-4f60-9b78-95aaa9ba20dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:10.468897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e02b51-ec4e-4f60-9b78-95aaa9ba20dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:10.469666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e02b51-ec4e-4f60-9b78-95aaa9ba20dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:10.470539 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1086/2167] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:42:09 2022] DELETE /identity/v3/users/cc79ced69a93440d921142c39120fcf0 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:10.481165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e02b51-ec4e-4f60-9b78-95aaa9ba20dc admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:10.493257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1082/2168] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:42:10.497396 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e432cd5-6cd5-4c09-8237-8bdc2fbfb6cb admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:10.552615 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:10.621381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e432cd5-6cd5-4c09-8237-8bdc2fbfb6cb admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:10.630931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769299bf-11c8-411d-aacd-7aa10ace63af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:10.631605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769299bf-11c8-411d-aacd-7aa10ace63af admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:10.631906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769299bf-11c8-411d-aacd-7aa10ace63af admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:10.632287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769299bf-11c8-411d-aacd-7aa10ace63af admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:10.633102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769299bf-11c8-411d-aacd-7aa10ace63af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:10.634760 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769299bf-11c8-411d-aacd-7aa10ace63af admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:10.652905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1087/2169] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:42:10.653188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e02b51-ec4e-4f60-9b78-95aaa9ba20dc admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:10.666782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e02b51-ec4e-4f60-9b78-95aaa9ba20dc admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:10.672103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121b9fe-bba4-4ed9-be80-6e482907a50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:10.672859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b9fe-bba4-4ed9-be80-6e482907a50d admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:10.673141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b9fe-bba4-4ed9-be80-6e482907a50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:10.673418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b9fe-bba4-4ed9-be80-6e482907a50d admin admin] PATH_INFO: `/v3/projects/9e556cd723334a48a2835ca8c1aa21fd/users/30cafaae85254794b39d8b2bac9d0371/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:10.692944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121b9fe-bba4-4ed9-be80-6e482907a50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e556cd723334a48a2835ca8c1aa21fd, user_id=30cafaae85254794b39d8b2bac9d0371, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:10.696083 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121b9fe-bba4-4ed9-be80-6e482907a50d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:10.756452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769299bf-11c8-411d-aacd-7aa10ace63af admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:10.758885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-769299bf-11c8-411d-aacd-7aa10ace63af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:10.788669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1083/2170] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:42:10 2022] PUT /identity/v3/projects/9e556cd723334a48a2835ca8c1aa21fd/users/30cafaae85254794b39d8b2bac9d0371/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:42:10.790714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90121-9e92-429a-a80b-40ac1af31764 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:10.791135 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90121-9e92-429a-a80b-40ac1af31764 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:10.791436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90121-9e92-429a-a80b-40ac1af31764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:10.799320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769299bf-11c8-411d-aacd-7aa10ace63af admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:10.825104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-edd90121-9e92-429a-a80b-40ac1af31764 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:10.825104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-edd90121-9e92-429a-a80b-40ac1af31764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:10.833696 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:10.890114 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d8cf4-3b9b-4809-8f03-ac96d3d69ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:10.891212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d8cf4-3b9b-4809-8f03-ac96d3d69ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:10.891648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d8cf4-3b9b-4809-8f03-ac96d3d69ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:10.892039 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d8cf4-3b9b-4809-8f03-ac96d3d69ac7 admin admin] PATH_INFO: `/v3/users/3de3aa8d48c14603b011dad12111e705` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:10.894203 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d8cf4-3b9b-4809-8f03-ac96d3d69ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de3aa8d48c14603b011dad12111e705)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:10.898855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d8cf4-3b9b-4809-8f03-ac96d3d69ac7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:10.966664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1084/2171] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:42:10.976316 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd90121-9e92-429a-a80b-40ac1af31764 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:10.978062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-edd90121-9e92-429a-a80b-40ac1af31764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:11.077493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd90121-9e92-429a-a80b-40ac1af31764 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:11.083515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73683ed8-3c3f-4171-ba69-ada9a775a311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:11.084133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73683ed8-3c3f-4171-ba69-ada9a775a311 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:11.084409 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73683ed8-3c3f-4171-ba69-ada9a775a311 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:11.084682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73683ed8-3c3f-4171-ba69-ada9a775a311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:11.101784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73683ed8-3c3f-4171-ba69-ada9a775a311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:11.103425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73683ed8-3c3f-4171-ba69-ada9a775a311 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:11.114847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1085/2172] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:42:11.115581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73683ed8-3c3f-4171-ba69-ada9a775a311 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:11.116955 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-73683ed8-3c3f-4171-ba69-ada9a775a311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:11.131749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73683ed8-3c3f-4171-ba69-ada9a775a311 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:11.137087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:11.137726 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:11.138003 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:11.138275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] PATH_INFO: `/v3/projects/efa4e46347b641749a93ad38dcb52e72` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:11.139973 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa4e46347b641749a93ad38dcb52e72)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:11.141963 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:11.184804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-295d8cf4-3b9b-4809-8f03-ac96d3d69ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de3aa8d48c14603b011dad12111e705'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.192576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-295d8cf4-3b9b-4809-8f03-ac96d3d69ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de3aa8d48c14603b011dad12111e705'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.205563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-295d8cf4-3b9b-4809-8f03-ac96d3d69ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de3aa8d48c14603b011dad12111e705'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.282913 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa4e46347b641749a93ad38dcb52e72', 'request_id': 'req-6cdb0655-db0f-47d1-a155-fcda44a8ef84'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.291037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa4e46347b641749a93ad38dcb52e72', 'request_id': 'req-6cdb0655-db0f-47d1-a155-fcda44a8ef84'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.304175 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-295d8cf4-3b9b-4809-8f03-ac96d3d69ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de3aa8d48c14603b011dad12111e705'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.304922 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-295d8cf4-3b9b-4809-8f03-ac96d3d69ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de3aa8d48c14603b011dad12111e705'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.313113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1088/2173] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:42:10 2022] DELETE /identity/v3/users/3de3aa8d48c14603b011dad12111e705 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:11.317395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f12f5-9913-437d-8e72-f4cbcc1426a4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:11.317686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f12f5-9913-437d-8e72-f4cbcc1426a4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:11.318073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f12f5-9913-437d-8e72-f4cbcc1426a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:11.341858 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-214f12f5-9913-437d-8e72-f4cbcc1426a4 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:11.342691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-214f12f5-9913-437d-8e72-f4cbcc1426a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:11.386187 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa4e46347b641749a93ad38dcb52e72', 'request_id': 'req-6cdb0655-db0f-47d1-a155-fcda44a8ef84'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.402682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] The token cache is being invalidate because project efa4e46347b641749a93ad38dcb52e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:42:11.402892 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.403566 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.405302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1086/2174] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:42:11 2022] DELETE /identity/v3/projects/efa4e46347b641749a93ad38dcb52e72 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:11.409857 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:11.411738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:11.433214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1089/2175] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:11.448534 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f12f5-9913-437d-8e72-f4cbcc1426a4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:11.451328 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-214f12f5-9913-437d-8e72-f4cbcc1426a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:11.561175 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb0655-db0f-47d1-a155-fcda44a8ef84 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:11.567634 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f12f5-9913-437d-8e72-f4cbcc1426a4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:11.568275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca14709-e573-41ba-bef6-75da6ca09f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:11.568923 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14709-e573-41ba-bef6-75da6ca09f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:11.569240 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14709-e573-41ba-bef6-75da6ca09f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:11.569520 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14709-e573-41ba-bef6-75da6ca09f65 admin admin] PATH_INFO: `/v3/users/f995ad791f374ecd930b7ae0cbdd4ca3` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:11.570778 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca14709-e573-41ba-bef6-75da6ca09f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f995ad791f374ecd930b7ae0cbdd4ca3)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:11.572754 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca14709-e573-41ba-bef6-75da6ca09f65 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:11.577935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde975dc-aa3e-4ad5-af86-518d8f37191c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:11.578560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde975dc-aa3e-4ad5-af86-518d8f37191c service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:11.578839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde975dc-aa3e-4ad5-af86-518d8f37191c service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:11.579110 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde975dc-aa3e-4ad5-af86-518d8f37191c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:11.612583 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde975dc-aa3e-4ad5-af86-518d8f37191c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:11.615473 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde975dc-aa3e-4ad5-af86-518d8f37191c service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:11.640920 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1090/2176] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:42:11.835674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-eca14709-e573-41ba-bef6-75da6ca09f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f995ad791f374ecd930b7ae0cbdd4ca3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.929810 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-eca14709-e573-41ba-bef6-75da6ca09f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f995ad791f374ecd930b7ae0cbdd4ca3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.931382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:11.932002 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-eca14709-e573-41ba-bef6-75da6ca09f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f995ad791f374ecd930b7ae0cbdd4ca3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.940516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-eca14709-e573-41ba-bef6-75da6ca09f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f995ad791f374ecd930b7ae0cbdd4ca3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.955134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-eca14709-e573-41ba-bef6-75da6ca09f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f995ad791f374ecd930b7ae0cbdd4ca3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:11.963013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1087/2177] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:42:11 2022] DELETE /identity/v3/users/f995ad791f374ecd930b7ae0cbdd4ca3 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:12.293627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:12.635693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde975dc-aa3e-4ad5-af86-518d8f37191c service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:12.639739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca14709-e573-41ba-bef6-75da6ca09f65 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:12.644737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-eca14709-e573-41ba-bef6-75da6ca09f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:12.662500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde975dc-aa3e-4ad5-af86-518d8f37191c service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:12.734328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca14709-e573-41ba-bef6-75da6ca09f65 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:12.740515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c96da-ab70-430e-b2c4-aaae54e57c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:12.741614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c96da-ab70-430e-b2c4-aaae54e57c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:12.742066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c96da-ab70-430e-b2c4-aaae54e57c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:12.742606 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c96da-ab70-430e-b2c4-aaae54e57c5b admin admin] PATH_INFO: `/v3/projects/87be0e1a7fb2433b91c2173c224fa601` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:12.744171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c96da-ab70-430e-b2c4-aaae54e57c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=87be0e1a7fb2433b91c2173c224fa601)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:12.745506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:12.746426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:12.746814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:12.747023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c96da-ab70-430e-b2c4-aaae54e57c5b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:12.747551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5 admin admin] PATH_INFO: `/v3/projects/6c6183d6daea4080b926c6ba3716eb37` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:12.749466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6183d6daea4080b926c6ba3716eb37)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:12.759229 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:12.896531 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-673c96da-ab70-430e-b2c4-aaae54e57c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87be0e1a7fb2433b91c2173c224fa601', 'request_id': 'req-673c96da-ab70-430e-b2c4-aaae54e57c5b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:12.903947 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-673c96da-ab70-430e-b2c4-aaae54e57c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87be0e1a7fb2433b91c2173c224fa601', 'request_id': 'req-673c96da-ab70-430e-b2c4-aaae54e57c5b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:12.904248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6183d6daea4080b926c6ba3716eb37', 'request_id': 'req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:12.911849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6183d6daea4080b926c6ba3716eb37', 'request_id': 'req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:12.917687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6183d6daea4080b926c6ba3716eb37', 'request_id': 'req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:13.006394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-673c96da-ab70-430e-b2c4-aaae54e57c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87be0e1a7fb2433b91c2173c224fa601', 'request_id': 'req-673c96da-ab70-430e-b2c4-aaae54e57c5b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:13.017896 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-673c96da-ab70-430e-b2c4-aaae54e57c5b admin admin] The token cache is being invalidate because project 87be0e1a7fb2433b91c2173c224fa601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:42:13.018178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-673c96da-ab70-430e-b2c4-aaae54e57c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:13.018815 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-673c96da-ab70-430e-b2c4-aaae54e57c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:13.020303 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1088/2178] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:42:12 2022] DELETE /identity/v3/projects/87be0e1a7fb2433b91c2173c224fa601 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:13.021517 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e66af-e022-4d74-9aba-1513db9e8dbc None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.021798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e66af-e022-4d74-9aba-1513db9e8dbc None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.022071 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e66af-e022-4d74-9aba-1513db9e8dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.049680 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2f9e66af-e022-4d74-9aba-1513db9e8dbc None None] MFA Rules not processed for user `30cafaae85254794b39d8b2bac9d0371`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:13.051047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2f9e66af-e022-4d74-9aba-1513db9e8dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:13.067070 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5 admin admin] The token cache is being invalidate because project 6c6183d6daea4080b926c6ba3716eb37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:42:13.067368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:13.068060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-19ebc2c1-cf27-4da8-ba57-32d2a82766e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:13.069626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1091/2179] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:42:12 2022] DELETE /identity/v3/projects/6c6183d6daea4080b926c6ba3716eb37 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:13.070892 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35ed92-a2b2-4fdb-b214-4fe75f3f6bf7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.071176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35ed92-a2b2-4fdb-b214-4fe75f3f6bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.071453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35ed92-a2b2-4fdb-b214-4fe75f3f6bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.091307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bd35ed92-a2b2-4fdb-b214-4fe75f3f6bf7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:13.092535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bd35ed92-a2b2-4fdb-b214-4fe75f3f6bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:13.123040 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1089/2180] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:13.124294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e327a-af41-4744-ab44-37169028f657 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.124575 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e327a-af41-4744-ab44-37169028f657 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.131111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e327a-af41-4744-ab44-37169028f657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.155902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1092/2181] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:13.159638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35ed92-a2b2-4fdb-b214-4fe75f3f6bf7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:13.159638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bd35ed92-a2b2-4fdb-b214-4fe75f3f6bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:13.161841 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2f6e327a-af41-4744-ab44-37169028f657 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:13.163130 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2f6e327a-af41-4744-ab44-37169028f657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:13.171977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1090/2182] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:13.173415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217dcf2-7bc1-4438-a333-5bd1bc34511d None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.173888 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217dcf2-7bc1-4438-a333-5bd1bc34511d None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.174991 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217dcf2-7bc1-4438-a333-5bd1bc34511d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.179008 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:13.200057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-d217dcf2-7bc1-4438-a333-5bd1bc34511d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:13.201435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d217dcf2-7bc1-4438-a333-5bd1bc34511d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:13.209769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1091/2183] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:13.211431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ff693-3076-477e-b16e-bf235cdd835b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.211714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ff693-3076-477e-b16e-bf235cdd835b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.211985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ff693-3076-477e-b16e-bf235cdd835b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.235697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-e89ff693-3076-477e-b16e-bf235cdd835b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:13.238625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-e89ff693-3076-477e-b16e-bf235cdd835b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:13.244369 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35ed92-a2b2-4fdb-b214-4fe75f3f6bf7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:13.249352 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1092/2184] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:13.252677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9150d7-5b2c-4c6b-b6f1-b8b087cb3e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:13.252677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9150d7-5b2c-4c6b-b6f1-b8b087cb3e85 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.252872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ff693-3076-477e-b16e-bf235cdd835b None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:13.252945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9150d7-5b2c-4c6b-b6f1-b8b087cb3e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.252945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9150d7-5b2c-4c6b-b6f1-b8b087cb3e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.263864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9150d7-5b2c-4c6b-b6f1-b8b087cb3e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:13.265419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9150d7-5b2c-4c6b-b6f1-b8b087cb3e85 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:13.268786 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ff693-3076-477e-b16e-bf235cdd835b None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:13.272795 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a203c4-210b-4c9a-b27a-9f94786590b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:13.273437 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a203c4-210b-4c9a-b27a-9f94786590b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.274791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a203c4-210b-4c9a-b27a-9f94786590b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.275828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a203c4-210b-4c9a-b27a-9f94786590b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.276629 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a203c4-210b-4c9a-b27a-9f94786590b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:42:13.276939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a203c4-210b-4c9a-b27a-9f94786590b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:13.278567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a203c4-210b-4c9a-b27a-9f94786590b0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:13.280921 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1093/2185] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:42:13.282153 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9150d7-5b2c-4c6b-b6f1-b8b087cb3e85 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:13.296816 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1093/2186] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:42:13.300120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a203c4-210b-4c9a-b27a-9f94786590b0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:13.303033 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9150d7-5b2c-4c6b-b6f1-b8b087cb3e85 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:13.313638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b11972-9582-492c-a888-d66a2c09e333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:13.314391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b11972-9582-492c-a888-d66a2c09e333 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.315307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b11972-9582-492c-a888-d66a2c09e333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.315679 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b11972-9582-492c-a888-d66a2c09e333 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.316620 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b11972-9582-492c-a888-d66a2c09e333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:42:13.317125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b11972-9582-492c-a888-d66a2c09e333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:13.318710 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a203c4-210b-4c9a-b27a-9f94786590b0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:13.320466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b11972-9582-492c-a888-d66a2c09e333 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:13.326177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608cf3-70a0-4487-b933-6a9160672330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:13.326177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608cf3-70a0-4487-b933-6a9160672330 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.326177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608cf3-70a0-4487-b933-6a9160672330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.326703 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608cf3-70a0-4487-b933-6a9160672330 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.327517 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96608cf3-70a0-4487-b933-6a9160672330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:13.329760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96608cf3-70a0-4487-b933-6a9160672330 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:13.338469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1094/2187] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:42:13.343669 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b11972-9582-492c-a888-d66a2c09e333 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:13.356813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b11972-9582-492c-a888-d66a2c09e333 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:13.362394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33170c5-2197-4c5b-a6f3-114bec3c864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:13.363105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33170c5-2197-4c5b-a6f3-114bec3c864a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.363404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33170c5-2197-4c5b-a6f3-114bec3c864a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.363528 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33170c5-2197-4c5b-a6f3-114bec3c864a admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.364151 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33170c5-2197-4c5b-a6f3-114bec3c864a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:13.366303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33170c5-2197-4c5b-a6f3-114bec3c864a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:13.416565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1094/2188] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:42:13 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:42:13.420633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608cf3-70a0-4487-b933-6a9160672330 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:13.483097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608cf3-70a0-4487-b933-6a9160672330 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:13.488040 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbaf63-206c-4af8-9c5f-37abb9aefef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:13.488576 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbaf63-206c-4af8-9c5f-37abb9aefef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.488854 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbaf63-206c-4af8-9c5f-37abb9aefef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.489162 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbaf63-206c-4af8-9c5f-37abb9aefef3 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.489781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbaf63-206c-4af8-9c5f-37abb9aefef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:13.491691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbaf63-206c-4af8-9c5f-37abb9aefef3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:13.508178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1095/2189] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:42:13 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:42:13.512316 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33170c5-2197-4c5b-a6f3-114bec3c864a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:13.577913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33170c5-2197-4c5b-a6f3-114bec3c864a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:13.582693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56245c9-6473-43f7-8fc0-f8c1f56f84a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:13.583296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56245c9-6473-43f7-8fc0-f8c1f56f84a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.583572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56245c9-6473-43f7-8fc0-f8c1f56f84a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.583841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56245c9-6473-43f7-8fc0-f8c1f56f84a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.584466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56245c9-6473-43f7-8fc0-f8c1f56f84a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:13.586416 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56245c9-6473-43f7-8fc0-f8c1f56f84a6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:13.613497 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1095/2190] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:42:13 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:42:13.624093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbaf63-206c-4af8-9c5f-37abb9aefef3 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:13.634767 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbaf63-206c-4af8-9c5f-37abb9aefef3 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:13.639691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f5631-8934-4b80-bd79-85e9de957d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:13.640362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f5631-8934-4b80-bd79-85e9de957d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.640639 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f5631-8934-4b80-bd79-85e9de957d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.640910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f5631-8934-4b80-bd79-85e9de957d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.641797 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f5631-8934-4b80-bd79-85e9de957d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:13.644017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f5631-8934-4b80-bd79-85e9de957d74 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:13.656857 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1096/2191] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:42:13.661468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f5631-8934-4b80-bd79-85e9de957d74 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:13.671288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f5631-8934-4b80-bd79-85e9de957d74 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:13.676829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3da4e-ef43-49a3-bc96-83b22b49a427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:13.677442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3da4e-ef43-49a3-bc96-83b22b49a427 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.677718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3da4e-ef43-49a3-bc96-83b22b49a427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.677987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3da4e-ef43-49a3-bc96-83b22b49a427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.678670 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3da4e-ef43-49a3-bc96-83b22b49a427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:13.680293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3da4e-ef43-49a3-bc96-83b22b49a427 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:13.695014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1097/2192] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:42:13.695190 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1096/2193] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:42:13 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:42:13.696072 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3da4e-ef43-49a3-bc96-83b22b49a427 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:13.697391 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56245c9-6473-43f7-8fc0-f8c1f56f84a6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:13.706000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3da4e-ef43-49a3-bc96-83b22b49a427 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:13.707467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56245c9-6473-43f7-8fc0-f8c1f56f84a6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:13.711843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ac796-c411-4b75-abf0-56a0bdf08b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:13.712381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b4855-713d-4f3c-be8a-5b3533f0ce42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:13.712527 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ac796-c411-4b75-abf0-56a0bdf08b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.712805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ac796-c411-4b75-abf0-56a0bdf08b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.712973 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4855-713d-4f3c-be8a-5b3533f0ce42 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.713113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ac796-c411-4b75-abf0-56a0bdf08b9e admin admin] PATH_INFO: `/v3/projects/ab96ef65234f4902be491defdb342df7/users/99bd3ecdc90b4858b75e38569d74061d/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.713288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4855-713d-4f3c-be8a-5b3533f0ce42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.713558 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4855-713d-4f3c-be8a-5b3533f0ce42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.714226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b4855-713d-4f3c-be8a-5b3533f0ce42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:13.716032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b4855-713d-4f3c-be8a-5b3533f0ce42 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:13.726500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1097/2194] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:42:13.728650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ac796-c411-4b75-abf0-56a0bdf08b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab96ef65234f4902be491defdb342df7, user_id=99bd3ecdc90b4858b75e38569d74061d, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:13.730519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b4855-713d-4f3c-be8a-5b3533f0ce42 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:13.731622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ac796-c411-4b75-abf0-56a0bdf08b9e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:13.741031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b4855-713d-4f3c-be8a-5b3533f0ce42 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:13.746850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ef9d8-4d3b-4628-a201-4cafc9c90071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:13.747365 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ef9d8-4d3b-4628-a201-4cafc9c90071 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.747698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ef9d8-4d3b-4628-a201-4cafc9c90071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.748008 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ef9d8-4d3b-4628-a201-4cafc9c90071 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.748795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ef9d8-4d3b-4628-a201-4cafc9c90071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:13.750557 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ef9d8-4d3b-4628-a201-4cafc9c90071 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:13.762389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1098/2195] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:42:13.766577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ef9d8-4d3b-4628-a201-4cafc9c90071 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:13.776802 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ef9d8-4d3b-4628-a201-4cafc9c90071 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:13.781430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d1fcd-b70d-4619-835e-0189f218b5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:13.782052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1fcd-b70d-4619-835e-0189f218b5ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.782329 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1fcd-b70d-4619-835e-0189f218b5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.782598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1fcd-b70d-4619-835e-0189f218b5ed admin admin] PATH_INFO: `/v3/projects/25fe8414331e4b7abab68547d448be90/users/07fb3e7f8c3f4bb6a577896c775e57e5/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.797180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d1fcd-b70d-4619-835e-0189f218b5ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=25fe8414331e4b7abab68547d448be90, user_id=07fb3e7f8c3f4bb6a577896c775e57e5, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:13.800600 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d1fcd-b70d-4619-835e-0189f218b5ed admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:13.826967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1098/2196] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:42:13 2022] PUT /identity/v3/projects/ab96ef65234f4902be491defdb342df7/users/99bd3ecdc90b4858b75e38569d74061d/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:13.831917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b234ad1-d0b1-4a8f-8f69-0f9abd9b3a1f None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.832200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b234ad1-d0b1-4a8f-8f69-0f9abd9b3a1f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.832469 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b234ad1-d0b1-4a8f-8f69-0f9abd9b3a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.851058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-6b234ad1-d0b1-4a8f-8f69-0f9abd9b3a1f None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:13.852169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6b234ad1-d0b1-4a8f-8f69-0f9abd9b3a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:13.892388 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1099/2197] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:42:13 2022] PUT /identity/v3/projects/25fe8414331e4b7abab68547d448be90/users/07fb3e7f8c3f4bb6a577896c775e57e5/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:42:13.903798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2dd50-beba-4c52-b500-95b8fa369086 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:13.904091 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2dd50-beba-4c52-b500-95b8fa369086 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:13.904376 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2dd50-beba-4c52-b500-95b8fa369086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:13.915078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1099/2198] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:42:13.934679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b234ad1-d0b1-4a8f-8f69-0f9abd9b3a1f None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:13.936283 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6b234ad1-d0b1-4a8f-8f69-0f9abd9b3a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:13.954301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8fe2dd50-beba-4c52-b500-95b8fa369086 None None] MFA Rules not processed for user `07fb3e7f8c3f4bb6a577896c775e57e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:13.955818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8fe2dd50-beba-4c52-b500-95b8fa369086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:13.998832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b234ad1-d0b1-4a8f-8f69-0f9abd9b3a1f None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:14.045888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1100/2199] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:42:14.047123 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2dd50-beba-4c52-b500-95b8fa369086 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:14.074075 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51e532-fd9d-4577-bcd1-3393c7886b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:14.074698 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51e532-fd9d-4577-bcd1-3393c7886b73 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:14.074977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51e532-fd9d-4577-bcd1-3393c7886b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:14.075247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51e532-fd9d-4577-bcd1-3393c7886b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:14.129552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2dd50-beba-4c52-b500-95b8fa369086 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:14.134882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb93b05-f7fa-4563-83a1-5435d28c99dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:14.135513 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb93b05-f7fa-4563-83a1-5435d28c99dd admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:14.135795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb93b05-f7fa-4563-83a1-5435d28c99dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:14.136072 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb93b05-f7fa-4563-83a1-5435d28c99dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:14.136713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb93b05-f7fa-4563-83a1-5435d28c99dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:14.138693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb93b05-f7fa-4563-83a1-5435d28c99dd admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:14.171820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51e532-fd9d-4577-bcd1-3393c7886b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:14.173456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51e532-fd9d-4577-bcd1-3393c7886b73 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:14.189161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1100/2200] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:42:14.267378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:14.274459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1101/2201] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:42:14 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:42:14.278681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51e532-fd9d-4577-bcd1-3393c7886b73 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:14.289345 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51e532-fd9d-4577-bcd1-3393c7886b73 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:14.346971 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d2683-7144-4eaa-9061-faf527f666ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:14.347609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d2683-7144-4eaa-9061-faf527f666ae admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:14.348029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d2683-7144-4eaa-9061-faf527f666ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:14.348305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d2683-7144-4eaa-9061-faf527f666ae admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:14.348948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d2683-7144-4eaa-9061-faf527f666ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:14.350909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d2683-7144-4eaa-9061-faf527f666ae admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:14.428825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1101/2202] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:42:14 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:42:14.429867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb93b05-f7fa-4563-83a1-5435d28c99dd admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:14.441491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb93b05-f7fa-4563-83a1-5435d28c99dd admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:14.446894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2dc4d-b489-42df-aba8-0e2661f2f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:14.447516 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2dc4d-b489-42df-aba8-0e2661f2f830 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:14.447795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2dc4d-b489-42df-aba8-0e2661f2f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:14.448065 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2dc4d-b489-42df-aba8-0e2661f2f830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:14.448720 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2dc4d-b489-42df-aba8-0e2661f2f830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:14.450864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2dc4d-b489-42df-aba8-0e2661f2f830 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:14.465340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1102/2203] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:42:14.466727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d2683-7144-4eaa-9061-faf527f666ae admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:14.477014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d2683-7144-4eaa-9061-faf527f666ae admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:14.481934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ecb26-7e9c-4f56-b38b-4d2294313eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:14.482707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ecb26-7e9c-4f56-b38b-4d2294313eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:14.482864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ecb26-7e9c-4f56-b38b-4d2294313eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:14.483142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ecb26-7e9c-4f56-b38b-4d2294313eb8 admin admin] PATH_INFO: `/v3/projects/2ae77f92c419483e95e28c7223ce34d6/users/211ec4a4b24b40808c1096c3a2961328/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:14.501676 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ecb26-7e9c-4f56-b38b-4d2294313eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae77f92c419483e95e28c7223ce34d6, user_id=211ec4a4b24b40808c1096c3a2961328, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:14.505174 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ecb26-7e9c-4f56-b38b-4d2294313eb8 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:14.575357 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1102/2204] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:42:14 2022] PUT /identity/v3/projects/2ae77f92c419483e95e28c7223ce34d6/users/211ec4a4b24b40808c1096c3a2961328/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:14.579547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2dc4d-b489-42df-aba8-0e2661f2f830 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:14.590076 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2dc4d-b489-42df-aba8-0e2661f2f830 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:14.620693 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ecb26-7e9c-4f56-b38b-4d2294313eb8 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:14.622512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b90ecb26-7e9c-4f56-b38b-4d2294313eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:14.654495 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f8c6a-2f53-480c-947f-cc4896920c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:14.655159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f8c6a-2f53-480c-947f-cc4896920c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:14.660141 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f8c6a-2f53-480c-947f-cc4896920c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:14.660141 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f8c6a-2f53-480c-947f-cc4896920c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:14.660141 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f8c6a-2f53-480c-947f-cc4896920c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:14.660141 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f8c6a-2f53-480c-947f-cc4896920c4a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:14.669344 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1103/2205] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:42:14.673443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f8c6a-2f53-480c-947f-cc4896920c4a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:14.684649 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f8c6a-2f53-480c-947f-cc4896920c4a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:14.689964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677c43f-f798-4047-af29-3c2b1714dfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:14.690629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c43f-f798-4047-af29-3c2b1714dfb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:14.691030 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c43f-f798-4047-af29-3c2b1714dfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:14.691362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c43f-f798-4047-af29-3c2b1714dfb1 admin admin] PATH_INFO: `/v3/projects/2ae77f92c419483e95e28c7223ce34d6/users/211ec4a4b24b40808c1096c3a2961328/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:14.693471 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677c43f-f798-4047-af29-3c2b1714dfb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae77f92c419483e95e28c7223ce34d6, user_id=211ec4a4b24b40808c1096c3a2961328, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:14.696139 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677c43f-f798-4047-af29-3c2b1714dfb1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:14.707039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ecb26-7e9c-4f56-b38b-4d2294313eb8 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:14.718259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1104/2206] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:42:14 2022] PUT /identity/v3/projects/2ae77f92c419483e95e28c7223ce34d6/users/211ec4a4b24b40808c1096c3a2961328/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:42:14.721237 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bec6c-a085-45da-948e-b8f3b89a7726 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:14.721729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bec6c-a085-45da-948e-b8f3b89a7726 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:14.722244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bec6c-a085-45da-948e-b8f3b89a7726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:14.753515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-af5bec6c-a085-45da-948e-b8f3b89a7726 None None] MFA Rules not processed for user `211ec4a4b24b40808c1096c3a2961328`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:14.755068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-af5bec6c-a085-45da-948e-b8f3b89a7726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:14.776465 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320daac-8d3a-4e19-b0cb-06b5b7a588c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:14.777593 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320daac-8d3a-4e19-b0cb-06b5b7a588c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:14.777870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320daac-8d3a-4e19-b0cb-06b5b7a588c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:14.778145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320daac-8d3a-4e19-b0cb-06b5b7a588c2 admin admin] PATH_INFO: `/v3/users/924902491c284ea7b7da4f69b36c9df7` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:14.779461 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320daac-8d3a-4e19-b0cb-06b5b7a588c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924902491c284ea7b7da4f69b36c9df7)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:14.781424 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320daac-8d3a-4e19-b0cb-06b5b7a588c2 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:14.840154 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1105/2207] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:14.853526 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bec6c-a085-45da-948e-b8f3b89a7726 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:14.854991 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-af5bec6c-a085-45da-948e-b8f3b89a7726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:14.910943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bec6c-a085-45da-948e-b8f3b89a7726 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:14.914824 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c73e0c-5f75-4628-9aba-e0bcdcf70e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:14.915552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c73e0c-5f75-4628-9aba-e0bcdcf70e49 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:14.915705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c73e0c-5f75-4628-9aba-e0bcdcf70e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:14.915957 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c73e0c-5f75-4628-9aba-e0bcdcf70e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:14.975044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c73e0c-5f75-4628-9aba-e0bcdcf70e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:14.976408 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c73e0c-5f75-4628-9aba-e0bcdcf70e49 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:14.985673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1106/2208] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:42:14.994174 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9320daac-8d3a-4e19-b0cb-06b5b7a588c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924902491c284ea7b7da4f69b36c9df7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:15.072777 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9320daac-8d3a-4e19-b0cb-06b5b7a588c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924902491c284ea7b7da4f69b36c9df7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:15.072777 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9320daac-8d3a-4e19-b0cb-06b5b7a588c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924902491c284ea7b7da4f69b36c9df7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:15.073084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665eca1b-c7f9-4706-ad36-27d9bef2d56f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:15.073169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665eca1b-c7f9-4706-ad36-27d9bef2d56f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:15.073417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665eca1b-c7f9-4706-ad36-27d9bef2d56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:15.084596 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9320daac-8d3a-4e19-b0cb-06b5b7a588c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924902491c284ea7b7da4f69b36c9df7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:15.093721 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-665eca1b-c7f9-4706-ad36-27d9bef2d56f None None] MFA Rules not processed for user `30cafaae85254794b39d8b2bac9d0371`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:15.095865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-665eca1b-c7f9-4706-ad36-27d9bef2d56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:15.103187 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9320daac-8d3a-4e19-b0cb-06b5b7a588c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924902491c284ea7b7da4f69b36c9df7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:15.110304 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1103/2209] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:42:14 2022] DELETE /identity/v3/users/924902491c284ea7b7da4f69b36c9df7 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:15.115195 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02027a-c8de-47ca-81f8-b98eb8da0842 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:15.115550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02027a-c8de-47ca-81f8-b98eb8da0842 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:15.116129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02027a-c8de-47ca-81f8-b98eb8da0842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:15.137347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-8e02027a-c8de-47ca-81f8-b98eb8da0842 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:15.138598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8e02027a-c8de-47ca-81f8-b98eb8da0842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:15.165598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1107/2210] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:42:15.207053 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1104/2211] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:42:15.213189 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665eca1b-c7f9-4706-ad36-27d9bef2d56f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:15.214603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-665eca1b-c7f9-4706-ad36-27d9bef2d56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:15.285404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665eca1b-c7f9-4706-ad36-27d9bef2d56f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:15.291078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:15.351309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ef57b-2c4b-40ad-8418-6d12b3cfdbfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:15.351964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ef57b-2c4b-40ad-8418-6d12b3cfdbfa service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:15.352409 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ef57b-2c4b-40ad-8418-6d12b3cfdbfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:15.352690 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ef57b-2c4b-40ad-8418-6d12b3cfdbfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:15.363709 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ef57b-2c4b-40ad-8418-6d12b3cfdbfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:15.366289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ef57b-2c4b-40ad-8418-6d12b3cfdbfa service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:15.378446 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1108/2212] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:42:16.123074 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02027a-c8de-47ca-81f8-b98eb8da0842 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:16.124839 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8e02027a-c8de-47ca-81f8-b98eb8da0842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:16.141871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02027a-c8de-47ca-81f8-b98eb8da0842 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:16.148329 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:16.149459 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:16.150164 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:16.150645 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a admin admin] PATH_INFO: `/v3/projects/9ac94e862b86434b97af260688f8ef71` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:16.152143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac94e862b86434b97af260688f8ef71)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:16.159863 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:16.341863 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac94e862b86434b97af260688f8ef71', 'request_id': 'req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:16.349804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac94e862b86434b97af260688f8ef71', 'request_id': 'req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:16.455480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac94e862b86434b97af260688f8ef71', 'request_id': 'req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:16.472382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a admin admin] The token cache is being invalidate because project 9ac94e862b86434b97af260688f8ef71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:42:16.473174 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:16.474021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-25dbee59-385f-4e5d-aa2b-ffc73624ce9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:16.475961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1105/2213] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:42:16 2022] DELETE /identity/v3/projects/9ac94e862b86434b97af260688f8ef71 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:16.481047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843c9fe-4e89-4d4b-a147-9d614c7a6bf9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:16.481983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843c9fe-4e89-4d4b-a147-9d614c7a6bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:16.482492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843c9fe-4e89-4d4b-a147-9d614c7a6bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:16.505283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2843c9fe-4e89-4d4b-a147-9d614c7a6bf9 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:16.506875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2843c9fe-4e89-4d4b-a147-9d614c7a6bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:16.597738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1109/2214] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:16.605273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187fb10-f491-4550-bea8-236f0bff371c None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:16.605895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187fb10-f491-4550-bea8-236f0bff371c None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:16.606430 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187fb10-f491-4550-bea8-236f0bff371c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:16.634725 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2187fb10-f491-4550-bea8-236f0bff371c None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:16.636794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2187fb10-f491-4550-bea8-236f0bff371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:16.647477 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1106/2215] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:16.651659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843c9fe-4e89-4d4b-a147-9d614c7a6bf9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:16.671263 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843c9fe-4e89-4d4b-a147-9d614c7a6bf9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:16.681905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e82131-1190-40b2-9b53-209dbfe1a0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:16.683780 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e82131-1190-40b2-9b53-209dbfe1a0fa admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:16.684117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e82131-1190-40b2-9b53-209dbfe1a0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:16.686276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e82131-1190-40b2-9b53-209dbfe1a0fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:16.687089 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e82131-1190-40b2-9b53-209dbfe1a0fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:42:16.687825 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e82131-1190-40b2-9b53-209dbfe1a0fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:16.691605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e82131-1190-40b2-9b53-209dbfe1a0fa admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:16.712497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1110/2216] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:42:16.713713 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187fb10-f491-4550-bea8-236f0bff371c None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:16.731141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187fb10-f491-4550-bea8-236f0bff371c None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:16.739373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5252aa6-d1f9-487e-b539-52347bd8bfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:16.740403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5252aa6-d1f9-487e-b539-52347bd8bfe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:16.741419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5252aa6-d1f9-487e-b539-52347bd8bfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:16.741901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5252aa6-d1f9-487e-b539-52347bd8bfe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:16.742794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5252aa6-d1f9-487e-b539-52347bd8bfe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:16.745548 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5252aa6-d1f9-487e-b539-52347bd8bfe6 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:16.769921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:16.835564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1107/2217] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:42:16 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:42:16.839206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e82131-1190-40b2-9b53-209dbfe1a0fa admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:16.853163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e82131-1190-40b2-9b53-209dbfe1a0fa admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:16.979331 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b2fdf-b820-4cd1-94bc-4700f4c2cf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:16.981338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b2fdf-b820-4cd1-94bc-4700f4c2cf3b admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:16.981338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b2fdf-b820-4cd1-94bc-4700f4c2cf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:16.981338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b2fdf-b820-4cd1-94bc-4700f4c2cf3b admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:16.981338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b2fdf-b820-4cd1-94bc-4700f4c2cf3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:16.983751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b2fdf-b820-4cd1-94bc-4700f4c2cf3b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:17.109620 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1111/2218] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:42:16 2022] POST /identity/v3/users => generated 288 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:42:17.113649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5252aa6-d1f9-487e-b539-52347bd8bfe6 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:17.129714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5252aa6-d1f9-487e-b539-52347bd8bfe6 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:17.136344 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdae22f-98ac-4f19-8f7c-72afd0af631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:17.136956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdae22f-98ac-4f19-8f7c-72afd0af631e admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:17.137259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdae22f-98ac-4f19-8f7c-72afd0af631e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:17.137528 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdae22f-98ac-4f19-8f7c-72afd0af631e admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:17.138198 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdae22f-98ac-4f19-8f7c-72afd0af631e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:17.139789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdae22f-98ac-4f19-8f7c-72afd0af631e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:17.159290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1108/2219] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:42:17.165798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b2fdf-b820-4cd1-94bc-4700f4c2cf3b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:17.176754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b2fdf-b820-4cd1-94bc-4700f4c2cf3b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:17.183106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318bc16-4020-4a9a-bbfe-207ef4b921d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:17.183665 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318bc16-4020-4a9a-bbfe-207ef4b921d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:17.183954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318bc16-4020-4a9a-bbfe-207ef4b921d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:17.184215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318bc16-4020-4a9a-bbfe-207ef4b921d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:17.185049 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318bc16-4020-4a9a-bbfe-207ef4b921d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:17.186712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318bc16-4020-4a9a-bbfe-207ef4b921d3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:17.198779 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1112/2220] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:42:17.202754 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdae22f-98ac-4f19-8f7c-72afd0af631e admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:17.214569 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdae22f-98ac-4f19-8f7c-72afd0af631e admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:17.224958 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f3d3f-e259-4485-9c8c-bbffd93b51b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:17.225850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f3d3f-e259-4485-9c8c-bbffd93b51b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:17.226263 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f3d3f-e259-4485-9c8c-bbffd93b51b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:17.226565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f3d3f-e259-4485-9c8c-bbffd93b51b6 admin admin] PATH_INFO: `/v3/projects/881faf9d31e1479a80c34be0a417b3e0/users/ae8e10ea9171412e8921242fc8eeff9d/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:17.246019 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f3d3f-e259-4485-9c8c-bbffd93b51b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=881faf9d31e1479a80c34be0a417b3e0, user_id=ae8e10ea9171412e8921242fc8eeff9d, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:17.251029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f3d3f-e259-4485-9c8c-bbffd93b51b6 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:17.380503 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1109/2221] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:42:17 2022] PUT /identity/v3/projects/881faf9d31e1479a80c34be0a417b3e0/users/ae8e10ea9171412e8921242fc8eeff9d/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:17.391513 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712be05-b234-4749-8e53-04d49c3aa4ce None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:17.391695 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712be05-b234-4749-8e53-04d49c3aa4ce None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:17.391924 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712be05-b234-4749-8e53-04d49c3aa4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:17.427151 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b712be05-b234-4749-8e53-04d49c3aa4ce None None] MFA Rules not processed for user `ae8e10ea9171412e8921242fc8eeff9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:17.428950 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b712be05-b234-4749-8e53-04d49c3aa4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:17.510490 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1113/2222] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:17.525264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f3d3f-e259-4485-9c8c-bbffd93b51b6 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:17.527091 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8e4f3d3f-e259-4485-9c8c-bbffd93b51b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:17.606900 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f3d3f-e259-4485-9c8c-bbffd93b51b6 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:17.610814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8586c-d905-4545-a317-029d8f4f5dc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:17.612483 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8586c-d905-4545-a317-029d8f4f5dc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:17.612656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8586c-d905-4545-a317-029d8f4f5dc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:17.612955 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8586c-d905-4545-a317-029d8f4f5dc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:17.636585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8586c-d905-4545-a317-029d8f4f5dc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:17.638043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8586c-d905-4545-a317-029d8f4f5dc8 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:17.657148 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1110/2223] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:42:18.328274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712be05-b234-4749-8e53-04d49c3aa4ce None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:18.329985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b712be05-b234-4749-8e53-04d49c3aa4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:18.459713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712be05-b234-4749-8e53-04d49c3aa4ce None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:18.467097 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225655e-c6a1-4248-b883-5f1418f4347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:18.467823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225655e-c6a1-4248-b883-5f1418f4347e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:18.468178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225655e-c6a1-4248-b883-5f1418f4347e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:18.468707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225655e-c6a1-4248-b883-5f1418f4347e admin admin] PATH_INFO: `/v3/users/07fb3e7f8c3f4bb6a577896c775e57e5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:18.472143 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225655e-c6a1-4248-b883-5f1418f4347e admin admin] RBAC: Authorizing `identity:delete_user(user_id=07fb3e7f8c3f4bb6a577896c775e57e5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:18.475329 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225655e-c6a1-4248-b883-5f1418f4347e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:19.003604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:19.074518 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b225655e-c6a1-4248-b883-5f1418f4347e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07fb3e7f8c3f4bb6a577896c775e57e5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:19.085616 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b225655e-c6a1-4248-b883-5f1418f4347e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07fb3e7f8c3f4bb6a577896c775e57e5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:19.101384 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b225655e-c6a1-4248-b883-5f1418f4347e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07fb3e7f8c3f4bb6a577896c775e57e5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:19.175992 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b225655e-c6a1-4248-b883-5f1418f4347e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07fb3e7f8c3f4bb6a577896c775e57e5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:19.180632 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b225655e-c6a1-4248-b883-5f1418f4347e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07fb3e7f8c3f4bb6a577896c775e57e5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:19.184105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1114/2224] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:42:18 2022] DELETE /identity/v3/users/07fb3e7f8c3f4bb6a577896c775e57e5 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:19.188615 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084572c5-a9d1-400f-9ed2-9375eb1e9798 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:19.189619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084572c5-a9d1-400f-9ed2-9375eb1e9798 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:19.189869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084572c5-a9d1-400f-9ed2-9375eb1e9798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:19.212257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-084572c5-a9d1-400f-9ed2-9375eb1e9798 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:19.213602 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-084572c5-a9d1-400f-9ed2-9375eb1e9798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:19.301524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1111/2225] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:42:19.312230 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225655e-c6a1-4248-b883-5f1418f4347e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:19.313758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b225655e-c6a1-4248-b883-5f1418f4347e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:19.393787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225655e-c6a1-4248-b883-5f1418f4347e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:19.399040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecc55f-39fe-487a-a478-2a191507eab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:19.399794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecc55f-39fe-487a-a478-2a191507eab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:19.400082 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecc55f-39fe-487a-a478-2a191507eab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:19.400419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecc55f-39fe-487a-a478-2a191507eab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:19.413607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecc55f-39fe-487a-a478-2a191507eab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:19.416972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecc55f-39fe-487a-a478-2a191507eab0 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:19.432166 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1115/2226] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:42:19.839774 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:20.068939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084572c5-a9d1-400f-9ed2-9375eb1e9798 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:20.070427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-084572c5-a9d1-400f-9ed2-9375eb1e9798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:20.090555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084572c5-a9d1-400f-9ed2-9375eb1e9798 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:20.101120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:20.101986 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:20.103300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:20.103300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] PATH_INFO: `/v3/projects/25fe8414331e4b7abab68547d448be90` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:20.105927 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25fe8414331e4b7abab68547d448be90)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:20.112865 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:20.353922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25fe8414331e4b7abab68547d448be90', 'request_id': 'req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:20.362591 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25fe8414331e4b7abab68547d448be90', 'request_id': 'req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:20.480608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25fe8414331e4b7abab68547d448be90', 'request_id': 'req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:20.494003 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] The token cache is being invalidate because project 25fe8414331e4b7abab68547d448be90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:42:20.494307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:20.494984 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:20.496826 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1112/2227] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:42:20 2022] DELETE /identity/v3/projects/25fe8414331e4b7abab68547d448be90 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:20.501147 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecc55f-39fe-487a-a478-2a191507eab0 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:20.512886 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecc55f-39fe-487a-a478-2a191507eab0 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:20.610149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162e2b3-3733-499e-819a-1f2538ed4b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:20.610149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162e2b3-3733-499e-819a-1f2538ed4b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:20.610149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162e2b3-3733-499e-819a-1f2538ed4b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:20.610803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162e2b3-3733-499e-819a-1f2538ed4b2c admin admin] PATH_INFO: `/v3/users/211ec4a4b24b40808c1096c3a2961328` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:20.611420 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162e2b3-3733-499e-819a-1f2538ed4b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=211ec4a4b24b40808c1096c3a2961328)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:20.615313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162e2b3-3733-499e-819a-1f2538ed4b2c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:20.901459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5162e2b3-3733-499e-819a-1f2538ed4b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211ec4a4b24b40808c1096c3a2961328'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:20.920767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5162e2b3-3733-499e-819a-1f2538ed4b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211ec4a4b24b40808c1096c3a2961328'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:20.953305 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5162e2b3-3733-499e-819a-1f2538ed4b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211ec4a4b24b40808c1096c3a2961328'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:21.029142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5162e2b3-3733-499e-819a-1f2538ed4b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211ec4a4b24b40808c1096c3a2961328'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:21.029797 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5162e2b3-3733-499e-819a-1f2538ed4b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211ec4a4b24b40808c1096c3a2961328'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:21.043021 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1116/2228] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:42:20 2022] DELETE /identity/v3/users/211ec4a4b24b40808c1096c3a2961328 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:21.790276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:22.370913 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:22.375221 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:22.427443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f3d5e-2267-4ccc-b15d-5eba8ec5f512 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:22.525374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53a1ff-2a73-4e1b-a81e-973e45099161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:22.526017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53a1ff-2a73-4e1b-a81e-973e45099161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:22.526297 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53a1ff-2a73-4e1b-a81e-973e45099161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:22.526569 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53a1ff-2a73-4e1b-a81e-973e45099161 admin admin] PATH_INFO: `/v3/projects/2ae77f92c419483e95e28c7223ce34d6` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:22.528321 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53a1ff-2a73-4e1b-a81e-973e45099161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae77f92c419483e95e28c7223ce34d6)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:22.530995 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53a1ff-2a73-4e1b-a81e-973e45099161 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:22.639251 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a3fce-473d-4c01-a6b3-85b27ae959a6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:22.639540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a3fce-473d-4c01-a6b3-85b27ae959a6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:22.640357 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a3fce-473d-4c01-a6b3-85b27ae959a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:22.692631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ba0a3fce-473d-4c01-a6b3-85b27ae959a6 None None] MFA Rules not processed for user `99bd3ecdc90b4858b75e38569d74061d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:22.715308 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-cc53a1ff-2a73-4e1b-a81e-973e45099161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae77f92c419483e95e28c7223ce34d6', 'request_id': 'req-cc53a1ff-2a73-4e1b-a81e-973e45099161'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:22.727921 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ba0a3fce-473d-4c01-a6b3-85b27ae959a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:22.745531 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-cc53a1ff-2a73-4e1b-a81e-973e45099161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae77f92c419483e95e28c7223ce34d6', 'request_id': 'req-cc53a1ff-2a73-4e1b-a81e-973e45099161'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:22.834095 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-cc53a1ff-2a73-4e1b-a81e-973e45099161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae77f92c419483e95e28c7223ce34d6', 'request_id': 'req-cc53a1ff-2a73-4e1b-a81e-973e45099161'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:22.862910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-cc53a1ff-2a73-4e1b-a81e-973e45099161 admin admin] The token cache is being invalidate because project 2ae77f92c419483e95e28c7223ce34d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:42:22.862910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-cc53a1ff-2a73-4e1b-a81e-973e45099161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:22.864502 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-cc53a1ff-2a73-4e1b-a81e-973e45099161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:22.867958 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1113/2229] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:42:22 2022] DELETE /identity/v3/projects/2ae77f92c419483e95e28c7223ce34d6 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:22.873315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83801232-7a94-434f-959f-5e0abf264f95 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:22.873739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83801232-7a94-434f-959f-5e0abf264f95 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:22.874101 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83801232-7a94-434f-959f-5e0abf264f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:22.918002 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-83801232-7a94-434f-959f-5e0abf264f95 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:22.920868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-83801232-7a94-434f-959f-5e0abf264f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:22.925585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1117/2230] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:22.926881 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a3fce-473d-4c01-a6b3-85b27ae959a6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:22.928714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ba0a3fce-473d-4c01-a6b3-85b27ae959a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:23.067237 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1114/2231] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:23.076220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc642e20-0f39-49df-b768-29462fd7451c None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:23.076382 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a3fce-473d-4c01-a6b3-85b27ae959a6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:23.076802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc642e20-0f39-49df-b768-29462fd7451c None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:23.077249 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc642e20-0f39-49df-b768-29462fd7451c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:23.106830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7353f15-d6a3-4501-8477-ff7b7758abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:23.110420 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7353f15-d6a3-4501-8477-ff7b7758abe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:23.110420 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7353f15-d6a3-4501-8477-ff7b7758abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:23.110420 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7353f15-d6a3-4501-8477-ff7b7758abe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:23.110420 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7353f15-d6a3-4501-8477-ff7b7758abe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:23.111423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7353f15-d6a3-4501-8477-ff7b7758abe1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:23.120600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-fc642e20-0f39-49df-b768-29462fd7451c None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:23.123201 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-fc642e20-0f39-49df-b768-29462fd7451c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:23.139438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:23.150538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1115/2232] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:23.154559 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc642e20-0f39-49df-b768-29462fd7451c None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:23.179758 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc642e20-0f39-49df-b768-29462fd7451c None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:23.191286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd8bac-c7e5-42f5-bfa6-32234339c1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:23.192248 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd8bac-c7e5-42f5-bfa6-32234339c1af admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:23.193032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd8bac-c7e5-42f5-bfa6-32234339c1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:23.193642 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd8bac-c7e5-42f5-bfa6-32234339c1af admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:23.195747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd8bac-c7e5-42f5-bfa6-32234339c1af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:42:23.197985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd8bac-c7e5-42f5-bfa6-32234339c1af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:23.202045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd8bac-c7e5-42f5-bfa6-32234339c1af admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:23.225550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1116/2233] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:42:23.242026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd8bac-c7e5-42f5-bfa6-32234339c1af admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:23.250978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1118/2234] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:42:22 2022] POST /identity/v3/projects => generated 371 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:42:23.255608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7353f15-d6a3-4501-8477-ff7b7758abe1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:23.276853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd8bac-c7e5-42f5-bfa6-32234339c1af admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:23.365231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03475209-61fb-4cb1-9ca5-db68ffab6708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:23.368122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03475209-61fb-4cb1-9ca5-db68ffab6708 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:23.368122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03475209-61fb-4cb1-9ca5-db68ffab6708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:23.368122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03475209-61fb-4cb1-9ca5-db68ffab6708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:23.368122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03475209-61fb-4cb1-9ca5-db68ffab6708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:23.369206 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03475209-61fb-4cb1-9ca5-db68ffab6708 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:23.396056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7353f15-d6a3-4501-8477-ff7b7758abe1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:23.403542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99261e4-e628-4ed1-9bf4-023dffea4512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:23.404275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99261e4-e628-4ed1-9bf4-023dffea4512 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:23.404778 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99261e4-e628-4ed1-9bf4-023dffea4512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:23.405265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99261e4-e628-4ed1-9bf4-023dffea4512 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:23.406014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99261e4-e628-4ed1-9bf4-023dffea4512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:23.409027 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99261e4-e628-4ed1-9bf4-023dffea4512 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:23.452095 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1117/2235] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:42:23 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:42:23.458468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03475209-61fb-4cb1-9ca5-db68ffab6708 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:23.554946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03475209-61fb-4cb1-9ca5-db68ffab6708 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:23.562814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3e8b8-9460-4742-9042-5bfda16515bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:23.562814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3e8b8-9460-4742-9042-5bfda16515bc admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:23.562814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3e8b8-9460-4742-9042-5bfda16515bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:23.562814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3e8b8-9460-4742-9042-5bfda16515bc admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:23.569748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3e8b8-9460-4742-9042-5bfda16515bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:23.569748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3e8b8-9460-4742-9042-5bfda16515bc admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:23.602369 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1119/2236] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:42:23 2022] POST /identity/v3/users => generated 292 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:42:23.603961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99261e4-e628-4ed1-9bf4-023dffea4512 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:23.615764 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99261e4-e628-4ed1-9bf4-023dffea4512 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:23.629103 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6533e07-785d-465f-80d6-07d69a985a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:23.630106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6533e07-785d-465f-80d6-07d69a985a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:23.630598 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6533e07-785d-465f-80d6-07d69a985a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:23.631081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6533e07-785d-465f-80d6-07d69a985a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:23.632091 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6533e07-785d-465f-80d6-07d69a985a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:23.634212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6533e07-785d-465f-80d6-07d69a985a38 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:23.653093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1120/2237] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:42:23.659032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6533e07-785d-465f-80d6-07d69a985a38 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:23.670864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6533e07-785d-465f-80d6-07d69a985a38 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:23.678096 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483b0d1-7e54-4fd4-a243-a0add72f015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:23.681379 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483b0d1-7e54-4fd4-a243-a0add72f015c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:23.681877 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483b0d1-7e54-4fd4-a243-a0add72f015c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:23.682322 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483b0d1-7e54-4fd4-a243-a0add72f015c admin admin] PATH_INFO: `/v3/projects/efb06f919d494bc9a3d044d025bccf9c/users/18496859f88e4cd5bef0190ef2c252ea/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:23.694881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1118/2238] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:42:23 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:42:23.699262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3e8b8-9460-4742-9042-5bfda16515bc admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:23.704296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483b0d1-7e54-4fd4-a243-a0add72f015c admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb06f919d494bc9a3d044d025bccf9c, user_id=18496859f88e4cd5bef0190ef2c252ea, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:23.707328 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483b0d1-7e54-4fd4-a243-a0add72f015c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:23.715113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3e8b8-9460-4742-9042-5bfda16515bc admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:23.721412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef539e74-4b66-4f93-bef1-91c8ddb932d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:23.730720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef539e74-4b66-4f93-bef1-91c8ddb932d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:23.730720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef539e74-4b66-4f93-bef1-91c8ddb932d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:23.730720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef539e74-4b66-4f93-bef1-91c8ddb932d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:23.730720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef539e74-4b66-4f93-bef1-91c8ddb932d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:23.730720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef539e74-4b66-4f93-bef1-91c8ddb932d0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:23.736208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1119/2239] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:42:23.740288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef539e74-4b66-4f93-bef1-91c8ddb932d0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:23.750693 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:23.756226 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef539e74-4b66-4f93-bef1-91c8ddb932d0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:23.762676 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffce5d-b6f6-488a-a502-0a1547226cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:23.763510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffce5d-b6f6-488a-a502-0a1547226cab admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:23.764348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffce5d-b6f6-488a-a502-0a1547226cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:23.764729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffce5d-b6f6-488a-a502-0a1547226cab admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:23.765591 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffce5d-b6f6-488a-a502-0a1547226cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:23.767614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffce5d-b6f6-488a-a502-0a1547226cab admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:23.787596 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1121/2240] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:42:23 2022] PUT /identity/v3/projects/efb06f919d494bc9a3d044d025bccf9c/users/18496859f88e4cd5bef0190ef2c252ea/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:23.792128 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483b0d1-7e54-4fd4-a243-a0add72f015c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:23.811581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1120/2241] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:42:23.819027 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffce5d-b6f6-488a-a502-0a1547226cab admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:23.836717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffce5d-b6f6-488a-a502-0a1547226cab admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:23.925100 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480f287-2f2a-48ca-875a-0039996cdab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:23.926712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480f287-2f2a-48ca-875a-0039996cdab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:23.927214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480f287-2f2a-48ca-875a-0039996cdab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:23.927696 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480f287-2f2a-48ca-875a-0039996cdab0 admin admin] PATH_INFO: `/v3/projects/fdd4b84d7bd74c17ba393218cb56b3d2/users/3289457cd2714f7b8a175682cfc57e90/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:23.948251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480f287-2f2a-48ca-875a-0039996cdab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd4b84d7bd74c17ba393218cb56b3d2, user_id=3289457cd2714f7b8a175682cfc57e90, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:23.952058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480f287-2f2a-48ca-875a-0039996cdab0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:23.990522 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483b0d1-7e54-4fd4-a243-a0add72f015c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:23.997045 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115037b-119c-41b1-9ae9-873005f62870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:23.997865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115037b-119c-41b1-9ae9-873005f62870 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:23.999054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115037b-119c-41b1-9ae9-873005f62870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:23.999474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115037b-119c-41b1-9ae9-873005f62870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:24.000342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115037b-119c-41b1-9ae9-873005f62870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:24.002824 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115037b-119c-41b1-9ae9-873005f62870 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:24.017734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1122/2242] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:42:24.027696 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1121/2243] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:42:23 2022] PUT /identity/v3/projects/fdd4b84d7bd74c17ba393218cb56b3d2/users/3289457cd2714f7b8a175682cfc57e90/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:24.034063 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115037b-119c-41b1-9ae9-873005f62870 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:24.036046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a6221-7111-4f7c-b87f-bb12546b58fb None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:24.036331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a6221-7111-4f7c-b87f-bb12546b58fb None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:24.036609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a6221-7111-4f7c-b87f-bb12546b58fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:24.059333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115037b-119c-41b1-9ae9-873005f62870 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:24.070316 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-518a6221-7111-4f7c-b87f-bb12546b58fb None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:24.071735 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-518a6221-7111-4f7c-b87f-bb12546b58fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:24.157807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1122/2244] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:24.168018 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a6221-7111-4f7c-b87f-bb12546b58fb None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:24.169854 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-518a6221-7111-4f7c-b87f-bb12546b58fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:24.196419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756da11b-6f09-4091-88ef-cd3c60ecd2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:24.197212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756da11b-6f09-4091-88ef-cd3c60ecd2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:24.197565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756da11b-6f09-4091-88ef-cd3c60ecd2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:24.197913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756da11b-6f09-4091-88ef-cd3c60ecd2c4 admin admin] PATH_INFO: `/v3/projects/efb06f919d494bc9a3d044d025bccf9c/users/18496859f88e4cd5bef0190ef2c252ea/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:24.201388 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756da11b-6f09-4091-88ef-cd3c60ecd2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb06f919d494bc9a3d044d025bccf9c, user_id=18496859f88e4cd5bef0190ef2c252ea, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:24.204562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756da11b-6f09-4091-88ef-cd3c60ecd2c4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:24.227067 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1123/2245] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:42:24 2022] PUT /identity/v3/projects/efb06f919d494bc9a3d044d025bccf9c/users/18496859f88e4cd5bef0190ef2c252ea/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:24.371323 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a6221-7111-4f7c-b87f-bb12546b58fb None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:24.428886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:24.513383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb44ba-9eda-4d58-9ed9-d0c3db5940d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:24.514044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb44ba-9eda-4d58-9ed9-d0c3db5940d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:24.514432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb44ba-9eda-4d58-9ed9-d0c3db5940d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:24.514777 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb44ba-9eda-4d58-9ed9-d0c3db5940d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:24.639946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb44ba-9eda-4d58-9ed9-d0c3db5940d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:24.641881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb44ba-9eda-4d58-9ed9-d0c3db5940d4 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:24.655743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1123/2246] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:42:25.849699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:26.986627 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:27.623499 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14398e-2348-4981-8831-a78e950e5ea2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:27.624534 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14398e-2348-4981-8831-a78e950e5ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:27.624813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14398e-2348-4981-8831-a78e950e5ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:27.686093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bc14398e-2348-4981-8831-a78e950e5ea2 None None] MFA Rules not processed for user `3289457cd2714f7b8a175682cfc57e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:27.689035 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bc14398e-2348-4981-8831-a78e950e5ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:27.831212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1124/2247] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:27.848968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb44ba-9eda-4d58-9ed9-d0c3db5940d4 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:27.850469 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8feb44ba-9eda-4d58-9ed9-d0c3db5940d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:27.962443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb44ba-9eda-4d58-9ed9-d0c3db5940d4 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:27.970094 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b203712-f026-452e-8c9f-f3ae2ac9d6bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:27.973843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203712-f026-452e-8c9f-f3ae2ac9d6bf service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:27.974433 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203712-f026-452e-8c9f-f3ae2ac9d6bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:27.975134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203712-f026-452e-8c9f-f3ae2ac9d6bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:27.986463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b203712-f026-452e-8c9f-f3ae2ac9d6bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:27.990177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b203712-f026-452e-8c9f-f3ae2ac9d6bf service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:28.002663 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1124/2248] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:42:28.029053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:28.851762 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:30.188850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3171f-1372-4ac2-a5ed-e5c0299d9fbb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:30.188850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3171f-1372-4ac2-a5ed-e5c0299d9fbb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:30.188850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3171f-1372-4ac2-a5ed-e5c0299d9fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:30.214095 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d6f3171f-1372-4ac2-a5ed-e5c0299d9fbb None None] MFA Rules not processed for user `3289457cd2714f7b8a175682cfc57e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:30.215671 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d6f3171f-1372-4ac2-a5ed-e5c0299d9fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:30.223984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1125/2249] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:31.000936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:31.797189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:32.726948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b203712-f026-452e-8c9f-f3ae2ac9d6bf service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:32.729033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6b203712-f026-452e-8c9f-f3ae2ac9d6bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:32.754777 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b203712-f026-452e-8c9f-f3ae2ac9d6bf service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:32.767296 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4365f-b9ae-4354-a31f-9d9c72671ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:32.770806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4365f-b9ae-4354-a31f-9d9c72671ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:32.771301 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4365f-b9ae-4354-a31f-9d9c72671ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:32.771586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4365f-b9ae-4354-a31f-9d9c72671ddb admin admin] PATH_INFO: `/v3/users/ae8e10ea9171412e8921242fc8eeff9d` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:32.773481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4365f-b9ae-4354-a31f-9d9c72671ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8e10ea9171412e8921242fc8eeff9d)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:32.779558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4365f-b9ae-4354-a31f-9d9c72671ddb admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:33.074266 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:33.085741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2fb4365f-b9ae-4354-a31f-9d9c72671ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8e10ea9171412e8921242fc8eeff9d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:33.194545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2fb4365f-b9ae-4354-a31f-9d9c72671ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8e10ea9171412e8921242fc8eeff9d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:33.195875 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2fb4365f-b9ae-4354-a31f-9d9c72671ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8e10ea9171412e8921242fc8eeff9d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:33.207042 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2fb4365f-b9ae-4354-a31f-9d9c72671ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8e10ea9171412e8921242fc8eeff9d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:33.248378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2fb4365f-b9ae-4354-a31f-9d9c72671ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8e10ea9171412e8921242fc8eeff9d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:33.269043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1125/2250] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:42:32 2022] DELETE /identity/v3/users/ae8e10ea9171412e8921242fc8eeff9d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:33.270609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca4370-47e1-40f1-9f07-9a6209d9c622 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:33.270966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca4370-47e1-40f1-9f07-9a6209d9c622 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:33.271441 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca4370-47e1-40f1-9f07-9a6209d9c622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:33.320535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f8ca4370-47e1-40f1-9f07-9a6209d9c622 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:33.322768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f8ca4370-47e1-40f1-9f07-9a6209d9c622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:33.450511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1126/2251] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:42:33.510587 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4365f-b9ae-4354-a31f-9d9c72671ddb admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:33.513400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2fb4365f-b9ae-4354-a31f-9d9c72671ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:33.587760 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c656020-097a-4b04-95a9-fed27e1dc8c1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:33.588049 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c656020-097a-4b04-95a9-fed27e1dc8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:33.588325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c656020-097a-4b04-95a9-fed27e1dc8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:33.598294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4365f-b9ae-4354-a31f-9d9c72671ddb admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:33.602023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146c023-4525-4370-b548-dc578b53e884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:33.602631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146c023-4525-4370-b548-dc578b53e884 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:33.602905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146c023-4525-4370-b548-dc578b53e884 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:33.603257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146c023-4525-4370-b548-dc578b53e884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:33.614509 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146c023-4525-4370-b548-dc578b53e884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:33.615972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146c023-4525-4370-b548-dc578b53e884 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:33.623672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5c656020-097a-4b04-95a9-fed27e1dc8c1 None None] MFA Rules not processed for user `18496859f88e4cd5bef0190ef2c252ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:33.625102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5c656020-097a-4b04-95a9-fed27e1dc8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:33.627184 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1126/2252] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:42:33.764380 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1127/2253] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:42:33.778022 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146c023-4525-4370-b548-dc578b53e884 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:33.779533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a146c023-4525-4370-b548-dc578b53e884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:33.880717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146c023-4525-4370-b548-dc578b53e884 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:33.888144 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbe9ad-3d8c-4a95-9c31-a1fc369bc12b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:33.888764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe9ad-3d8c-4a95-9c31-a1fc369bc12b service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:33.889223 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe9ad-3d8c-4a95-9c31-a1fc369bc12b service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:33.889478 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe9ad-3d8c-4a95-9c31-a1fc369bc12b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:33.896429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-11cbe9ad-3d8c-4a95-9c31-a1fc369bc12b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:33.974460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbe9ad-3d8c-4a95-9c31-a1fc369bc12b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:33.976212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbe9ad-3d8c-4a95-9c31-a1fc369bc12b service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:33.989303 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1127/2254] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:42:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:42:34.218590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c656020-097a-4b04-95a9-fed27e1dc8c1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:42:34.222814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5c656020-097a-4b04-95a9-fed27e1dc8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:34.235890 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c656020-097a-4b04-95a9-fed27e1dc8c1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:42:34.248356 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:42:34.252595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:34.252884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:34.253240 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39 admin admin] PATH_INFO: `/v3/projects/881faf9d31e1479a80c34be0a417b3e0` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:34.257833 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=881faf9d31e1479a80c34be0a417b3e0)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:42:34.261260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:42:34.378243 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '881faf9d31e1479a80c34be0a417b3e0', 'request_id': 'req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:34.385136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '881faf9d31e1479a80c34be0a417b3e0', 'request_id': 'req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:34.392219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '881faf9d31e1479a80c34be0a417b3e0', 'request_id': 'req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:34.487758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39 admin admin] The token cache is being invalidate because project 881faf9d31e1479a80c34be0a417b3e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:42:34.488081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:34.488724 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-66d1ac4c-0ca6-42c9-ac12-6110bc739d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:42:34.490508 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1128/2255] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:42:34 2022] DELETE /identity/v3/projects/881faf9d31e1479a80c34be0a417b3e0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:42:34.677118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:34.734212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:36.733798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:36.779777 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:37.130300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188f2a8-0a1c-4ceb-8865-c7543e06cfb5 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:37.130300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188f2a8-0a1c-4ceb-8865-c7543e06cfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:37.130492 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188f2a8-0a1c-4ceb-8865-c7543e06cfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:37.189287 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-7188f2a8-0a1c-4ceb-8865-c7543e06cfb5 None None] MFA Rules not processed for user `99bd3ecdc90b4858b75e38569d74061d`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:37.191986 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7188f2a8-0a1c-4ceb-8865-c7543e06cfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:37.270133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1128/2256] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:38.791147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:39.622538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:40.765421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:41.264180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0353bcc-617a-452f-81d1-bed32da838d8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:41.264736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0353bcc-617a-452f-81d1-bed32da838d8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:41.264736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0353bcc-617a-452f-81d1-bed32da838d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:41.289768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b0353bcc-617a-452f-81d1-bed32da838d8 None None] MFA Rules not processed for user `da324489014b4ed7adb3529702cd5e78`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:41.291253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b0353bcc-617a-452f-81d1-bed32da838d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:41.335883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:41.353065 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1129/2257] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:42.087927 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:42.316328 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:42.519671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:42.868373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:43.262091 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:43.985545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:44.045660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:44.612964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:44.738990 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:44.793555 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:45.142599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:45.458417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:45.916452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:46.006377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:46.304303 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:46.371363 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:46.668327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:46.697186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:47.149528 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:56.731667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1da1e9-8510-4e7a-a1b2-ce3ab908bf30 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:56.732178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1da1e9-8510-4e7a-a1b2-ce3ab908bf30 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:56.732281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1da1e9-8510-4e7a-a1b2-ce3ab908bf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:56.751696 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-1b1da1e9-8510-4e7a-a1b2-ce3ab908bf30 None None] MFA Rules not processed for user `3289457cd2714f7b8a175682cfc57e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:56.752875 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1b1da1e9-8510-4e7a-a1b2-ce3ab908bf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:42:56.808358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1129/2258] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:42:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:42:57.292592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:42:59.959174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc5a5e-0546-401e-83ae-1f3a20bf3858 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:42:59.959838 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc5a5e-0546-401e-83ae-1f3a20bf3858 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:42:59.959838 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc5a5e-0546-401e-83ae-1f3a20bf3858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:42:59.981605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-10dc5a5e-0546-401e-83ae-1f3a20bf3858 None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:42:59.982936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-10dc5a5e-0546-401e-83ae-1f3a20bf3858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:00.042299 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1130/2259] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:43:00.087051 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1da1e9-8510-4e7a-a1b2-ce3ab908bf30 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:00.088551 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1b1da1e9-8510-4e7a-a1b2-ce3ab908bf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:00.093743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:43:00.221184 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1da1e9-8510-4e7a-a1b2-ce3ab908bf30 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:00.226931 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684bd68-65ba-47be-83b7-bb3f0b4fca55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:00.228245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684bd68-65ba-47be-83b7-bb3f0b4fca55 service swift] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:00.228633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684bd68-65ba-47be-83b7-bb3f0b4fca55 service swift] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:00.228970 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684bd68-65ba-47be-83b7-bb3f0b4fca55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:00.238142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684bd68-65ba-47be-83b7-bb3f0b4fca55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:00.241776 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684bd68-65ba-47be-83b7-bb3f0b4fca55 service swift] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:00.252210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1130/2260] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:43:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 04:43:10.034122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=25 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:43:10.248844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=31 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:43:14.510784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2c769-ac38-440f-a5ff-8596b5373e97 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:14.514713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2c769-ac38-440f-a5ff-8596b5373e97 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:14.514713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2c769-ac38-440f-a5ff-8596b5373e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:14.532607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d3b2c769-ac38-440f-a5ff-8596b5373e97 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:14.533872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d3b2c769-ac38-440f-a5ff-8596b5373e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:14.620848 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1131/2261] 10.222.0.61 () {58 vars in 1016 bytes} [Sat Sep 17 04:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:43:14.649260 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684bd68-65ba-47be-83b7-bb3f0b4fca55 service swift] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:14.657820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-0684bd68-65ba-47be-83b7-bb3f0b4fca55 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:14.768477 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684bd68-65ba-47be-83b7-bb3f0b4fca55 service swift] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:14.776386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8df276-143e-4738-8175-3a34a557a878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:14.783859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8df276-143e-4738-8175-3a34a557a878 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:14.783859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8df276-143e-4738-8175-3a34a557a878 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:14.783859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8df276-143e-4738-8175-3a34a557a878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:14.792029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8df276-143e-4738-8175-3a34a557a878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:14.795431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8df276-143e-4738-8175-3a34a557a878 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:14.820273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1131/2262] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:43:22.423178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670737d-e900-4658-b109-482c73e0f938 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:22.423729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670737d-e900-4658-b109-482c73e0f938 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:22.423845 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670737d-e900-4658-b109-482c73e0f938 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:22.425527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1132/2263] 10.222.0.50 () {54 vars in 921 bytes} [Sat Sep 17 04:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 04:43:22.432718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0494a-c4b3-44fe-ae58-481ecbf058ed None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:22.433262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0494a-c4b3-44fe-ae58-481ecbf058ed None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:22.433262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0494a-c4b3-44fe-ae58-481ecbf058ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:22.455273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-b3a0494a-c4b3-44fe-ae58-481ecbf058ed None None] MFA Rules not processed for user `eb70408fecfe41e0b2ea9a53c7ae0823`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:22.456492 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b3a0494a-c4b3-44fe-ae58-481ecbf058ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:22.467729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1132/2264] 10.222.0.50 () {58 vars in 1018 bytes} [Sat Sep 17 04:43:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:43:22.485907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670737d-e900-4658-b109-482c73e0f938 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:22.487836 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b670737d-e900-4658-b109-482c73e0f938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:22.571305 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670737d-e900-4658-b109-482c73e0f938 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:22.576310 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65576385-9844-4945-9b3a-ee925c9c88f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ba9aba795f423a8ffabe419b64507a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:22.577011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576385-9844-4945-9b3a-ee925c9c88f0 service glance] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:22.577351 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576385-9844-4945-9b3a-ee925c9c88f0 service glance] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:22.577629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576385-9844-4945-9b3a-ee925c9c88f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:22.594764 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65576385-9844-4945-9b3a-ee925c9c88f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:22.596214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65576385-9844-4945-9b3a-ee925c9c88f0 service glance] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:22.614303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1133/2265] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:43:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:43:22.840550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee030c7-576f-48cb-b3d7-de7a70f009be None None] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:22.840900 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee030c7-576f-48cb-b3d7-de7a70f009be None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:22.841236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee030c7-576f-48cb-b3d7-de7a70f009be None None] PATH_INFO: `/` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:22.842618 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1133/2266] 10.222.0.50 () {54 vars in 921 bytes} [Sat Sep 17 04:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:43:22.847759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1d519-dca1-4139-b8e9-d8d2f633c31c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:22.848049 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1d519-dca1-4139-b8e9-d8d2f633c31c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:22.848347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1d519-dca1-4139-b8e9-d8d2f633c31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:22.877799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e9d1d519-dca1-4139-b8e9-d8d2f633c31c None None] MFA Rules not processed for user `6469c8860be943168b67ea7fa28bf19d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:22.877799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e9d1d519-dca1-4139-b8e9-d8d2f633c31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:22.926489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1134/2267] 10.222.0.50 () {58 vars in 1018 bytes} [Sat Sep 17 04:43:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:43:22.939869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee030c7-576f-48cb-b3d7-de7a70f009be None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:22.942170 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-dee030c7-576f-48cb-b3d7-de7a70f009be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:22.955532 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee030c7-576f-48cb-b3d7-de7a70f009be None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:22.959264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cdb65-f9ac-4932-a250-6a3db2d3fde6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:22.959781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cdb65-f9ac-4932-a250-6a3db2d3fde6 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:22.960065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cdb65-f9ac-4932-a250-6a3db2d3fde6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:22.960335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cdb65-f9ac-4932-a250-6a3db2d3fde6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:22.967808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cdb65-f9ac-4932-a250-6a3db2d3fde6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:22.969600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cdb65-f9ac-4932-a250-6a3db2d3fde6 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:22.977507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1134/2268] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:43:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:43:23.062347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ceaeb-9258-4462-bd6a-4ee814adf876 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:23.062814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ceaeb-9258-4462-bd6a-4ee814adf876 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:23.063661 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ceaeb-9258-4462-bd6a-4ee814adf876 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:23.067184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1135/2269] 10.222.0.50 () {54 vars in 921 bytes} [Sat Sep 17 04:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:43:23.070397 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eece521-fdbf-4ebb-98b7-6d263c75da3b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:23.070697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eece521-fdbf-4ebb-98b7-6d263c75da3b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:23.070966 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eece521-fdbf-4ebb-98b7-6d263c75da3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:23.091078 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-0eece521-fdbf-4ebb-98b7-6d263c75da3b None None] MFA Rules not processed for user `eb70408fecfe41e0b2ea9a53c7ae0823`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:23.092491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-0eece521-fdbf-4ebb-98b7-6d263c75da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:23.103783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1135/2270] 10.222.0.50 () {58 vars in 1018 bytes} [Sat Sep 17 04:43:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:43:23.115224 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ceaeb-9258-4462-bd6a-4ee814adf876 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:23.118352 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d3c23-796c-434e-bb4e-31b64a33a521 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:23.118649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d3c23-796c-434e-bb4e-31b64a33a521 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:23.118989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d3c23-796c-434e-bb4e-31b64a33a521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:23.126618 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ceaeb-9258-4462-bd6a-4ee814adf876 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:23.130321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdd118-d1ad-4ebc-8368-6fe0dd7232aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:23.130955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd118-d1ad-4ebc-8368-6fe0dd7232aa service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:23.131233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd118-d1ad-4ebc-8368-6fe0dd7232aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:23.131507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd118-d1ad-4ebc-8368-6fe0dd7232aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:23.142514 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cdd118-d1ad-4ebc-8368-6fe0dd7232aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:23.144087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cdd118-d1ad-4ebc-8368-6fe0dd7232aa service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:23.147544 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-658d3c23-796c-434e-bb4e-31b64a33a521 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:23.148867 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-658d3c23-796c-434e-bb4e-31b64a33a521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:23.159597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1136/2271] 10.222.0.61 () {58 vars in 1016 bytes} [Sat Sep 17 04:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:43:23.173626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1136/2272] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:43:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:43:23.186275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d3c23-796c-434e-bb4e-31b64a33a521 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:23.189798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-658d3c23-796c-434e-bb4e-31b64a33a521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:23.206726 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d3c23-796c-434e-bb4e-31b64a33a521 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:23.212568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342b6a4-fd39-44c2-ab22-063e1ceca032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:23.213289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342b6a4-fd39-44c2-ab22-063e1ceca032 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:23.213638 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342b6a4-fd39-44c2-ab22-063e1ceca032 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:23.213980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342b6a4-fd39-44c2-ab22-063e1ceca032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:23.224062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342b6a4-fd39-44c2-ab22-063e1ceca032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:23.225899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342b6a4-fd39-44c2-ab22-063e1ceca032 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:23.237538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1137/2273] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:43:29.698801 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27497523-a1ba-4066-a0d0-41657454664a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:29.699361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27497523-a1ba-4066-a0d0-41657454664a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:29.699361 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27497523-a1ba-4066-a0d0-41657454664a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:29.720518 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-27497523-a1ba-4066-a0d0-41657454664a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:29.721873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-27497523-a1ba-4066-a0d0-41657454664a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:29.730809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1137/2274] 10.222.0.61 () {58 vars in 1016 bytes} [Sat Sep 17 04:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:43:29.772939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342b6a4-fd39-44c2-ab22-063e1ceca032 service nova] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:29.784425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342b6a4-fd39-44c2-ab22-063e1ceca032 service nova] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:29.792243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99891c38-2305-438c-b8b3-06704de6f68c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:29.792934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99891c38-2305-438c-b8b3-06704de6f68c service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:29.793386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99891c38-2305-438c-b8b3-06704de6f68c service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:29.793516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99891c38-2305-438c-b8b3-06704de6f68c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:29.803994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99891c38-2305-438c-b8b3-06704de6f68c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:29.805606 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99891c38-2305-438c-b8b3-06704de6f68c service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:29.816040 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1138/2275] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:43:32.611813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429f009-0f9e-4bf7-8f3e-df99600e6624 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:32.612582 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429f009-0f9e-4bf7-8f3e-df99600e6624 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:32.613159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429f009-0f9e-4bf7-8f3e-df99600e6624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:32.637889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b429f009-0f9e-4bf7-8f3e-df99600e6624 None None] MFA Rules not processed for user `255138cca3254c5f939112b74a04011f`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:32.639168 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b429f009-0f9e-4bf7-8f3e-df99600e6624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:32.674118 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:43:32.677956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99891c38-2305-438c-b8b3-06704de6f68c service nova] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:32.700186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99891c38-2305-438c-b8b3-06704de6f68c service nova] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:32.705021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22844352-4615-45f2-a465-abc6350eac57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:32.705944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22844352-4615-45f2-a465-abc6350eac57 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:32.707084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22844352-4615-45f2-a465-abc6350eac57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:32.707519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22844352-4615-45f2-a465-abc6350eac57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:32.712169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1138/2276] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:43:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:43:32.713073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-22844352-4615-45f2-a465-abc6350eac57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:32.794920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22844352-4615-45f2-a465-abc6350eac57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:32.796381 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22844352-4615-45f2-a465-abc6350eac57 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:32.813517 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1139/2277] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:43:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:43:33.400462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6f96d-f243-49fb-a80c-f6afaad4538f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:33.401219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6f96d-f243-49fb-a80c-f6afaad4538f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:33.402466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6f96d-f243-49fb-a80c-f6afaad4538f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:33.434936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-32a6f96d-f243-49fb-a80c-f6afaad4538f None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:33.437273 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-32a6f96d-f243-49fb-a80c-f6afaad4538f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:33.448067 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1139/2278] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:43:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:43:33.461167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22844352-4615-45f2-a465-abc6350eac57 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:33.476743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22844352-4615-45f2-a465-abc6350eac57 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:33.495623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30266312-23f0-4d7c-a1e1-6405259ff074 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:33.497468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30266312-23f0-4d7c-a1e1-6405259ff074 service swift] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:33.497750 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30266312-23f0-4d7c-a1e1-6405259ff074 service swift] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:33.498070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30266312-23f0-4d7c-a1e1-6405259ff074 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:33.511141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30266312-23f0-4d7c-a1e1-6405259ff074 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:33.513204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30266312-23f0-4d7c-a1e1-6405259ff074 service swift] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:33.524598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1140/2279] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:43:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 04:43:34.384523 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613a8f-051e-4bcd-af75-cfcb64c75766 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:34.389278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613a8f-051e-4bcd-af75-cfcb64c75766 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:34.389278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613a8f-051e-4bcd-af75-cfcb64c75766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:34.420134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-38613a8f-051e-4bcd-af75-cfcb64c75766 None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:34.423629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-38613a8f-051e-4bcd-af75-cfcb64c75766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:34.441572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1140/2280] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:43:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:43:34.460934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30266312-23f0-4d7c-a1e1-6405259ff074 service swift] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:34.474919 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30266312-23f0-4d7c-a1e1-6405259ff074 service swift] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:34.482284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7db60-f68d-4f8f-95e0-ea128f93e2c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:34.482926 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7db60-f68d-4f8f-95e0-ea128f93e2c3 service swift] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:34.483229 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7db60-f68d-4f8f-95e0-ea128f93e2c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:34.483805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7db60-f68d-4f8f-95e0-ea128f93e2c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:34.496813 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:43:34.501780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7db60-f68d-4f8f-95e0-ea128f93e2c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:34.503676 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7db60-f68d-4f8f-95e0-ea128f93e2c3 service swift] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:34.514545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1141/2281] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:43:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 04:43:34.690227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6ebc8-834b-4bb6-ad4f-92fbcd0f890a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:34.691491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6ebc8-834b-4bb6-ad4f-92fbcd0f890a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:34.691971 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6ebc8-834b-4bb6-ad4f-92fbcd0f890a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:34.782359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9db6ebc8-834b-4bb6-ad4f-92fbcd0f890a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:34.783764 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9db6ebc8-834b-4bb6-ad4f-92fbcd0f890a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:34.808097 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1141/2282] 10.222.0.61 () {58 vars in 1016 bytes} [Sat Sep 17 04:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:43:34.834707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7db60-f68d-4f8f-95e0-ea128f93e2c3 service swift] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:34.858241 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7db60-f68d-4f8f-95e0-ea128f93e2c3 service swift] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:34.879257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a55d3-e65b-4b39-9dfb-f2701ff3f4e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:34.880903 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a55d3-e65b-4b39-9dfb-f2701ff3f4e1 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:34.884094 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a55d3-e65b-4b39-9dfb-f2701ff3f4e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:34.885460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a55d3-e65b-4b39-9dfb-f2701ff3f4e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:34.916823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a55d3-e65b-4b39-9dfb-f2701ff3f4e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:34.919837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a55d3-e65b-4b39-9dfb-f2701ff3f4e1 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:34.965445 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1142/2283] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:43:43.384090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfb3f0-6a0a-492a-b4dd-7d4aa5db5a20 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:43.384723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfb3f0-6a0a-492a-b4dd-7d4aa5db5a20 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:43.384723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfb3f0-6a0a-492a-b4dd-7d4aa5db5a20 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:43.387995 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1142/2284] 10.222.0.50 () {54 vars in 961 bytes} [Sat Sep 17 04:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:43:43.392523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb63b57-e30d-4e40-a248-a2b1eb950e6f None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:43.393407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb63b57-e30d-4e40-a248-a2b1eb950e6f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:43.393407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb63b57-e30d-4e40-a248-a2b1eb950e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:43.428703 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-bdb63b57-e30d-4e40-a248-a2b1eb950e6f None None] MFA Rules not processed for user `931a947711a2468baaeef701bbee60c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:43.430377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-bdb63b57-e30d-4e40-a248-a2b1eb950e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:43.618800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1143/2285] 10.222.0.50 () {58 vars in 1058 bytes} [Sat Sep 17 04:43:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:43:43.628564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfb3f0-6a0a-492a-b4dd-7d4aa5db5a20 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:43.645301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfb3f0-6a0a-492a-b4dd-7d4aa5db5a20 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:43.661485 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1ec2e-6072-487d-96de-72b45178ba8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931a947711a2468baaeef701bbee60c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:43.662037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1ec2e-6072-487d-96de-72b45178ba8f service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:43.662379 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1ec2e-6072-487d-96de-72b45178ba8f service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:43.662713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1ec2e-6072-487d-96de-72b45178ba8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:43.665484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e4f1ec2e-6072-487d-96de-72b45178ba8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:43.681221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1ec2e-6072-487d-96de-72b45178ba8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:43.682934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1ec2e-6072-487d-96de-72b45178ba8f service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:43.723940 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1143/2286] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:43:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:43:49.487727 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06cee2-54d4-4acf-8073-a9e009a3b06b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:49.488590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06cee2-54d4-4acf-8073-a9e009a3b06b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:49.488590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06cee2-54d4-4acf-8073-a9e009a3b06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:49.526651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-9e06cee2-54d4-4acf-8073-a9e009a3b06b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:49.527934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9e06cee2-54d4-4acf-8073-a9e009a3b06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:49.560202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1144/2287] 10.222.0.61 () {58 vars in 1016 bytes} [Sat Sep 17 04:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:43:49.576571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1ec2e-6072-487d-96de-72b45178ba8f service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:49.589829 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1ec2e-6072-487d-96de-72b45178ba8f service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:49.596615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a9fe8-d406-40cc-9441-8455c9b2a22d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:49.597367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9fe8-d406-40cc-9441-8455c9b2a22d service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:49.597714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9fe8-d406-40cc-9441-8455c9b2a22d service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:49.598167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9fe8-d406-40cc-9441-8455c9b2a22d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:49.607289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a9fe8-d406-40cc-9441-8455c9b2a22d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:49.608970 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a9fe8-d406-40cc-9441-8455c9b2a22d service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:49.619798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1144/2288] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:43:53.782650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f1710-c1f7-4f09-9ad1-889da0ba8c95 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:53.782650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f1710-c1f7-4f09-9ad1-889da0ba8c95 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:53.782650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f1710-c1f7-4f09-9ad1-889da0ba8c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:53.800884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-aa3f1710-c1f7-4f09-9ad1-889da0ba8c95 None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:53.803187 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e449ac0-1a4e-455d-9057-debaf83b7f67 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:53.803676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e449ac0-1a4e-455d-9057-debaf83b7f67 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:53.803769 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e449ac0-1a4e-455d-9057-debaf83b7f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:53.807435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-aa3f1710-c1f7-4f09-9ad1-889da0ba8c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:53.815068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1145/2289] 10.222.0.50 () {58 vars in 967 bytes} [Sat Sep 17 04:43:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:43:53.828652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0e449ac0-1a4e-455d-9057-debaf83b7f67 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:53.829939 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0e449ac0-1a4e-455d-9057-debaf83b7f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:53.832363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f1710-c1f7-4f09-9ad1-889da0ba8c95 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:53.839404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1145/2290] 10.222.0.61 () {58 vars in 1016 bytes} [Sat Sep 17 04:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:43:53.846037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f1710-c1f7-4f09-9ad1-889da0ba8c95 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:53.851245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cef90-409f-4dc8-9249-ab4a5d2867a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:53.851847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cef90-409f-4dc8-9249-ab4a5d2867a4 service swift] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:53.852124 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cef90-409f-4dc8-9249-ab4a5d2867a4 service swift] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:53.852393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cef90-409f-4dc8-9249-ab4a5d2867a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:53.860881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cef90-409f-4dc8-9249-ab4a5d2867a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:53.862495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cef90-409f-4dc8-9249-ab4a5d2867a4 service swift] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:53.862849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e449ac0-1a4e-455d-9057-debaf83b7f67 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:53.871016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1146/2291] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:43:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 04:43:53.875978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e449ac0-1a4e-455d-9057-debaf83b7f67 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:53.881958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856c90a-c64d-465a-a62f-9e610c083bd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:53.882581 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c90a-c64d-465a-a62f-9e610c083bd8 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:53.882861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c90a-c64d-465a-a62f-9e610c083bd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:53.883359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c90a-c64d-465a-a62f-9e610c083bd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:53.892893 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856c90a-c64d-465a-a62f-9e610c083bd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:53.894655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856c90a-c64d-465a-a62f-9e610c083bd8 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:53.905106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1146/2292] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:43:55.433934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73380360-cf3b-4f32-931e-5e9d351434fe None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:55.434398 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73380360-cf3b-4f32-931e-5e9d351434fe None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:55.434499 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73380360-cf3b-4f32-931e-5e9d351434fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:55.455226 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-73380360-cf3b-4f32-931e-5e9d351434fe None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:43:55.459840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-73380360-cf3b-4f32-931e-5e9d351434fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:55.464478 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1147/2293] 10.222.0.50 () {58 vars in 967 bytes} [Sat Sep 17 04:43:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:43:55.485008 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856c90a-c64d-465a-a62f-9e610c083bd8 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:55.497360 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856c90a-c64d-465a-a62f-9e610c083bd8 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:55.502383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e9a20-1248-43f5-917d-badfe9be19d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:55.502976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e9a20-1248-43f5-917d-badfe9be19d5 service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:55.503306 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e9a20-1248-43f5-917d-badfe9be19d5 service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:55.503517 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e9a20-1248-43f5-917d-badfe9be19d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:55.512880 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e9a20-1248-43f5-917d-badfe9be19d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:55.514691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e9a20-1248-43f5-917d-badfe9be19d5 service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:55.523584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1147/2294] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:43:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 04:43:56.968792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73380360-cf3b-4f32-931e-5e9d351434fe None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:56.970581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-73380360-cf3b-4f32-931e-5e9d351434fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:43:56.985929 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73380360-cf3b-4f32-931e-5e9d351434fe None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:56.990582 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bcc31-8563-46f2-b060-fa60a29d9b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:56.991278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bcc31-8563-46f2-b060-fa60a29d9b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:56.991620 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bcc31-8563-46f2-b060-fa60a29d9b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:56.991955 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bcc31-8563-46f2-b060-fa60a29d9b92 admin admin] PATH_INFO: `/v3/users/3289457cd2714f7b8a175682cfc57e90` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:56.993122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bcc31-8563-46f2-b060-fa60a29d9b92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3289457cd2714f7b8a175682cfc57e90)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:56.995028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bcc31-8563-46f2-b060-fa60a29d9b92 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:57.209376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-386bcc31-8563-46f2-b060-fa60a29d9b92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3289457cd2714f7b8a175682cfc57e90'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:43:57.307890 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-386bcc31-8563-46f2-b060-fa60a29d9b92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3289457cd2714f7b8a175682cfc57e90'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:43:57.308511 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-386bcc31-8563-46f2-b060-fa60a29d9b92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3289457cd2714f7b8a175682cfc57e90'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:43:57.316537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-386bcc31-8563-46f2-b060-fa60a29d9b92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3289457cd2714f7b8a175682cfc57e90'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:43:57.331041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-386bcc31-8563-46f2-b060-fa60a29d9b92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3289457cd2714f7b8a175682cfc57e90'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:43:57.337382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1148/2295] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:43:56 2022] DELETE /identity/v3/users/3289457cd2714f7b8a175682cfc57e90 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:43:57.572006 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e9a20-1248-43f5-917d-badfe9be19d5 service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:43:57.583982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e9a20-1248-43f5-917d-badfe9be19d5 service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:43:57.645839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2ad51-cff2-4edd-b780-999a4e34537b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:43:57.646387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2ad51-cff2-4edd-b780-999a4e34537b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:43:57.646661 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2ad51-cff2-4edd-b780-999a4e34537b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:43:57.646933 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2ad51-cff2-4edd-b780-999a4e34537b admin admin] PATH_INFO: `/v3/projects/fdd4b84d7bd74c17ba393218cb56b3d2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:43:57.648066 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2ad51-cff2-4edd-b780-999a4e34537b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd4b84d7bd74c17ba393218cb56b3d2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:43:57.650012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2ad51-cff2-4edd-b780-999a4e34537b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:43:57.749988 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a9f2ad51-cff2-4edd-b780-999a4e34537b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd4b84d7bd74c17ba393218cb56b3d2', 'request_id': 'req-a9f2ad51-cff2-4edd-b780-999a4e34537b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:43:57.756574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a9f2ad51-cff2-4edd-b780-999a4e34537b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd4b84d7bd74c17ba393218cb56b3d2', 'request_id': 'req-a9f2ad51-cff2-4edd-b780-999a4e34537b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:43:57.761676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:43:57.763025 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a9f2ad51-cff2-4edd-b780-999a4e34537b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd4b84d7bd74c17ba393218cb56b3d2', 'request_id': 'req-a9f2ad51-cff2-4edd-b780-999a4e34537b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:43:57.849801 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a9f2ad51-cff2-4edd-b780-999a4e34537b admin admin] The token cache is being invalidate because project fdd4b84d7bd74c17ba393218cb56b3d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:43:57.850212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a9f2ad51-cff2-4edd-b780-999a4e34537b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:43:57.850910 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a9f2ad51-cff2-4edd-b780-999a4e34537b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:43:57.852605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1148/2296] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:43:57 2022] DELETE /identity/v3/projects/fdd4b84d7bd74c17ba393218cb56b3d2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:44:07.333778 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=82,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:44:07.855562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=3,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:44:16.547751 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb2888-2cb1-4d6b-aebd-87dfd3a2c37a None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:44:16.548216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb2888-2cb1-4d6b-aebd-87dfd3a2c37a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:44:16.548324 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb2888-2cb1-4d6b-aebd-87dfd3a2c37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:44:16.568501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-48bb2888-2cb1-4d6b-aebd-87dfd3a2c37a None None] MFA Rules not processed for user `30cafaae85254794b39d8b2bac9d0371`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:44:16.569736 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-48bb2888-2cb1-4d6b-aebd-87dfd3a2c37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:44:16.623198 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1149/2297] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:44:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:44:26.616709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=25 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:44:37.143608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c25215-fbc6-4f26-b54e-c093a225b051 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:44:37.144150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c25215-fbc6-4f26-b54e-c093a225b051 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:44:37.144150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c25215-fbc6-4f26-b54e-c093a225b051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:44:37.164842 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-78c25215-fbc6-4f26-b54e-c093a225b051 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:44:37.166081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-78c25215-fbc6-4f26-b54e-c093a225b051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:44:37.225013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1149/2298] 10.222.0.61 () {58 vars in 1016 bytes} [Sat Sep 17 04:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:44:37.252020 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb2888-2cb1-4d6b-aebd-87dfd3a2c37a None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:44:37.253524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-48bb2888-2cb1-4d6b-aebd-87dfd3a2c37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:44:37.328977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb2888-2cb1-4d6b-aebd-87dfd3a2c37a None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:44:37.344849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae8009-c1b1-4cea-861a-1ff11bd63ae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:44:37.345501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8009-c1b1-4cea-861a-1ff11bd63ae9 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:44:37.345780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8009-c1b1-4cea-861a-1ff11bd63ae9 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:44:37.346074 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8009-c1b1-4cea-861a-1ff11bd63ae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:44:37.354822 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae8009-c1b1-4cea-861a-1ff11bd63ae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:44:37.356413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae8009-c1b1-4cea-861a-1ff11bd63ae9 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:44:37.367002 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1150/2299] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:44:41.624925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b7ca6-c7a3-4bc7-bf2a-ea92ebf8d9d0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:44:41.625552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b7ca6-c7a3-4bc7-bf2a-ea92ebf8d9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:44:41.625688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b7ca6-c7a3-4bc7-bf2a-ea92ebf8d9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:44:41.648196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8d2b7ca6-c7a3-4bc7-bf2a-ea92ebf8d9d0 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:44:41.649501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8d2b7ca6-c7a3-4bc7-bf2a-ea92ebf8d9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:44:41.657966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1150/2300] 10.222.0.61 () {58 vars in 1016 bytes} [Sat Sep 17 04:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:44:41.678570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae8009-c1b1-4cea-861a-1ff11bd63ae9 service nova] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:44:41.680128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a9ae8009-c1b1-4cea-861a-1ff11bd63ae9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:44:41.695658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae8009-c1b1-4cea-861a-1ff11bd63ae9 service nova] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:44:41.701618 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60259b-981c-4525-87e7-181cdbb2cfea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:44:41.709200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60259b-981c-4525-87e7-181cdbb2cfea service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:44:41.709200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60259b-981c-4525-87e7-181cdbb2cfea service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:44:41.709200 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60259b-981c-4525-87e7-181cdbb2cfea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:44:41.711659 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60259b-981c-4525-87e7-181cdbb2cfea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:44:41.713256 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60259b-981c-4525-87e7-181cdbb2cfea service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:44:41.722804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1151/2301] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:44:45.543918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90064396-6781-4d27-aab9-277437f3ce4d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:44:45.544397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90064396-6781-4d27-aab9-277437f3ce4d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:44:45.544506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90064396-6781-4d27-aab9-277437f3ce4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:44:45.564148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-90064396-6781-4d27-aab9-277437f3ce4d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:44:45.565387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-90064396-6781-4d27-aab9-277437f3ce4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:44:45.573993 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1151/2302] 10.222.0.61 () {58 vars in 1016 bytes} [Sat Sep 17 04:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:44:45.592654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60259b-981c-4525-87e7-181cdbb2cfea service nova] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:44:45.605383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60259b-981c-4525-87e7-181cdbb2cfea service nova] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:44:45.611118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8ba1e-d372-4157-a07c-712fb1da74a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:44:45.611845 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8ba1e-d372-4157-a07c-712fb1da74a1 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:44:45.612119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8ba1e-d372-4157-a07c-712fb1da74a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:44:45.612388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8ba1e-d372-4157-a07c-712fb1da74a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:44:45.621034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8ba1e-d372-4157-a07c-712fb1da74a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:44:45.622659 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8ba1e-d372-4157-a07c-712fb1da74a1 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:44:45.632161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1152/2303] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:44:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:44:45.769954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41b632-101b-4875-b05a-51792d09e5fd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:44:45.770667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41b632-101b-4875-b05a-51792d09e5fd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:44:45.770976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41b632-101b-4875-b05a-51792d09e5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:44:45.815839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ea41b632-101b-4875-b05a-51792d09e5fd None None] MFA Rules not processed for user `da324489014b4ed7adb3529702cd5e78`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:44:45.815839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ea41b632-101b-4875-b05a-51792d09e5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:44:45.874659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1152/2304] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:44:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:44:51.834066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483611fd-bcae-4677-b21e-8ecc8da60806 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:44:51.834535 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483611fd-bcae-4677-b21e-8ecc8da60806 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:44:51.835118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483611fd-bcae-4677-b21e-8ecc8da60806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:44:51.859718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-483611fd-bcae-4677-b21e-8ecc8da60806 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:44:51.864276 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-483611fd-bcae-4677-b21e-8ecc8da60806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:44:51.870336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1153/2305] 10.222.0.61 () {58 vars in 1016 bytes} [Sat Sep 17 04:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:44:51.886264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41b632-101b-4875-b05a-51792d09e5fd None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:44:51.901121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41b632-101b-4875-b05a-51792d09e5fd None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:44:51.906841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88d3d6-6a22-4401-8e37-6b72fbb8473b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:44:51.907536 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88d3d6-6a22-4401-8e37-6b72fbb8473b service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:44:51.907880 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88d3d6-6a22-4401-8e37-6b72fbb8473b service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:44:51.908217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88d3d6-6a22-4401-8e37-6b72fbb8473b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:44:51.917219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88d3d6-6a22-4401-8e37-6b72fbb8473b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:44:51.918903 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88d3d6-6a22-4401-8e37-6b72fbb8473b service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:44:51.929107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1153/2306] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:44:59.267164 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f887e5e-6448-479c-9279-aa2ee9cba5a3 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:44:59.271227 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f887e5e-6448-479c-9279-aa2ee9cba5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:44:59.271227 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f887e5e-6448-479c-9279-aa2ee9cba5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:44:59.311101 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-4f887e5e-6448-479c-9279-aa2ee9cba5a3 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:44:59.312408 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-4f887e5e-6448-479c-9279-aa2ee9cba5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:44:59.322236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1154/2307] 10.222.0.61 () {58 vars in 1016 bytes} [Sat Sep 17 04:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:44:59.338221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88d3d6-6a22-4401-8e37-6b72fbb8473b service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:44:59.344837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=65 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:44:59.353138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88d3d6-6a22-4401-8e37-6b72fbb8473b service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:44:59.361866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6ad9b-9cde-4a04-95d7-0062d54304f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:44:59.362870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6ad9b-9cde-4a04-95d7-0062d54304f4 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:44:59.363350 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6ad9b-9cde-4a04-95d7-0062d54304f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:44:59.363993 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6ad9b-9cde-4a04-95d7-0062d54304f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:44:59.378197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6ad9b-9cde-4a04-95d7-0062d54304f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:44:59.382869 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6ad9b-9cde-4a04-95d7-0062d54304f4 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:44:59.397477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1154/2308] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:45:04.086824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559d15-2bd9-4d93-b799-14fb606a2f19 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:45:04.087284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559d15-2bd9-4d93-b799-14fb606a2f19 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:45:04.088142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559d15-2bd9-4d93-b799-14fb606a2f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:45:04.115895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-a1559d15-2bd9-4d93-b799-14fb606a2f19 None None] MFA Rules not processed for user `811bb431ddbb42638f909ebf6d921536`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:45:04.117428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a1559d15-2bd9-4d93-b799-14fb606a2f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:04.193356 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1155/2309] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:45:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:45:05.505771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983c03c-d84e-45b4-937f-15273726459d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:45:05.506367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983c03c-d84e-45b4-937f-15273726459d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:45:05.506486 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983c03c-d84e-45b4-937f-15273726459d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:45:05.526315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f983c03c-d84e-45b4-937f-15273726459d None None] MFA Rules not processed for user `c70f2ce21e9b49ffb3564873e09397e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:45:05.527506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f983c03c-d84e-45b4-937f-15273726459d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:05.629253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1155/2310] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:45:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:45:14.183021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=77 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:45:15.621754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=30 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:45:23.796852 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80f908-e130-49ea-8599-613b832e1c98 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:45:23.797400 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80f908-e130-49ea-8599-613b832e1c98 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:45:23.797631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80f908-e130-49ea-8599-613b832e1c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:45:23.818092 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2f80f908-e130-49ea-8599-613b832e1c98 None None] MFA Rules not processed for user `255138cca3254c5f939112b74a04011f`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:45:23.819462 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2f80f908-e130-49ea-8599-613b832e1c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:23.873568 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1156/2311] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:45:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:45:32.770506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983c03c-d84e-45b4-937f-15273726459d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:45:32.772108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f983c03c-d84e-45b4-937f-15273726459d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:32.831554 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983c03c-d84e-45b4-937f-15273726459d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:45:32.835249 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6210-af5d-4e03-b516-726712162bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:45:32.835890 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6210-af5d-4e03-b516-726712162bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:45:32.836170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6210-af5d-4e03-b516-726712162bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:45:32.836435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6210-af5d-4e03-b516-726712162bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:45:32.838416 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c69f6210-af5d-4e03-b516-726712162bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:32.854012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f6210-af5d-4e03-b516-726712162bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:45:32.855495 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f6210-af5d-4e03-b516-726712162bf3 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:45:32.868107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1156/2312] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:45:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:45:33.866876 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=25 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:45:34.036198 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80f908-e130-49ea-8599-613b832e1c98 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:45:34.037721 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2f80f908-e130-49ea-8599-613b832e1c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:34.051345 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80f908-e130-49ea-8599-613b832e1c98 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:45:34.055074 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd816-0f0a-434e-9515-2135874c0c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:45:34.055675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd816-0f0a-434e-9515-2135874c0c2f service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:45:34.055950 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd816-0f0a-434e-9515-2135874c0c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:45:34.056217 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd816-0f0a-434e-9515-2135874c0c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:45:34.057956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a45cd816-0f0a-434e-9515-2135874c0c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:34.072507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cd816-0f0a-434e-9515-2135874c0c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:45:34.074029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cd816-0f0a-434e-9515-2135874c0c2f service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:45:34.085793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1157/2313] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:45:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:45:36.765078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6210-af5d-4e03-b516-726712162bf3 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:45:36.767083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c69f6210-af5d-4e03-b516-726712162bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:36.785760 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6210-af5d-4e03-b516-726712162bf3 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:45:36.794784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d83f7-92ae-4722-93ba-448e263a86fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:45:36.795440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d83f7-92ae-4722-93ba-448e263a86fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:45:36.795722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d83f7-92ae-4722-93ba-448e263a86fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:45:36.796018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d83f7-92ae-4722-93ba-448e263a86fb admin admin] PATH_INFO: `/v3/users/30cafaae85254794b39d8b2bac9d0371` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:45:36.797682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d83f7-92ae-4722-93ba-448e263a86fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=30cafaae85254794b39d8b2bac9d0371)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:45:36.800377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d83f7-92ae-4722-93ba-448e263a86fb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:45:37.005990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aa7d83f7-92ae-4722-93ba-448e263a86fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30cafaae85254794b39d8b2bac9d0371'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:45:37.013016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aa7d83f7-92ae-4722-93ba-448e263a86fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30cafaae85254794b39d8b2bac9d0371'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:45:37.026630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aa7d83f7-92ae-4722-93ba-448e263a86fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30cafaae85254794b39d8b2bac9d0371'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:45:37.100535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aa7d83f7-92ae-4722-93ba-448e263a86fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30cafaae85254794b39d8b2bac9d0371'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:45:37.101743 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aa7d83f7-92ae-4722-93ba-448e263a86fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30cafaae85254794b39d8b2bac9d0371'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:45:37.108231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1157/2314] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:45:36 2022] DELETE /identity/v3/users/30cafaae85254794b39d8b2bac9d0371 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:45:37.372268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd816-0f0a-434e-9515-2135874c0c2f service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:45:37.384897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd816-0f0a-434e-9515-2135874c0c2f service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:45:37.453783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:45:37.454410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:45:37.454682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:45:37.454968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] PATH_INFO: `/v3/projects/9e556cd723334a48a2835ca8c1aa21fd` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:45:37.456370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e556cd723334a48a2835ca8c1aa21fd)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:45:37.458293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:45:37.572954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e556cd723334a48a2835ca8c1aa21fd', 'request_id': 'req-f57b1a7f-319f-45ae-a990-b90af96995e0'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:45:37.585291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e556cd723334a48a2835ca8c1aa21fd', 'request_id': 'req-f57b1a7f-319f-45ae-a990-b90af96995e0'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:45:37.667314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e556cd723334a48a2835ca8c1aa21fd', 'request_id': 'req-f57b1a7f-319f-45ae-a990-b90af96995e0'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:45:37.684607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] The token cache is being invalidate because project 9e556cd723334a48a2835ca8c1aa21fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:45:37.684911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:45:37.685685 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:45:37.697035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1158/2315] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:45:37 2022] DELETE /identity/v3/projects/9e556cd723334a48a2835ca8c1aa21fd => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:45:44.656061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d83f7-92ae-4722-93ba-448e263a86fb admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:45:44.657672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aa7d83f7-92ae-4722-93ba-448e263a86fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:44.732954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d83f7-92ae-4722-93ba-448e263a86fb admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:45:44.743142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:45:44.796533 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d78c02-89f9-4a80-aa19-3adc40993033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:45:44.797190 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d78c02-89f9-4a80-aa19-3adc40993033 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:45:44.797469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d78c02-89f9-4a80-aa19-3adc40993033 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:45:44.797737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d78c02-89f9-4a80-aa19-3adc40993033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:45:44.799442 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-03d78c02-89f9-4a80-aa19-3adc40993033 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:44.858518 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d78c02-89f9-4a80-aa19-3adc40993033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:45:44.860088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d78c02-89f9-4a80-aa19-3adc40993033 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:45:44.870295 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1158/2316] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:45:44 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:45:47.678713 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:45:54.953349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=50 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:45:55.687227 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:45:55.688729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:55.755597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b1a7f-319f-45ae-a990-b90af96995e0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:45:55.759180 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23940f71-74f5-4011-a32d-597568a9547c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:45:55.759959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23940f71-74f5-4011-a32d-597568a9547c service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:45:55.760236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23940f71-74f5-4011-a32d-597568a9547c service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:45:55.760504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23940f71-74f5-4011-a32d-597568a9547c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:45:55.762231 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-23940f71-74f5-4011-a32d-597568a9547c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:55.827606 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23940f71-74f5-4011-a32d-597568a9547c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:45:55.829100 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23940f71-74f5-4011-a32d-597568a9547c service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:45:55.839434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1159/2317] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:45:59.647072 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d4059-6e95-41b3-95cd-291f16255401 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:45:59.648470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d4059-6e95-41b3-95cd-291f16255401 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:45:59.648470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d4059-6e95-41b3-95cd-291f16255401 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:45:59.649855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1159/2318] 10.222.0.50 () {54 vars in 921 bytes} [Sat Sep 17 04:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 04:45:59.661707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f470f6-766b-4204-84ed-5884d22fa573 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:45:59.671386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f470f6-766b-4204-84ed-5884d22fa573 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:45:59.671386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f470f6-766b-4204-84ed-5884d22fa573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:45:59.683992 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-d0f470f6-766b-4204-84ed-5884d22fa573 None None] MFA Rules not processed for user `931a947711a2468baaeef701bbee60c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:45:59.685387 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d0f470f6-766b-4204-84ed-5884d22fa573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:59.753946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1160/2319] 10.222.0.50 () {58 vars in 1018 bytes} [Sat Sep 17 04:45:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:45:59.765627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d4059-6e95-41b3-95cd-291f16255401 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:45:59.767334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a49d4059-6e95-41b3-95cd-291f16255401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:59.783872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d4059-6e95-41b3-95cd-291f16255401 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:45:59.789963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0801d-fe98-4685-be28-c7f346c8fe8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931a947711a2468baaeef701bbee60c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:45:59.790565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0801d-fe98-4685-be28-c7f346c8fe8a service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:45:59.790896 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0801d-fe98-4685-be28-c7f346c8fe8a service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:45:59.791165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0801d-fe98-4685-be28-c7f346c8fe8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:45:59.800010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0801d-fe98-4685-be28-c7f346c8fe8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:45:59.801625 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0801d-fe98-4685-be28-c7f346c8fe8a service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:45:59.817711 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1160/2320] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:45:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:45:59.818578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f470f6-766b-4204-84ed-5884d22fa573 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:45:59.820600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d0f470f6-766b-4204-84ed-5884d22fa573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:45:59.836874 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f470f6-766b-4204-84ed-5884d22fa573 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:45:59.841676 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5577619-a891-4d2a-9534-89e7147b0c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:45:59.842316 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5577619-a891-4d2a-9534-89e7147b0c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:45:59.842599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5577619-a891-4d2a-9534-89e7147b0c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:45:59.842869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5577619-a891-4d2a-9534-89e7147b0c6d admin admin] PATH_INFO: `/v3/users/da324489014b4ed7adb3529702cd5e78` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:45:59.844171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5577619-a891-4d2a-9534-89e7147b0c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=da324489014b4ed7adb3529702cd5e78)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:45:59.846382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5577619-a891-4d2a-9534-89e7147b0c6d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:45:59.994499 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:45:59.999462 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e5577619-a891-4d2a-9534-89e7147b0c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da324489014b4ed7adb3529702cd5e78'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:00.076858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e5577619-a891-4d2a-9534-89e7147b0c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da324489014b4ed7adb3529702cd5e78'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:00.077549 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e5577619-a891-4d2a-9534-89e7147b0c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da324489014b4ed7adb3529702cd5e78'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:00.086324 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e5577619-a891-4d2a-9534-89e7147b0c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da324489014b4ed7adb3529702cd5e78'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:00.100309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e5577619-a891-4d2a-9534-89e7147b0c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da324489014b4ed7adb3529702cd5e78'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:00.106380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1161/2321] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:45:59 2022] DELETE /identity/v3/users/da324489014b4ed7adb3529702cd5e78 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:46:00.334723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0801d-fe98-4685-be28-c7f346c8fe8a service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:00.345719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0801d-fe98-4685-be28-c7f346c8fe8a service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:00.411603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:00.412312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:00.412588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:00.412855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3 admin admin] PATH_INFO: `/v3/projects/c47f0d04da5a4dada0af5e26f3365c98` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:00.414016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47f0d04da5a4dada0af5e26f3365c98)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:00.415934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:00.527965 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47f0d04da5a4dada0af5e26f3365c98', 'request_id': 'req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:00.534267 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47f0d04da5a4dada0af5e26f3365c98', 'request_id': 'req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:00.539948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47f0d04da5a4dada0af5e26f3365c98', 'request_id': 'req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:00.617589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3 admin admin] The token cache is being invalidate because project c47f0d04da5a4dada0af5e26f3365c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:46:00.617786 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:00.618440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-23bbac6a-8cf0-41b2-b34a-d5339550f4a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:00.619925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1161/2322] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:46:00 2022] DELETE /identity/v3/projects/c47f0d04da5a4dada0af5e26f3365c98 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:00.632325 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e45df3-49c7-4084-aa1d-5537a8fd9f4b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:00.632616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e45df3-49c7-4084-aa1d-5537a8fd9f4b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:00.632891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e45df3-49c7-4084-aa1d-5537a8fd9f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:00.653571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-37e45df3-49c7-4084-aa1d-5537a8fd9f4b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:00.654788 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-37e45df3-49c7-4084-aa1d-5537a8fd9f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:00.724095 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1162/2323] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:00.732648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad8195-a671-4bb0-a0fb-09dd3e1aced7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:00.733199 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad8195-a671-4bb0-a0fb-09dd3e1aced7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:00.734272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad8195-a671-4bb0-a0fb-09dd3e1aced7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:00.754974 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e3ad8195-a671-4bb0-a0fb-09dd3e1aced7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:00.757064 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e3ad8195-a671-4bb0-a0fb-09dd3e1aced7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:00.766335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1162/2324] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:00.771844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e45df3-49c7-4084-aa1d-5537a8fd9f4b None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:00.782285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e45df3-49c7-4084-aa1d-5537a8fd9f4b None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:00.792836 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd00998-7b37-4761-8be4-0112b31ced00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:00.793614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd00998-7b37-4761-8be4-0112b31ced00 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:00.799373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd00998-7b37-4761-8be4-0112b31ced00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:00.799373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd00998-7b37-4761-8be4-0112b31ced00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:00.799373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd00998-7b37-4761-8be4-0112b31ced00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:46:00.799373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd00998-7b37-4761-8be4-0112b31ced00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:00.799373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd00998-7b37-4761-8be4-0112b31ced00 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:00.814071 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1163/2325] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:46:00.818970 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad8195-a671-4bb0-a0fb-09dd3e1aced7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:00.829028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad8195-a671-4bb0-a0fb-09dd3e1aced7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:00.840502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c920-fa8e-4db9-958e-9775e7251299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:00.841454 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c920-fa8e-4db9-958e-9775e7251299 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:00.842094 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c920-fa8e-4db9-958e-9775e7251299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:00.843040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c920-fa8e-4db9-958e-9775e7251299 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:00.843722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8c920-fa8e-4db9-958e-9775e7251299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:00.845846 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8c920-fa8e-4db9-958e-9775e7251299 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:00.902603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd00998-7b37-4761-8be4-0112b31ced00 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:00.904382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6dd00998-7b37-4761-8be4-0112b31ced00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:00.955831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1163/2326] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:46:00 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:00.956948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c920-fa8e-4db9-958e-9775e7251299 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:00.960949 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd00998-7b37-4761-8be4-0112b31ced00 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:01.006564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:01.012416 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8deaec-d2c5-47d4-8d09-946c0537a8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:01.013236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8deaec-d2c5-47d4-8d09-946c0537a8fa service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:01.013480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8deaec-d2c5-47d4-8d09-946c0537a8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:01.013753 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8deaec-d2c5-47d4-8d09-946c0537a8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:01.022064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ab8deaec-d2c5-47d4-8d09-946c0537a8fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:01.022220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c920-fa8e-4db9-958e-9775e7251299 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:01.025394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8deaec-d2c5-47d4-8d09-946c0537a8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:01.025530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf15ee-9d2b-4811-9da7-5e5d059b6fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:01.026138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf15ee-9d2b-4811-9da7-5e5d059b6fee admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:01.026423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf15ee-9d2b-4811-9da7-5e5d059b6fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:01.026691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf15ee-9d2b-4811-9da7-5e5d059b6fee admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:01.026951 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8deaec-d2c5-47d4-8d09-946c0537a8fa service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:01.027320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf15ee-9d2b-4811-9da7-5e5d059b6fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:01.029250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf15ee-9d2b-4811-9da7-5e5d059b6fee admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:01.035117 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1164/2327] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:46:01.144725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1164/2328] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:46:00 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:01.148897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8deaec-d2c5-47d4-8d09-946c0537a8fa service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:01.156092 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:01.160567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8deaec-d2c5-47d4-8d09-946c0537a8fa service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:01.166145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a388ea6-f956-4100-937c-17904c7f1770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:01.166748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a388ea6-f956-4100-937c-17904c7f1770 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:01.167025 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a388ea6-f956-4100-937c-17904c7f1770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:01.167303 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a388ea6-f956-4100-937c-17904c7f1770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:01.167937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a388ea6-f956-4100-937c-17904c7f1770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:01.169586 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a388ea6-f956-4100-937c-17904c7f1770 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:01.180529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1165/2329] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:46:01.184714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf15ee-9d2b-4811-9da7-5e5d059b6fee admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:01.196380 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf15ee-9d2b-4811-9da7-5e5d059b6fee admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:01.201252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33103ee4-a4df-498a-8162-7680e5a10708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:01.201861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103ee4-a4df-498a-8162-7680e5a10708 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:01.202136 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103ee4-a4df-498a-8162-7680e5a10708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:01.202520 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103ee4-a4df-498a-8162-7680e5a10708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:01.203172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33103ee4-a4df-498a-8162-7680e5a10708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:01.204775 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33103ee4-a4df-498a-8162-7680e5a10708 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:01.215155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1165/2330] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:01.219611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a388ea6-f956-4100-937c-17904c7f1770 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:01.229987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a388ea6-f956-4100-937c-17904c7f1770 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:01.234620 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9b0b6-9e7a-4b97-aa22-c8967a811e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:01.235258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9b0b6-9e7a-4b97-aa22-c8967a811e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:01.235536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9b0b6-9e7a-4b97-aa22-c8967a811e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:01.235830 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9b0b6-9e7a-4b97-aa22-c8967a811e30 admin admin] PATH_INFO: `/v3/projects/1f7fabdc918646fe824ee471b0e38f6d/users/f5c5934d2ee94b32840c31fc5c42fcd1/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:01.251000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9b0b6-9e7a-4b97-aa22-c8967a811e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7fabdc918646fe824ee471b0e38f6d, user_id=f5c5934d2ee94b32840c31fc5c42fcd1, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:01.253846 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9b0b6-9e7a-4b97-aa22-c8967a811e30 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:01.330398 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1166/2331] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:01 2022] PUT /identity/v3/projects/1f7fabdc918646fe824ee471b0e38f6d/users/f5c5934d2ee94b32840c31fc5c42fcd1/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:46:01.341909 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06f585-1ee9-415f-979b-fa7bad202705 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:01.342197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06f585-1ee9-415f-979b-fa7bad202705 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:01.342518 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06f585-1ee9-415f-979b-fa7bad202705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:01.371491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4f06f585-1ee9-415f-979b-fa7bad202705 None None] MFA Rules not processed for user `f5c5934d2ee94b32840c31fc5c42fcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:01.372706 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4f06f585-1ee9-415f-979b-fa7bad202705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:01.447930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1166/2332] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:01.459977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9b0b6-9e7a-4b97-aa22-c8967a811e30 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:01.461759 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b0f9b0b6-9e7a-4b97-aa22-c8967a811e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:01.532180 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9b0b6-9e7a-4b97-aa22-c8967a811e30 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:01.535936 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0782a6-39f1-4487-ba12-39de789b37f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:01.537464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0782a6-39f1-4487-ba12-39de789b37f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:01.538196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0782a6-39f1-4487-ba12-39de789b37f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:01.538471 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0782a6-39f1-4487-ba12-39de789b37f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:01.547748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0782a6-39f1-4487-ba12-39de789b37f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:01.549234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0782a6-39f1-4487-ba12-39de789b37f0 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:01.559998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1167/2333] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:01.585013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06f585-1ee9-415f-979b-fa7bad202705 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:01.657357 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06f585-1ee9-415f-979b-fa7bad202705 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:01.662081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62761662-243e-4f31-8848-09728be65122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:01.662765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62761662-243e-4f31-8848-09728be65122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:01.663042 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62761662-243e-4f31-8848-09728be65122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:01.663312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62761662-243e-4f31-8848-09728be65122 admin admin] PATH_INFO: `/v3/users/f5c5934d2ee94b32840c31fc5c42fcd1` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:01.664477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62761662-243e-4f31-8848-09728be65122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c5934d2ee94b32840c31fc5c42fcd1)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:01.667221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62761662-243e-4f31-8848-09728be65122 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:01.673465 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0782a6-39f1-4487-ba12-39de789b37f0 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:01.674928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8a0782a6-39f1-4487-ba12-39de789b37f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:01.750880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0782a6-39f1-4487-ba12-39de789b37f0 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:01.756663 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5eaac-9a57-49b9-a234-3d3270dfb533 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931a947711a2468baaeef701bbee60c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:01.757306 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5eaac-9a57-49b9-a234-3d3270dfb533 service placement] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:01.757589 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5eaac-9a57-49b9-a234-3d3270dfb533 service placement] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:01.757862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5eaac-9a57-49b9-a234-3d3270dfb533 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:01.759654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-40c5eaac-9a57-49b9-a234-3d3270dfb533 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:01.771935 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5eaac-9a57-49b9-a234-3d3270dfb533 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:01.775735 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5eaac-9a57-49b9-a234-3d3270dfb533 service placement] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:01.785050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1168/2334] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:01.884712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-62761662-243e-4f31-8848-09728be65122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c5934d2ee94b32840c31fc5c42fcd1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:01.892572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-62761662-243e-4f31-8848-09728be65122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c5934d2ee94b32840c31fc5c42fcd1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:01.896054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:01.907778 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-62761662-243e-4f31-8848-09728be65122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c5934d2ee94b32840c31fc5c42fcd1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:01.984343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-62761662-243e-4f31-8848-09728be65122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c5934d2ee94b32840c31fc5c42fcd1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:01.985293 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-62761662-243e-4f31-8848-09728be65122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c5934d2ee94b32840c31fc5c42fcd1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:01.992663 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1167/2335] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:46:01 2022] DELETE /identity/v3/users/f5c5934d2ee94b32840c31fc5c42fcd1 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:01.997320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb526d-534b-47bd-9879-7d0d5ea38518 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:01.997610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb526d-534b-47bd-9879-7d0d5ea38518 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:01.997890 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb526d-534b-47bd-9879-7d0d5ea38518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:02.017510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-53eb526d-534b-47bd-9879-7d0d5ea38518 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:02.018726 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-53eb526d-534b-47bd-9879-7d0d5ea38518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:02.079066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1169/2336] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:02.089271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62761662-243e-4f31-8848-09728be65122 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:02.090767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-62761662-243e-4f31-8848-09728be65122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:02.154790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62761662-243e-4f31-8848-09728be65122 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:02.161296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02008bf-fad4-403a-8c51-94d4927971d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:02.164936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02008bf-fad4-403a-8c51-94d4927971d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:02.164936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02008bf-fad4-403a-8c51-94d4927971d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:02.164936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02008bf-fad4-403a-8c51-94d4927971d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:02.173769 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02008bf-fad4-403a-8c51-94d4927971d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:02.175237 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02008bf-fad4-403a-8c51-94d4927971d6 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:02.185544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1168/2337] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:02.619493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb526d-534b-47bd-9879-7d0d5ea38518 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:02.620980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-53eb526d-534b-47bd-9879-7d0d5ea38518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:02.628771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:02.648925 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb526d-534b-47bd-9879-7d0d5ea38518 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:02.655201 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc24fdf-87d0-488e-a441-689660eec584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:02.656963 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc24fdf-87d0-488e-a441-689660eec584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:02.657438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc24fdf-87d0-488e-a441-689660eec584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:02.657808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc24fdf-87d0-488e-a441-689660eec584 admin admin] PATH_INFO: `/v3/projects/1f7fabdc918646fe824ee471b0e38f6d` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:02.659115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc24fdf-87d0-488e-a441-689660eec584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f7fabdc918646fe824ee471b0e38f6d)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:02.662257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc24fdf-87d0-488e-a441-689660eec584 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:02.783853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3bc24fdf-87d0-488e-a441-689660eec584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f7fabdc918646fe824ee471b0e38f6d', 'request_id': 'req-3bc24fdf-87d0-488e-a441-689660eec584'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:02.792933 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3bc24fdf-87d0-488e-a441-689660eec584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f7fabdc918646fe824ee471b0e38f6d', 'request_id': 'req-3bc24fdf-87d0-488e-a441-689660eec584'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:02.868601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3bc24fdf-87d0-488e-a441-689660eec584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f7fabdc918646fe824ee471b0e38f6d', 'request_id': 'req-3bc24fdf-87d0-488e-a441-689660eec584'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:02.879690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3bc24fdf-87d0-488e-a441-689660eec584 admin admin] The token cache is being invalidate because project 1f7fabdc918646fe824ee471b0e38f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:46:02.880007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3bc24fdf-87d0-488e-a441-689660eec584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:02.880669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3bc24fdf-87d0-488e-a441-689660eec584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:02.882181 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1170/2338] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:46:02 2022] DELETE /identity/v3/projects/1f7fabdc918646fe824ee471b0e38f6d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:02.887184 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d074b-5edb-4eed-b085-d5fce0fa17f5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:02.887640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d074b-5edb-4eed-b085-d5fce0fa17f5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:02.887751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d074b-5edb-4eed-b085-d5fce0fa17f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:02.907845 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-752d074b-5edb-4eed-b085-d5fce0fa17f5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:02.909161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-752d074b-5edb-4eed-b085-d5fce0fa17f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:02.970783 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1169/2339] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:02.981181 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1473a-3cdc-4474-9ddc-c9db4c2d69cf None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:02.981949 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1473a-3cdc-4474-9ddc-c9db4c2d69cf None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:02.981949 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1473a-3cdc-4474-9ddc-c9db4c2d69cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:03.003030 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c6e1473a-3cdc-4474-9ddc-c9db4c2d69cf None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:03.004180 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c6e1473a-3cdc-4474-9ddc-c9db4c2d69cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:03.012613 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1171/2340] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:03.016951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d074b-5edb-4eed-b085-d5fce0fa17f5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:03.028375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d074b-5edb-4eed-b085-d5fce0fa17f5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:03.033177 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f227627-419f-4736-9e39-290163a5effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:03.033779 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f227627-419f-4736-9e39-290163a5effa admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:03.034167 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f227627-419f-4736-9e39-290163a5effa admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:03.034440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f227627-419f-4736-9e39-290163a5effa admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:03.035108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f227627-419f-4736-9e39-290163a5effa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:46:03.035406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f227627-419f-4736-9e39-290163a5effa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:03.037726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f227627-419f-4736-9e39-290163a5effa admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:03.054541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1170/2341] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:46:03.055802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1473a-3cdc-4474-9ddc-c9db4c2d69cf None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:03.065765 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1473a-3cdc-4474-9ddc-c9db4c2d69cf None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:03.071372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705870c-6a44-4e3f-8803-bc8fbe788a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:03.072073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705870c-6a44-4e3f-8803-bc8fbe788a38 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:03.072364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705870c-6a44-4e3f-8803-bc8fbe788a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:03.072762 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705870c-6a44-4e3f-8803-bc8fbe788a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:03.073540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705870c-6a44-4e3f-8803-bc8fbe788a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:03.075532 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705870c-6a44-4e3f-8803-bc8fbe788a38 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:03.221574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f227627-419f-4736-9e39-290163a5effa admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:03.227721 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1172/2342] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:46:03 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:03.234227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f227627-419f-4736-9e39-290163a5effa admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:03.294662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea51d8-1f37-43d5-baa5-4d4657acee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:03.295268 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea51d8-1f37-43d5-baa5-4d4657acee39 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:03.295545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea51d8-1f37-43d5-baa5-4d4657acee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:03.295817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea51d8-1f37-43d5-baa5-4d4657acee39 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:03.296442 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea51d8-1f37-43d5-baa5-4d4657acee39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:03.298529 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea51d8-1f37-43d5-baa5-4d4657acee39 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:03.309515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:03.361546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1171/2343] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:46:03 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:03.365985 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705870c-6a44-4e3f-8803-bc8fbe788a38 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:03.376371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705870c-6a44-4e3f-8803-bc8fbe788a38 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:03.381431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c09f3c-4993-4004-b5b3-2cd08de6d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:03.382050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c09f3c-4993-4004-b5b3-2cd08de6d978 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:03.382358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c09f3c-4993-4004-b5b3-2cd08de6d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:03.382633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c09f3c-4993-4004-b5b3-2cd08de6d978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:03.383270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c09f3c-4993-4004-b5b3-2cd08de6d978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:03.384874 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c09f3c-4993-4004-b5b3-2cd08de6d978 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:03.394990 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1173/2344] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:03.399638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea51d8-1f37-43d5-baa5-4d4657acee39 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:03.410021 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea51d8-1f37-43d5-baa5-4d4657acee39 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:03.415951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59acf75-3634-4c10-b4d7-e9f93ae83464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:03.416566 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59acf75-3634-4c10-b4d7-e9f93ae83464 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:03.416848 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59acf75-3634-4c10-b4d7-e9f93ae83464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:03.417179 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59acf75-3634-4c10-b4d7-e9f93ae83464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:03.419699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59acf75-3634-4c10-b4d7-e9f93ae83464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:03.419699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59acf75-3634-4c10-b4d7-e9f93ae83464 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:03.434334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1172/2345] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:03.435609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c09f3c-4993-4004-b5b3-2cd08de6d978 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:03.446223 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c09f3c-4993-4004-b5b3-2cd08de6d978 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:03.450788 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44601037-acc5-4890-9110-8385b3ec43f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:03.451447 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44601037-acc5-4890-9110-8385b3ec43f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:03.451719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44601037-acc5-4890-9110-8385b3ec43f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:03.451989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44601037-acc5-4890-9110-8385b3ec43f0 admin admin] PATH_INFO: `/v3/projects/954c3d9bdbf6483985ea066767f4de1c/users/3424cdd8328147b780147909a923355c/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:03.467810 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44601037-acc5-4890-9110-8385b3ec43f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954c3d9bdbf6483985ea066767f4de1c, user_id=3424cdd8328147b780147909a923355c, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:03.470490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44601037-acc5-4890-9110-8385b3ec43f0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:03.590881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1174/2346] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:03 2022] PUT /identity/v3/projects/954c3d9bdbf6483985ea066767f4de1c/users/3424cdd8328147b780147909a923355c/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:03.601657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813b0ff-55e8-42fd-bf87-863e5340c5b7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:03.601944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813b0ff-55e8-42fd-bf87-863e5340c5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:03.602218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813b0ff-55e8-42fd-bf87-863e5340c5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:03.630289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2813b0ff-55e8-42fd-bf87-863e5340c5b7 None None] MFA Rules not processed for user `3424cdd8328147b780147909a923355c`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:03.632474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2813b0ff-55e8-42fd-bf87-863e5340c5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:03.698312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1173/2347] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:03.702926 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44601037-acc5-4890-9110-8385b3ec43f0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:03.767131 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44601037-acc5-4890-9110-8385b3ec43f0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:03.771881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54763e4c-b49a-4a07-a60f-44655360d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:03.772480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54763e4c-b49a-4a07-a60f-44655360d8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:03.772757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54763e4c-b49a-4a07-a60f-44655360d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:03.773051 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54763e4c-b49a-4a07-a60f-44655360d8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:03.773691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54763e4c-b49a-4a07-a60f-44655360d8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:03.775596 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54763e4c-b49a-4a07-a60f-44655360d8c4 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:03.847424 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1175/2348] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:46:03 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:03.851699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813b0ff-55e8-42fd-bf87-863e5340c5b7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:03.862529 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813b0ff-55e8-42fd-bf87-863e5340c5b7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:03.939422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3457f1-a5af-4127-a16c-18b6ba95cf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:03.940040 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3457f1-a5af-4127-a16c-18b6ba95cf6b admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:03.940297 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3457f1-a5af-4127-a16c-18b6ba95cf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:03.940565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3457f1-a5af-4127-a16c-18b6ba95cf6b admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:03.941233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3457f1-a5af-4127-a16c-18b6ba95cf6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:03.943767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3457f1-a5af-4127-a16c-18b6ba95cf6b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:04.032832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1174/2349] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:46:03 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:04.034072 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54763e4c-b49a-4a07-a60f-44655360d8c4 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:04.044393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54763e4c-b49a-4a07-a60f-44655360d8c4 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:04.049027 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3ec05-dbd1-4251-8032-48c6300f3392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:04.049617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ec05-dbd1-4251-8032-48c6300f3392 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:04.049891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ec05-dbd1-4251-8032-48c6300f3392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:04.050159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ec05-dbd1-4251-8032-48c6300f3392 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:04.050789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3ec05-dbd1-4251-8032-48c6300f3392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:04.053057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3ec05-dbd1-4251-8032-48c6300f3392 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:04.054295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:04.063840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1176/2350] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:04.067807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3457f1-a5af-4127-a16c-18b6ba95cf6b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:04.078836 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3457f1-a5af-4127-a16c-18b6ba95cf6b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:04.083560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f09db-16fc-4e5a-b2c2-f3c4c52e5f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:04.084586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f09db-16fc-4e5a-b2c2-f3c4c52e5f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:04.084863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f09db-16fc-4e5a-b2c2-f3c4c52e5f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:04.085170 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f09db-16fc-4e5a-b2c2-f3c4c52e5f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:04.085813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f09db-16fc-4e5a-b2c2-f3c4c52e5f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:04.087419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f09db-16fc-4e5a-b2c2-f3c4c52e5f42 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:04.097351 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1175/2351] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:04.102439 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3ec05-dbd1-4251-8032-48c6300f3392 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:04.112247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3ec05-dbd1-4251-8032-48c6300f3392 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:04.117538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfa96d-c29b-41cd-9bb0-6757ab721f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:04.118177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfa96d-c29b-41cd-9bb0-6757ab721f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:04.118451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfa96d-c29b-41cd-9bb0-6757ab721f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:04.118719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfa96d-c29b-41cd-9bb0-6757ab721f88 admin admin] PATH_INFO: `/v3/projects/58d54257b7094298b03292512033107c/users/44d7aa5a2a8548d1bd49fa308792baf7/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:04.136133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfa96d-c29b-41cd-9bb0-6757ab721f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d54257b7094298b03292512033107c, user_id=44d7aa5a2a8548d1bd49fa308792baf7, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:04.138770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfa96d-c29b-41cd-9bb0-6757ab721f88 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:04.231407 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1177/2352] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:04 2022] PUT /identity/v3/projects/58d54257b7094298b03292512033107c/users/44d7aa5a2a8548d1bd49fa308792baf7/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:46:04.243336 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab03b-53e8-48b6-ad26-e5237103de0b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:04.243615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab03b-53e8-48b6-ad26-e5237103de0b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:04.248266 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab03b-53e8-48b6-ad26-e5237103de0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:04.271978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-081ab03b-53e8-48b6-ad26-e5237103de0b None None] MFA Rules not processed for user `44d7aa5a2a8548d1bd49fa308792baf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:04.273207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-081ab03b-53e8-48b6-ad26-e5237103de0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:04.315378 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:04.337507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfa96d-c29b-41cd-9bb0-6757ab721f88 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:04.338800 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1176/2353] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:04.339190 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-abbfa96d-c29b-41cd-9bb0-6757ab721f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:04.343061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ab03b-53e8-48b6-ad26-e5237103de0b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:04.395808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfa96d-c29b-41cd-9bb0-6757ab721f88 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:04.399563 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7f0c3-6073-4c36-b9f6-8e133c5917c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:04.400303 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7f0c3-6073-4c36-b9f6-8e133c5917c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:04.400622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7f0c3-6073-4c36-b9f6-8e133c5917c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:04.400922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7f0c3-6073-4c36-b9f6-8e133c5917c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:04.402671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-43f7f0c3-6073-4c36-b9f6-8e133c5917c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:04.409723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ab03b-53e8-48b6-ad26-e5237103de0b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:04.413015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7f0c3-6073-4c36-b9f6-8e133c5917c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:04.414495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7f0c3-6073-4c36-b9f6-8e133c5917c1 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:04.415128 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7a614-9bcf-4c13-a58b-72b2de75427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:04.415754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a614-9bcf-4c13-a58b-72b2de75427b admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:04.416029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a614-9bcf-4c13-a58b-72b2de75427b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:04.416294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a614-9bcf-4c13-a58b-72b2de75427b admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:04.416917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7a614-9bcf-4c13-a58b-72b2de75427b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:04.418907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7a614-9bcf-4c13-a58b-72b2de75427b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:04.423161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1178/2354] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:46:04.489103 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1177/2355] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:46:04 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:46:04.493743 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7f0c3-6073-4c36-b9f6-8e133c5917c1 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:04.505167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7f0c3-6073-4c36-b9f6-8e133c5917c1 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:04.564854 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3868e-15dc-449b-8778-3b8cf842b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:04.565496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3868e-15dc-449b-8778-3b8cf842b1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:04.565776 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3868e-15dc-449b-8778-3b8cf842b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:04.566050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3868e-15dc-449b-8778-3b8cf842b1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:04.566684 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3868e-15dc-449b-8778-3b8cf842b1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:04.568954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3868e-15dc-449b-8778-3b8cf842b1d1 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:04.664768 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1179/2356] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:46:04 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:04.668658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7a614-9bcf-4c13-a58b-72b2de75427b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:04.679726 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7a614-9bcf-4c13-a58b-72b2de75427b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:04.684287 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13df8e-29f5-4556-bcc8-77380205facd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:04.684888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13df8e-29f5-4556-bcc8-77380205facd admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:04.685202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13df8e-29f5-4556-bcc8-77380205facd admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:04.685522 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13df8e-29f5-4556-bcc8-77380205facd admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:04.686161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13df8e-29f5-4556-bcc8-77380205facd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:04.687772 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13df8e-29f5-4556-bcc8-77380205facd admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:04.699575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1178/2357] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:04.703921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3868e-15dc-449b-8778-3b8cf842b1d1 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:04.714430 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3868e-15dc-449b-8778-3b8cf842b1d1 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:04.719170 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc826a4-2edb-4e95-b7f3-a28e0a106331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:04.719828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc826a4-2edb-4e95-b7f3-a28e0a106331 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:04.720111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc826a4-2edb-4e95-b7f3-a28e0a106331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:04.720388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc826a4-2edb-4e95-b7f3-a28e0a106331 admin admin] PATH_INFO: `/v3/projects/96f93108838d4f7e89786a30c2d18b6e/users/f2f6d5a217cb41728c5c73399b8d2e7e/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:04.735972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc826a4-2edb-4e95-b7f3-a28e0a106331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f93108838d4f7e89786a30c2d18b6e, user_id=f2f6d5a217cb41728c5c73399b8d2e7e, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:04.738649 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc826a4-2edb-4e95-b7f3-a28e0a106331 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:04.846316 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1180/2358] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:04 2022] PUT /identity/v3/projects/96f93108838d4f7e89786a30c2d18b6e/users/f2f6d5a217cb41728c5c73399b8d2e7e/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:04.850638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13df8e-29f5-4556-bcc8-77380205facd admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:04.860760 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13df8e-29f5-4556-bcc8-77380205facd admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:04.921685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617708c7-b9db-4fe2-965b-e7a08c16bcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:04.922218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617708c7-b9db-4fe2-965b-e7a08c16bcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:04.922497 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617708c7-b9db-4fe2-965b-e7a08c16bcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:04.922808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617708c7-b9db-4fe2-965b-e7a08c16bcb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:04.923456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617708c7-b9db-4fe2-965b-e7a08c16bcb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:04.925165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617708c7-b9db-4fe2-965b-e7a08c16bcb7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:04.940767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1179/2359] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:04.945058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc826a4-2edb-4e95-b7f3-a28e0a106331 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:04.956554 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc826a4-2edb-4e95-b7f3-a28e0a106331 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:04.961696 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed964f00-92c9-453b-9573-4de072dcaee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:04.962372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed964f00-92c9-453b-9573-4de072dcaee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:04.962651 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed964f00-92c9-453b-9573-4de072dcaee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:04.962922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed964f00-92c9-453b-9573-4de072dcaee2 admin admin] PATH_INFO: `/v3/projects/96f93108838d4f7e89786a30c2d18b6e/users/f2f6d5a217cb41728c5c73399b8d2e7e/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:04.964835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed964f00-92c9-453b-9573-4de072dcaee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f93108838d4f7e89786a30c2d18b6e, user_id=f2f6d5a217cb41728c5c73399b8d2e7e, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:04.967616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed964f00-92c9-453b-9573-4de072dcaee2 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:04.979772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1181/2360] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:04 2022] PUT /identity/v3/projects/96f93108838d4f7e89786a30c2d18b6e/users/f2f6d5a217cb41728c5c73399b8d2e7e/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:46:04.991140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492632e-bfa9-4927-94b8-ccbfae9136c2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:04.991553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492632e-bfa9-4927-94b8-ccbfae9136c2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:04.991833 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492632e-bfa9-4927-94b8-ccbfae9136c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:05.022387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f492632e-bfa9-4927-94b8-ccbfae9136c2 None None] MFA Rules not processed for user `f2f6d5a217cb41728c5c73399b8d2e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:05.023352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f492632e-bfa9-4927-94b8-ccbfae9136c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:05.071546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:05.107951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1180/2361] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:05.116446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed964f00-92c9-453b-9573-4de072dcaee2 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:05.118263 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ed964f00-92c9-453b-9573-4de072dcaee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:05.152263 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:05.188917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed964f00-92c9-453b-9573-4de072dcaee2 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:05.192691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cf6fa-4d20-498a-b768-0bcd326a9e72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:05.193366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cf6fa-4d20-498a-b768-0bcd326a9e72 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:05.193644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cf6fa-4d20-498a-b768-0bcd326a9e72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:05.194025 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cf6fa-4d20-498a-b768-0bcd326a9e72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:05.254608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463cf6fa-4d20-498a-b768-0bcd326a9e72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:05.256196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463cf6fa-4d20-498a-b768-0bcd326a9e72 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:05.265631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1182/2362] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:07.180524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492632e-bfa9-4927-94b8-ccbfae9136c2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:07.182025 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f492632e-bfa9-4927-94b8-ccbfae9136c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:07.193695 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492632e-bfa9-4927-94b8-ccbfae9136c2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:07.198114 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df04eb-2711-49fb-b881-993be840cd7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:07.198721 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df04eb-2711-49fb-b881-993be840cd7a service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:07.198999 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df04eb-2711-49fb-b881-993be840cd7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:07.199294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df04eb-2711-49fb-b881-993be840cd7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:07.255266 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df04eb-2711-49fb-b881-993be840cd7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:07.256753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df04eb-2711-49fb-b881-993be840cd7a service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:07.267043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1181/2363] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:08.770704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cf6fa-4d20-498a-b768-0bcd326a9e72 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:08.780001 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cf6fa-4d20-498a-b768-0bcd326a9e72 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:08.783843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38020f1f-77ab-49f1-8187-abe96399fdd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:08.784148 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38020f1f-77ab-49f1-8187-abe96399fdd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:08.784424 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38020f1f-77ab-49f1-8187-abe96399fdd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:08.784696 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38020f1f-77ab-49f1-8187-abe96399fdd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:08.794082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38020f1f-77ab-49f1-8187-abe96399fdd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:08.795467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38020f1f-77ab-49f1-8187-abe96399fdd9 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:08.804662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1183/2364] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:09.283171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df04eb-2711-49fb-b881-993be840cd7a service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:09.284808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d2df04eb-2711-49fb-b881-993be840cd7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:09.363486 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df04eb-2711-49fb-b881-993be840cd7a service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:09.369771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf942a-1976-4608-a1c8-6e83b54a88c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:09.370384 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf942a-1976-4608-a1c8-6e83b54a88c2 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:09.370703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf942a-1976-4608-a1c8-6e83b54a88c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:09.371052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf942a-1976-4608-a1c8-6e83b54a88c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:09.372733 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e2cf942a-1976-4608-a1c8-6e83b54a88c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:09.432309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf942a-1976-4608-a1c8-6e83b54a88c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:09.433968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf942a-1976-4608-a1c8-6e83b54a88c2 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:09.444145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1182/2365] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:11.938393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38020f1f-77ab-49f1-8187-abe96399fdd9 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:11.954103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38020f1f-77ab-49f1-8187-abe96399fdd9 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:11.963057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbb480-d1ab-4906-afe6-6c9690bcd921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:11.963057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbb480-d1ab-4906-afe6-6c9690bcd921 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:11.963057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbb480-d1ab-4906-afe6-6c9690bcd921 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:11.963057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbb480-d1ab-4906-afe6-6c9690bcd921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:11.963448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b3dbb480-d1ab-4906-afe6-6c9690bcd921 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:12.023277 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbb480-d1ab-4906-afe6-6c9690bcd921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:12.024886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbb480-d1ab-4906-afe6-6c9690bcd921 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:12.033951 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1184/2366] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:13.332651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf942a-1976-4608-a1c8-6e83b54a88c2 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:13.347299 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:13.396404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf942a-1976-4608-a1c8-6e83b54a88c2 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:13.402212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a19ae0-0cce-41da-83cd-e6a627c318e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:13.402837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a19ae0-0cce-41da-83cd-e6a627c318e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:13.403114 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a19ae0-0cce-41da-83cd-e6a627c318e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:13.403387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a19ae0-0cce-41da-83cd-e6a627c318e2 admin admin] PATH_INFO: `/v3/users/3424cdd8328147b780147909a923355c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:13.404525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a19ae0-0cce-41da-83cd-e6a627c318e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3424cdd8328147b780147909a923355c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:13.406477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a19ae0-0cce-41da-83cd-e6a627c318e2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:13.600552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d4a19ae0-0cce-41da-83cd-e6a627c318e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3424cdd8328147b780147909a923355c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:13.608880 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d4a19ae0-0cce-41da-83cd-e6a627c318e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3424cdd8328147b780147909a923355c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:13.623728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d4a19ae0-0cce-41da-83cd-e6a627c318e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3424cdd8328147b780147909a923355c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:13.688692 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d4a19ae0-0cce-41da-83cd-e6a627c318e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3424cdd8328147b780147909a923355c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:13.689556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d4a19ae0-0cce-41da-83cd-e6a627c318e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3424cdd8328147b780147909a923355c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:13.699229 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1183/2367] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:46:13 2022] DELETE /identity/v3/users/3424cdd8328147b780147909a923355c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:13.703712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d8131-23e4-4cad-9823-97874652ae34 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:13.704280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d8131-23e4-4cad-9823-97874652ae34 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:13.704280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d8131-23e4-4cad-9823-97874652ae34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:13.723691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-5f0d8131-23e4-4cad-9823-97874652ae34 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:13.724901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5f0d8131-23e4-4cad-9823-97874652ae34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:13.798798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1185/2368] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:13.800336 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a19ae0-0cce-41da-83cd-e6a627c318e2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:13.801846 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d4a19ae0-0cce-41da-83cd-e6a627c318e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:13.867271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a19ae0-0cce-41da-83cd-e6a627c318e2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:13.871734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d99394-f0e1-4471-bac5-2914424dc060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:13.872348 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d99394-f0e1-4471-bac5-2914424dc060 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:13.872652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d99394-f0e1-4471-bac5-2914424dc060 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:13.872880 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d99394-f0e1-4471-bac5-2914424dc060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:13.882073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d99394-f0e1-4471-bac5-2914424dc060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:13.883524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d99394-f0e1-4471-bac5-2914424dc060 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:13.893191 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1184/2369] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:14.291305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d8131-23e4-4cad-9823-97874652ae34 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:14.292858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5f0d8131-23e4-4cad-9823-97874652ae34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:14.304972 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d8131-23e4-4cad-9823-97874652ae34 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:14.309941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:14.310579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:14.310881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:14.311932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] PATH_INFO: `/v3/projects/954c3d9bdbf6483985ea066767f4de1c` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:14.312472 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] RBAC: Authorizing `identity:delete_project(project_id=954c3d9bdbf6483985ea066767f4de1c)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:14.315343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:14.317550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:14.437458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954c3d9bdbf6483985ea066767f4de1c', 'request_id': 'req-9d81352d-2f0e-4132-8e0d-7346d4f8972a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:14.443699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954c3d9bdbf6483985ea066767f4de1c', 'request_id': 'req-9d81352d-2f0e-4132-8e0d-7346d4f8972a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:14.505665 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954c3d9bdbf6483985ea066767f4de1c', 'request_id': 'req-9d81352d-2f0e-4132-8e0d-7346d4f8972a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:14.517660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] The token cache is being invalidate because project 954c3d9bdbf6483985ea066767f4de1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:46:14.518086 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:14.518788 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:14.520465 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1186/2370] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:46:14 2022] DELETE /identity/v3/projects/954c3d9bdbf6483985ea066767f4de1c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:14.524595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d99394-f0e1-4471-bac5-2914424dc060 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:14.535145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d99394-f0e1-4471-bac5-2914424dc060 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:14.567709 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:14.592842 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e2f87-8084-4ae7-a85f-b1ba97e218f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:14.593496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e2f87-8084-4ae7-a85f-b1ba97e218f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:14.593770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e2f87-8084-4ae7-a85f-b1ba97e218f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:14.594041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e2f87-8084-4ae7-a85f-b1ba97e218f6 admin admin] PATH_INFO: `/v3/users/44d7aa5a2a8548d1bd49fa308792baf7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:14.595151 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e2f87-8084-4ae7-a85f-b1ba97e218f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d7aa5a2a8548d1bd49fa308792baf7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:14.597212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e2f87-8084-4ae7-a85f-b1ba97e218f6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:14.795354 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-267e2f87-8084-4ae7-a85f-b1ba97e218f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d7aa5a2a8548d1bd49fa308792baf7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:14.804503 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-267e2f87-8084-4ae7-a85f-b1ba97e218f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d7aa5a2a8548d1bd49fa308792baf7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:14.816677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-267e2f87-8084-4ae7-a85f-b1ba97e218f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d7aa5a2a8548d1bd49fa308792baf7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:14.881282 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-267e2f87-8084-4ae7-a85f-b1ba97e218f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d7aa5a2a8548d1bd49fa308792baf7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:14.882148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-267e2f87-8084-4ae7-a85f-b1ba97e218f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d7aa5a2a8548d1bd49fa308792baf7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:14.890182 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1185/2371] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:46:14 2022] DELETE /identity/v3/users/44d7aa5a2a8548d1bd49fa308792baf7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:15.334755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:15.336458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:15.350232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81352d-2f0e-4132-8e0d-7346d4f8972a admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:15.407261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:15.407883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:15.408160 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:15.408431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] PATH_INFO: `/v3/projects/58d54257b7094298b03292512033107c` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:15.409582 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d54257b7094298b03292512033107c)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:15.411519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:15.517470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d54257b7094298b03292512033107c', 'request_id': 'req-790a763a-8cb6-446f-bcb7-105240a59c1a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:15.524133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d54257b7094298b03292512033107c', 'request_id': 'req-790a763a-8cb6-446f-bcb7-105240a59c1a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:15.591450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d54257b7094298b03292512033107c', 'request_id': 'req-790a763a-8cb6-446f-bcb7-105240a59c1a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:15.602632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] The token cache is being invalidate because project 58d54257b7094298b03292512033107c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:46:15.602902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:15.603571 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:15.605738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1187/2372] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:46:15 2022] DELETE /identity/v3/projects/58d54257b7094298b03292512033107c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:15.609793 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e2f87-8084-4ae7-a85f-b1ba97e218f6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:15.611230 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-267e2f87-8084-4ae7-a85f-b1ba97e218f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:15.624451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e2f87-8084-4ae7-a85f-b1ba97e218f6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:15.681225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dff13-8254-41a1-a5bf-85b0f2f911f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:15.681858 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dff13-8254-41a1-a5bf-85b0f2f911f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:15.682157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dff13-8254-41a1-a5bf-85b0f2f911f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:15.682693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dff13-8254-41a1-a5bf-85b0f2f911f2 admin admin] PATH_INFO: `/v3/users/f2f6d5a217cb41728c5c73399b8d2e7e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:15.683981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dff13-8254-41a1-a5bf-85b0f2f911f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f6d5a217cb41728c5c73399b8d2e7e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:15.686052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dff13-8254-41a1-a5bf-85b0f2f911f2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:15.851157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3c2dff13-8254-41a1-a5bf-85b0f2f911f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f6d5a217cb41728c5c73399b8d2e7e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:15.858975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3c2dff13-8254-41a1-a5bf-85b0f2f911f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f6d5a217cb41728c5c73399b8d2e7e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:15.860189 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:15.871864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3c2dff13-8254-41a1-a5bf-85b0f2f911f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f6d5a217cb41728c5c73399b8d2e7e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:15.922714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3c2dff13-8254-41a1-a5bf-85b0f2f911f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f6d5a217cb41728c5c73399b8d2e7e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:15.923341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3c2dff13-8254-41a1-a5bf-85b0f2f911f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f6d5a217cb41728c5c73399b8d2e7e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:15.929467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1186/2373] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:46:15 2022] DELETE /identity/v3/users/f2f6d5a217cb41728c5c73399b8d2e7e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:16.370619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:16.372053 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:16.388466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a763a-8cb6-446f-bcb7-105240a59c1a admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:16.411617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:16.453833 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d551c-35fd-4bde-ba90-ff2733fc8641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:16.454464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d551c-35fd-4bde-ba90-ff2733fc8641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:16.454742 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d551c-35fd-4bde-ba90-ff2733fc8641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:16.455010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d551c-35fd-4bde-ba90-ff2733fc8641 admin admin] PATH_INFO: `/v3/projects/96f93108838d4f7e89786a30c2d18b6e` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:16.456109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d551c-35fd-4bde-ba90-ff2733fc8641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f93108838d4f7e89786a30c2d18b6e)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:16.458106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d551c-35fd-4bde-ba90-ff2733fc8641 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:16.591185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4d7d551c-35fd-4bde-ba90-ff2733fc8641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f93108838d4f7e89786a30c2d18b6e', 'request_id': 'req-4d7d551c-35fd-4bde-ba90-ff2733fc8641'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:16.597363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4d7d551c-35fd-4bde-ba90-ff2733fc8641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f93108838d4f7e89786a30c2d18b6e', 'request_id': 'req-4d7d551c-35fd-4bde-ba90-ff2733fc8641'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:16.658567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4d7d551c-35fd-4bde-ba90-ff2733fc8641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f93108838d4f7e89786a30c2d18b6e', 'request_id': 'req-4d7d551c-35fd-4bde-ba90-ff2733fc8641'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:16.669367 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4d7d551c-35fd-4bde-ba90-ff2733fc8641 admin admin] The token cache is being invalidate because project 96f93108838d4f7e89786a30c2d18b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:46:16.669654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4d7d551c-35fd-4bde-ba90-ff2733fc8641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:16.670328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4d7d551c-35fd-4bde-ba90-ff2733fc8641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:16.671904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1188/2374] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:46:16 2022] DELETE /identity/v3/projects/96f93108838d4f7e89786a30c2d18b6e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:16.676870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08564d4-a293-4f33-9aef-ee67930b9828 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:16.677387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08564d4-a293-4f33-9aef-ee67930b9828 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:16.677484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08564d4-a293-4f33-9aef-ee67930b9828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:16.697193 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d08564d4-a293-4f33-9aef-ee67930b9828 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:16.699034 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d08564d4-a293-4f33-9aef-ee67930b9828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:16.761549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1187/2375] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:16.769787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e33f0-b141-4f94-9f49-a75f408f3394 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:16.770068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e33f0-b141-4f94-9f49-a75f408f3394 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:16.770341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e33f0-b141-4f94-9f49-a75f408f3394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:16.791056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-9b6e33f0-b141-4f94-9f49-a75f408f3394 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:16.792840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9b6e33f0-b141-4f94-9f49-a75f408f3394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:16.800705 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1189/2376] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:16.805105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08564d4-a293-4f33-9aef-ee67930b9828 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:16.815031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08564d4-a293-4f33-9aef-ee67930b9828 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:16.819905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c654ff2-f979-41ed-9fa8-1dedd6ec7a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:16.820512 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c654ff2-f979-41ed-9fa8-1dedd6ec7a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:16.820794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c654ff2-f979-41ed-9fa8-1dedd6ec7a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:16.821100 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c654ff2-f979-41ed-9fa8-1dedd6ec7a64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:16.821751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c654ff2-f979-41ed-9fa8-1dedd6ec7a64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:46:16.822056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c654ff2-f979-41ed-9fa8-1dedd6ec7a64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:16.824347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c654ff2-f979-41ed-9fa8-1dedd6ec7a64 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:16.836449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1188/2377] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:46:16.841765 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e33f0-b141-4f94-9f49-a75f408f3394 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:16.852064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e33f0-b141-4f94-9f49-a75f408f3394 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:16.857303 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646181e0-5b86-49c3-99a9-0f78e0d338f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:16.857899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646181e0-5b86-49c3-99a9-0f78e0d338f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:16.858176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646181e0-5b86-49c3-99a9-0f78e0d338f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:16.858446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646181e0-5b86-49c3-99a9-0f78e0d338f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:16.859079 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646181e0-5b86-49c3-99a9-0f78e0d338f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:16.860975 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646181e0-5b86-49c3-99a9-0f78e0d338f1 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:16.987856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1190/2378] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:46:16 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:16.992127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c654ff2-f979-41ed-9fa8-1dedd6ec7a64 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:17.002408 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c654ff2-f979-41ed-9fa8-1dedd6ec7a64 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:17.059186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc43704-548d-4ad9-9ee9-07aa175d7e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:17.059793 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc43704-548d-4ad9-9ee9-07aa175d7e40 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:17.060071 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc43704-548d-4ad9-9ee9-07aa175d7e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:17.060339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc43704-548d-4ad9-9ee9-07aa175d7e40 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:17.060967 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc43704-548d-4ad9-9ee9-07aa175d7e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:17.062916 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc43704-548d-4ad9-9ee9-07aa175d7e40 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:17.161429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1189/2379] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:46:16 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:17.164685 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646181e0-5b86-49c3-99a9-0f78e0d338f1 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:17.176468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646181e0-5b86-49c3-99a9-0f78e0d338f1 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:17.181378 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b8d37-e64e-40cc-a3af-39853174db46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:17.181981 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b8d37-e64e-40cc-a3af-39853174db46 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:17.182259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b8d37-e64e-40cc-a3af-39853174db46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:17.182558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b8d37-e64e-40cc-a3af-39853174db46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:17.183305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b8d37-e64e-40cc-a3af-39853174db46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:17.185064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b8d37-e64e-40cc-a3af-39853174db46 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:17.195597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1191/2380] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:17.199853 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc43704-548d-4ad9-9ee9-07aa175d7e40 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:17.210147 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc43704-548d-4ad9-9ee9-07aa175d7e40 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:17.215994 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ab0f1-83a6-4a3f-82b3-a1e68692238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:17.218079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ab0f1-83a6-4a3f-82b3-a1e68692238c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:17.218079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ab0f1-83a6-4a3f-82b3-a1e68692238c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:17.218079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ab0f1-83a6-4a3f-82b3-a1e68692238c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:17.218079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ab0f1-83a6-4a3f-82b3-a1e68692238c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:17.219667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ab0f1-83a6-4a3f-82b3-a1e68692238c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:17.231383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1190/2381] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:17.235621 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b8d37-e64e-40cc-a3af-39853174db46 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:17.246102 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b8d37-e64e-40cc-a3af-39853174db46 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:17.252069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961395a-0a99-451f-9750-d7ca342c8f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:17.252855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961395a-0a99-451f-9750-d7ca342c8f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:17.253166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961395a-0a99-451f-9750-d7ca342c8f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:17.253593 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961395a-0a99-451f-9750-d7ca342c8f5a admin admin] PATH_INFO: `/v3/projects/2d0aaecd4bd7417387844d601adbc2be/users/392817b446f74dee932a85dabba8d9e7/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:17.272319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961395a-0a99-451f-9750-d7ca342c8f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0aaecd4bd7417387844d601adbc2be, user_id=392817b446f74dee932a85dabba8d9e7, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:17.275019 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961395a-0a99-451f-9750-d7ca342c8f5a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:17.397800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1192/2382] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:17 2022] PUT /identity/v3/projects/2d0aaecd4bd7417387844d601adbc2be/users/392817b446f74dee932a85dabba8d9e7/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:17.409575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8a6b1-ff30-47f1-9dfe-617d2c6eb9a2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:17.409877 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8a6b1-ff30-47f1-9dfe-617d2c6eb9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:17.410134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8a6b1-ff30-47f1-9dfe-617d2c6eb9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:17.439765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-46e8a6b1-ff30-47f1-9dfe-617d2c6eb9a2 None None] MFA Rules not processed for user `392817b446f74dee932a85dabba8d9e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:17.440909 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-46e8a6b1-ff30-47f1-9dfe-617d2c6eb9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:17.471146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:17.506490 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1191/2383] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:17.511011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961395a-0a99-451f-9750-d7ca342c8f5a admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:17.570360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:17.584924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961395a-0a99-451f-9750-d7ca342c8f5a admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:17.591247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96305717-ea19-4684-bb3f-2feee1927a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:17.591849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96305717-ea19-4684-bb3f-2feee1927a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:17.592120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96305717-ea19-4684-bb3f-2feee1927a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:17.592433 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96305717-ea19-4684-bb3f-2feee1927a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:17.600878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96305717-ea19-4684-bb3f-2feee1927a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:17.600878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96305717-ea19-4684-bb3f-2feee1927a0f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:17.730925 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1193/2384] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:46:17 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:17.735047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8a6b1-ff30-47f1-9dfe-617d2c6eb9a2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:17.745571 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8a6b1-ff30-47f1-9dfe-617d2c6eb9a2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:17.800401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556173fe-4a24-41c9-b727-54fe521fb684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:17.821883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556173fe-4a24-41c9-b727-54fe521fb684 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:17.821883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556173fe-4a24-41c9-b727-54fe521fb684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:17.821883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556173fe-4a24-41c9-b727-54fe521fb684 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:17.821883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556173fe-4a24-41c9-b727-54fe521fb684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:17.821883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556173fe-4a24-41c9-b727-54fe521fb684 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:17.918191 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1192/2385] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:46:17 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:17.922225 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96305717-ea19-4684-bb3f-2feee1927a0f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:17.932305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96305717-ea19-4684-bb3f-2feee1927a0f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:17.937483 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7825c1-463c-4cb2-ba2a-d7e13adac0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:17.938074 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7825c1-463c-4cb2-ba2a-d7e13adac0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:17.938355 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7825c1-463c-4cb2-ba2a-d7e13adac0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:17.938626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7825c1-463c-4cb2-ba2a-d7e13adac0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:17.939267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7825c1-463c-4cb2-ba2a-d7e13adac0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:17.940872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7825c1-463c-4cb2-ba2a-d7e13adac0e0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:17.951450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1194/2386] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:17.955313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556173fe-4a24-41c9-b727-54fe521fb684 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:17.965553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556173fe-4a24-41c9-b727-54fe521fb684 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:17.970116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa8708-b35f-47da-8875-f3d19dc9f80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:17.970700 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa8708-b35f-47da-8875-f3d19dc9f80c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:17.970979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa8708-b35f-47da-8875-f3d19dc9f80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:17.971247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa8708-b35f-47da-8875-f3d19dc9f80c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:17.971878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa8708-b35f-47da-8875-f3d19dc9f80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:17.973579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa8708-b35f-47da-8875-f3d19dc9f80c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:17.983484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1193/2387] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:17.987475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7825c1-463c-4cb2-ba2a-d7e13adac0e0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:17.997821 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7825c1-463c-4cb2-ba2a-d7e13adac0e0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:18.002271 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31882586-2dc7-4108-8646-6f6ed6a76588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:18.002905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31882586-2dc7-4108-8646-6f6ed6a76588 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:18.003180 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31882586-2dc7-4108-8646-6f6ed6a76588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:18.003449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31882586-2dc7-4108-8646-6f6ed6a76588 admin admin] PATH_INFO: `/v3/projects/0bd6c95465d34a038311ae13f73edfff/users/9a19fd3be2e749da97ded5e791719646/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:18.018250 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31882586-2dc7-4108-8646-6f6ed6a76588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd6c95465d34a038311ae13f73edfff, user_id=9a19fd3be2e749da97ded5e791719646, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:18.020948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31882586-2dc7-4108-8646-6f6ed6a76588 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:18.203948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1195/2388] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:17 2022] PUT /identity/v3/projects/0bd6c95465d34a038311ae13f73edfff/users/9a19fd3be2e749da97ded5e791719646/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:46:18.213675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ea2b-755d-4c75-a49d-0eed958eeed0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:18.214629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ea2b-755d-4c75-a49d-0eed958eeed0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:18.214912 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ea2b-755d-4c75-a49d-0eed958eeed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:18.242633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6ee6ea2b-755d-4c75-a49d-0eed958eeed0 None None] MFA Rules not processed for user `9a19fd3be2e749da97ded5e791719646`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:18.243822 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6ee6ea2b-755d-4c75-a49d-0eed958eeed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:18.308750 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1194/2389] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:18.313343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31882586-2dc7-4108-8646-6f6ed6a76588 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:18.376676 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31882586-2dc7-4108-8646-6f6ed6a76588 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:18.381427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1593d-7b86-4e2a-bf24-b3d0b0c5e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:18.382105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1593d-7b86-4e2a-bf24-b3d0b0c5e1ca admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:18.382452 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1593d-7b86-4e2a-bf24-b3d0b0c5e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:18.382791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1593d-7b86-4e2a-bf24-b3d0b0c5e1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:18.383495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1593d-7b86-4e2a-bf24-b3d0b0c5e1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:18.385478 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1593d-7b86-4e2a-bf24-b3d0b0c5e1ca admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:18.524745 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1196/2390] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:46:18 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:18.528954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6ea2b-755d-4c75-a49d-0eed958eeed0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:18.540304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6ea2b-755d-4c75-a49d-0eed958eeed0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:18.576398 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:18.598807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b061479-16a8-45be-8bfc-82e660cd7117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:18.599412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b061479-16a8-45be-8bfc-82e660cd7117 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:18.599689 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b061479-16a8-45be-8bfc-82e660cd7117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:18.599961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b061479-16a8-45be-8bfc-82e660cd7117 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:18.600599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b061479-16a8-45be-8bfc-82e660cd7117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:18.602559 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b061479-16a8-45be-8bfc-82e660cd7117 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:18.722973 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1195/2391] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:46:18 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:18.724381 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1593d-7b86-4e2a-bf24-b3d0b0c5e1ca admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:18.735465 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1593d-7b86-4e2a-bf24-b3d0b0c5e1ca admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:18.740506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c05aa-195b-426f-8b3b-a306ee496d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:18.743994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c05aa-195b-426f-8b3b-a306ee496d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:18.743994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c05aa-195b-426f-8b3b-a306ee496d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:18.743994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c05aa-195b-426f-8b3b-a306ee496d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:18.743994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c05aa-195b-426f-8b3b-a306ee496d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:18.743994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c05aa-195b-426f-8b3b-a306ee496d3b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:18.757679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1197/2392] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:18.758916 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b061479-16a8-45be-8bfc-82e660cd7117 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:18.769998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b061479-16a8-45be-8bfc-82e660cd7117 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:18.774732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0002c3-051f-4c91-b533-e90362ea4ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:18.775525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0002c3-051f-4c91-b533-e90362ea4ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:18.775727 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0002c3-051f-4c91-b533-e90362ea4ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:18.776071 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0002c3-051f-4c91-b533-e90362ea4ba9 admin admin] PATH_INFO: `/v3/projects/6101193000c14e8eb07574e63de64e12/users/be98c0e2e9c1472b9ebc6f0f892bebb5/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:18.793330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0002c3-051f-4c91-b533-e90362ea4ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6101193000c14e8eb07574e63de64e12, user_id=be98c0e2e9c1472b9ebc6f0f892bebb5, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:18.796567 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0002c3-051f-4c91-b533-e90362ea4ba9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:18.894794 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1196/2393] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:18 2022] PUT /identity/v3/projects/6101193000c14e8eb07574e63de64e12/users/be98c0e2e9c1472b9ebc6f0f892bebb5/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:18.898840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c05aa-195b-426f-8b3b-a306ee496d3b admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:18.909591 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c05aa-195b-426f-8b3b-a306ee496d3b admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:18.972609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f00a0e-be91-48a1-b2df-6017f51d956e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:18.973159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f00a0e-be91-48a1-b2df-6017f51d956e admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:18.973433 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f00a0e-be91-48a1-b2df-6017f51d956e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:18.973704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f00a0e-be91-48a1-b2df-6017f51d956e admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:18.974336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f00a0e-be91-48a1-b2df-6017f51d956e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:18.975921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f00a0e-be91-48a1-b2df-6017f51d956e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:18.986405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1198/2394] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:18.990718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0002c3-051f-4c91-b533-e90362ea4ba9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:19.001362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0002c3-051f-4c91-b533-e90362ea4ba9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:19.006319 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad766962-bce9-4c5f-a47e-35066348b9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:19.006976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad766962-bce9-4c5f-a47e-35066348b9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:19.007563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad766962-bce9-4c5f-a47e-35066348b9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:19.007563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad766962-bce9-4c5f-a47e-35066348b9ac admin admin] PATH_INFO: `/v3/projects/6101193000c14e8eb07574e63de64e12/users/be98c0e2e9c1472b9ebc6f0f892bebb5/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:19.009618 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad766962-bce9-4c5f-a47e-35066348b9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6101193000c14e8eb07574e63de64e12, user_id=be98c0e2e9c1472b9ebc6f0f892bebb5, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:19.012830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad766962-bce9-4c5f-a47e-35066348b9ac admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:19.023912 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1197/2395] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:18 2022] PUT /identity/v3/projects/6101193000c14e8eb07574e63de64e12/users/be98c0e2e9c1472b9ebc6f0f892bebb5/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:19.036092 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66b28e-6ed3-4dc4-9866-01107c0d3cfa None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:19.036380 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66b28e-6ed3-4dc4-9866-01107c0d3cfa None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:19.036658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66b28e-6ed3-4dc4-9866-01107c0d3cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:19.051122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:19.065720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-5c66b28e-6ed3-4dc4-9866-01107c0d3cfa None None] MFA Rules not processed for user `be98c0e2e9c1472b9ebc6f0f892bebb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:19.066942 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5c66b28e-6ed3-4dc4-9866-01107c0d3cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:19.135450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1199/2396] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:46:19.147416 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad766962-bce9-4c5f-a47e-35066348b9ac admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:19.149288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ad766962-bce9-4c5f-a47e-35066348b9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:19.208026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad766962-bce9-4c5f-a47e-35066348b9ac admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:19.211906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d864c-0f90-47f7-8d06-0f3029bb4d8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:19.212498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d864c-0f90-47f7-8d06-0f3029bb4d8b service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:19.212770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d864c-0f90-47f7-8d06-0f3029bb4d8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:19.213062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d864c-0f90-47f7-8d06-0f3029bb4d8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:19.270242 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d864c-0f90-47f7-8d06-0f3029bb4d8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:19.271615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d864c-0f90-47f7-8d06-0f3029bb4d8b service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:19.281540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1198/2397] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:21.420372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66b28e-6ed3-4dc4-9866-01107c0d3cfa None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:21.429689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66b28e-6ed3-4dc4-9866-01107c0d3cfa None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:21.433244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cde2fa-20db-4957-84ff-79901c6793b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:21.433833 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cde2fa-20db-4957-84ff-79901c6793b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:21.434107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cde2fa-20db-4957-84ff-79901c6793b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:21.434377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cde2fa-20db-4957-84ff-79901c6793b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:21.491251 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cde2fa-20db-4957-84ff-79901c6793b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:21.492685 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cde2fa-20db-4957-84ff-79901c6793b6 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:21.501938 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1200/2398] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:23.307182 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d864c-0f90-47f7-8d06-0f3029bb4d8b service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:23.316767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d864c-0f90-47f7-8d06-0f3029bb4d8b service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:23.320463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e2eee-b759-4e9b-93da-7dd7836e753a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:23.322241 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2eee-b759-4e9b-93da-7dd7836e753a service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:23.322241 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2eee-b759-4e9b-93da-7dd7836e753a service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:23.322241 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2eee-b759-4e9b-93da-7dd7836e753a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:23.331576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e2eee-b759-4e9b-93da-7dd7836e753a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:23.333016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e2eee-b759-4e9b-93da-7dd7836e753a service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:23.342939 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1199/2399] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:28.093644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cde2fa-20db-4957-84ff-79901c6793b6 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:28.155575 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cde2fa-20db-4957-84ff-79901c6793b6 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:28.160061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d80ed-10b6-4b96-9506-fdf65d3c85ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:28.160688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d80ed-10b6-4b96-9506-fdf65d3c85ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:28.160968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d80ed-10b6-4b96-9506-fdf65d3c85ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:28.161268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d80ed-10b6-4b96-9506-fdf65d3c85ce admin admin] PATH_INFO: `/v3/users/392817b446f74dee932a85dabba8d9e7` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:28.162911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d80ed-10b6-4b96-9506-fdf65d3c85ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=392817b446f74dee932a85dabba8d9e7)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:28.164816 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d80ed-10b6-4b96-9506-fdf65d3c85ce admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:28.350733 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:28.364362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-218d80ed-10b6-4b96-9506-fdf65d3c85ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392817b446f74dee932a85dabba8d9e7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:28.479382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-218d80ed-10b6-4b96-9506-fdf65d3c85ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392817b446f74dee932a85dabba8d9e7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:28.480393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-218d80ed-10b6-4b96-9506-fdf65d3c85ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392817b446f74dee932a85dabba8d9e7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:28.488377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-218d80ed-10b6-4b96-9506-fdf65d3c85ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392817b446f74dee932a85dabba8d9e7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:28.502349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-218d80ed-10b6-4b96-9506-fdf65d3c85ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392817b446f74dee932a85dabba8d9e7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:28.512600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1201/2400] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:46:28 2022] DELETE /identity/v3/users/392817b446f74dee932a85dabba8d9e7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:28.516877 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c82f-6abb-4365-9982-063954929ecb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:28.517378 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c82f-6abb-4365-9982-063954929ecb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:28.517471 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c82f-6abb-4365-9982-063954929ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:28.544222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9d40c82f-6abb-4365-9982-063954929ecb None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:28.545528 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9d40c82f-6abb-4365-9982-063954929ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:28.579449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:28.624078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1200/2401] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:46:28.636273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d80ed-10b6-4b96-9506-fdf65d3c85ce admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:28.637834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-218d80ed-10b6-4b96-9506-fdf65d3c85ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:28.702449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d80ed-10b6-4b96-9506-fdf65d3c85ce admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:28.707018 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8142-fcf7-4ce0-bb35-63db8056de5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:28.707632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8142-fcf7-4ce0-bb35-63db8056de5c service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:28.714012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8142-fcf7-4ce0-bb35-63db8056de5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:28.714012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8142-fcf7-4ce0-bb35-63db8056de5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:28.719326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b8142-fcf7-4ce0-bb35-63db8056de5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:28.720802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b8142-fcf7-4ce0-bb35-63db8056de5c service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:28.732065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1202/2402] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:46:29.235982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40c82f-6abb-4365-9982-063954929ecb None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:29.238945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9d40c82f-6abb-4365-9982-063954929ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:29.274446 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40c82f-6abb-4365-9982-063954929ecb None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:29.281390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:29.282055 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:29.282358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:29.282602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] PATH_INFO: `/v3/projects/2d0aaecd4bd7417387844d601adbc2be` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:29.283955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0aaecd4bd7417387844d601adbc2be)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:29.285987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:29.337343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8142-fcf7-4ce0-bb35-63db8056de5c service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:29.339539 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-359b8142-fcf7-4ce0-bb35-63db8056de5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:29.454137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0aaecd4bd7417387844d601adbc2be', 'request_id': 'req-6b3ea59e-ad39-4505-908d-80fd652f771c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:29.463176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0aaecd4bd7417387844d601adbc2be', 'request_id': 'req-6b3ea59e-ad39-4505-908d-80fd652f771c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:29.473176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0aaecd4bd7417387844d601adbc2be', 'request_id': 'req-6b3ea59e-ad39-4505-908d-80fd652f771c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:29.491587 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8142-fcf7-4ce0-bb35-63db8056de5c service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:29.550626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] The token cache is being invalidate because project 2d0aaecd4bd7417387844d601adbc2be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:46:29.551471 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:29.551668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:29.554691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1201/2403] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:46:29 2022] DELETE /identity/v3/projects/2d0aaecd4bd7417387844d601adbc2be => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:29.558969 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:29.562028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:29.564159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:29.580590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c563476-ea73-45fc-8e6c-17339e525797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:29.581293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563476-ea73-45fc-8e6c-17339e525797 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:29.583421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563476-ea73-45fc-8e6c-17339e525797 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:29.583421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563476-ea73-45fc-8e6c-17339e525797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:29.583736 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9c563476-ea73-45fc-8e6c-17339e525797 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:29.597315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c563476-ea73-45fc-8e6c-17339e525797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:29.598971 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c563476-ea73-45fc-8e6c-17339e525797 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:29.614508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1203/2404] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:46:29.659916 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ea59e-ad39-4505-908d-80fd652f771c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:29.666376 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d81c0-db80-408e-b473-e13dc3548935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:29.667198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d81c0-db80-408e-b473-e13dc3548935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:29.667475 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d81c0-db80-408e-b473-e13dc3548935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:29.667745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d81c0-db80-408e-b473-e13dc3548935 admin admin] PATH_INFO: `/v3/users/9a19fd3be2e749da97ded5e791719646` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:29.669710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d81c0-db80-408e-b473-e13dc3548935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a19fd3be2e749da97ded5e791719646)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:29.671764 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d81c0-db80-408e-b473-e13dc3548935 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:29.943836 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a02d81c0-db80-408e-b473-e13dc3548935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a19fd3be2e749da97ded5e791719646'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:29.970682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a02d81c0-db80-408e-b473-e13dc3548935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a19fd3be2e749da97ded5e791719646'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:29.972154 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:29.985557 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a02d81c0-db80-408e-b473-e13dc3548935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a19fd3be2e749da97ded5e791719646'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:30.044602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a02d81c0-db80-408e-b473-e13dc3548935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a19fd3be2e749da97ded5e791719646'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:30.045325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a02d81c0-db80-408e-b473-e13dc3548935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a19fd3be2e749da97ded5e791719646'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:30.051973 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1202/2405] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:46:29 2022] DELETE /identity/v3/users/9a19fd3be2e749da97ded5e791719646 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:30.531362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c563476-ea73-45fc-8e6c-17339e525797 service nova] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:30.543350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c563476-ea73-45fc-8e6c-17339e525797 service nova] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:30.669113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:30.670023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:30.670306 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:30.670576 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] PATH_INFO: `/v3/projects/0bd6c95465d34a038311ae13f73edfff` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:30.671722 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bd6c95465d34a038311ae13f73edfff)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:30.673978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:30.863494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd6c95465d34a038311ae13f73edfff', 'request_id': 'req-c501b8e3-f925-4110-8942-47520f413124'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:30.877572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd6c95465d34a038311ae13f73edfff', 'request_id': 'req-c501b8e3-f925-4110-8942-47520f413124'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:30.976665 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd6c95465d34a038311ae13f73edfff', 'request_id': 'req-c501b8e3-f925-4110-8942-47520f413124'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:31.002396 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] The token cache is being invalidate because project 0bd6c95465d34a038311ae13f73edfff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:46:31.002612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:31.003341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:31.004834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1204/2406] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:46:30 2022] DELETE /identity/v3/projects/0bd6c95465d34a038311ae13f73edfff => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:31.009489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d81c0-db80-408e-b473-e13dc3548935 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:31.013013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a02d81c0-db80-408e-b473-e13dc3548935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:31.026281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d81c0-db80-408e-b473-e13dc3548935 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:31.083017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8610c5-c08a-45a6-9ecb-695de320f759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:31.083673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8610c5-c08a-45a6-9ecb-695de320f759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:31.083953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8610c5-c08a-45a6-9ecb-695de320f759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:31.084252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8610c5-c08a-45a6-9ecb-695de320f759 admin admin] PATH_INFO: `/v3/users/be98c0e2e9c1472b9ebc6f0f892bebb5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:31.085408 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8610c5-c08a-45a6-9ecb-695de320f759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be98c0e2e9c1472b9ebc6f0f892bebb5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:31.087599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8610c5-c08a-45a6-9ecb-695de320f759 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:31.274765 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:31.277199 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:31.291371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1e8610c5-c08a-45a6-9ecb-695de320f759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be98c0e2e9c1472b9ebc6f0f892bebb5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:31.299296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1e8610c5-c08a-45a6-9ecb-695de320f759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be98c0e2e9c1472b9ebc6f0f892bebb5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:31.314120 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1e8610c5-c08a-45a6-9ecb-695de320f759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be98c0e2e9c1472b9ebc6f0f892bebb5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:31.366240 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:31.372252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b8e3-f925-4110-8942-47520f413124 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:31.381364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a5fd2-8679-470d-b461-5b4329ae8f65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:31.382026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a5fd2-8679-470d-b461-5b4329ae8f65 service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:31.382306 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a5fd2-8679-470d-b461-5b4329ae8f65 service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:31.382641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a5fd2-8679-470d-b461-5b4329ae8f65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:31.384903 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-481a5fd2-8679-470d-b461-5b4329ae8f65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:31.387161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1e8610c5-c08a-45a6-9ecb-695de320f759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be98c0e2e9c1472b9ebc6f0f892bebb5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:31.388023 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1e8610c5-c08a-45a6-9ecb-695de320f759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be98c0e2e9c1472b9ebc6f0f892bebb5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:31.394971 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1203/2407] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:46:31 2022] DELETE /identity/v3/users/be98c0e2e9c1472b9ebc6f0f892bebb5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:31.397027 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0168b1f-71d9-4b84-8565-d2595cc554d0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:31.397431 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0168b1f-71d9-4b84-8565-d2595cc554d0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:31.397751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0168b1f-71d9-4b84-8565-d2595cc554d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:31.406897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a5fd2-8679-470d-b461-5b4329ae8f65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:31.408535 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a5fd2-8679-470d-b461-5b4329ae8f65 service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:31.424253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1205/2408] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:31.434510 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f0168b1f-71d9-4b84-8565-d2595cc554d0 None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:31.436249 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f0168b1f-71d9-4b84-8565-d2595cc554d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:31.511804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:31.522745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1204/2409] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:46:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:31.660857 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a5fd2-8679-470d-b461-5b4329ae8f65 service nova] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:31.663451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-481a5fd2-8679-470d-b461-5b4329ae8f65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:31.740521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a5fd2-8679-470d-b461-5b4329ae8f65 service nova] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:31.816390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222d523-73a4-468f-8cfa-8833e4eeb7c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:31.817024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d523-73a4-468f-8cfa-8833e4eeb7c4 service swift] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:31.817310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d523-73a4-468f-8cfa-8833e4eeb7c4 service swift] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:31.817577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d523-73a4-468f-8cfa-8833e4eeb7c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:31.826436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222d523-73a4-468f-8cfa-8833e4eeb7c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:31.828026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222d523-73a4-468f-8cfa-8833e4eeb7c4 service swift] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:31.838361 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1206/2410] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:46:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 04:46:31.870046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0168b1f-71d9-4b84-8565-d2595cc554d0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:31.870046 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f0168b1f-71d9-4b84-8565-d2595cc554d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:31.994252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0168b1f-71d9-4b84-8565-d2595cc554d0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:31.999390 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:32.002790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:32.003235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:32.003834 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d admin admin] PATH_INFO: `/v3/projects/6101193000c14e8eb07574e63de64e12` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:32.005137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6101193000c14e8eb07574e63de64e12)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:32.007896 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:32.181183 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6101193000c14e8eb07574e63de64e12', 'request_id': 'req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:32.191531 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6101193000c14e8eb07574e63de64e12', 'request_id': 'req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:32.199948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6101193000c14e8eb07574e63de64e12', 'request_id': 'req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:32.321019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d admin admin] The token cache is being invalidate because project 6101193000c14e8eb07574e63de64e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:46:32.321590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:32.323691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1db4ab6d-4490-4917-b9ba-8cfd1e83380d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:32.328135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1205/2411] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:46:31 2022] DELETE /identity/v3/projects/6101193000c14e8eb07574e63de64e12 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:32.332080 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee0fd8-f600-4ce0-96b1-35cd6d219997 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:32.332702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee0fd8-f600-4ce0-96b1-35cd6d219997 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:32.332963 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee0fd8-f600-4ce0-96b1-35cd6d219997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:32.355309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-bfee0fd8-f600-4ce0-96b1-35cd6d219997 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:32.358471 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-bfee0fd8-f600-4ce0-96b1-35cd6d219997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:32.488896 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1207/2412] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:32.497027 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099944e-94c8-4931-8796-01a1afe822f1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:32.498021 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099944e-94c8-4931-8796-01a1afe822f1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:32.498400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099944e-94c8-4931-8796-01a1afe822f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:32.527252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0099944e-94c8-4931-8796-01a1afe822f1 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:32.530047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0099944e-94c8-4931-8796-01a1afe822f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:32.554625 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1206/2413] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:32.555855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee0fd8-f600-4ce0-96b1-35cd6d219997 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:32.567323 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee0fd8-f600-4ce0-96b1-35cd6d219997 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:32.573032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad867e6d-d9ef-41a0-8869-567cadc8b4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:32.573847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad867e6d-d9ef-41a0-8869-567cadc8b4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:32.574224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad867e6d-d9ef-41a0-8869-567cadc8b4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:32.574588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad867e6d-d9ef-41a0-8869-567cadc8b4e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:32.575336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad867e6d-d9ef-41a0-8869-567cadc8b4e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:46:32.575908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad867e6d-d9ef-41a0-8869-567cadc8b4e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:32.579039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad867e6d-d9ef-41a0-8869-567cadc8b4e8 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:32.594235 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1208/2414] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:46:32.601918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099944e-94c8-4931-8796-01a1afe822f1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:32.612137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099944e-94c8-4931-8796-01a1afe822f1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:32.618326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d12a1-9107-47e6-8ef8-f797167caeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:32.619666 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d12a1-9107-47e6-8ef8-f797167caeab admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:32.619666 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d12a1-9107-47e6-8ef8-f797167caeab admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:32.619666 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d12a1-9107-47e6-8ef8-f797167caeab admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:32.620766 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d12a1-9107-47e6-8ef8-f797167caeab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:32.622968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d12a1-9107-47e6-8ef8-f797167caeab admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:32.751828 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1207/2415] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:46:32 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:46:32.755487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad867e6d-d9ef-41a0-8869-567cadc8b4e8 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:32.767240 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad867e6d-d9ef-41a0-8869-567cadc8b4e8 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:32.780130 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:32.847264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aa193-9171-45b8-ba19-c513c9619b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:32.848208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aa193-9171-45b8-ba19-c513c9619b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:32.848635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aa193-9171-45b8-ba19-c513c9619b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:32.849031 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aa193-9171-45b8-ba19-c513c9619b1e admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:32.850404 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02aa193-9171-45b8-ba19-c513c9619b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:32.854888 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02aa193-9171-45b8-ba19-c513c9619b1e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:32.941027 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1209/2416] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:46:32 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:32.944083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d12a1-9107-47e6-8ef8-f797167caeab admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:32.956602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d12a1-9107-47e6-8ef8-f797167caeab admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:32.962339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8bb68-490b-4153-87ca-5153c4ff0616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:32.963055 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8bb68-490b-4153-87ca-5153c4ff0616 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:32.964321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8bb68-490b-4153-87ca-5153c4ff0616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:32.964321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8bb68-490b-4153-87ca-5153c4ff0616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:32.964321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8bb68-490b-4153-87ca-5153c4ff0616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:32.969068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8bb68-490b-4153-87ca-5153c4ff0616 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:32.987054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1208/2417] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:32.988382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aa193-9171-45b8-ba19-c513c9619b1e admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:33.002965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aa193-9171-45b8-ba19-c513c9619b1e admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:33.008812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61ca39-dee0-4935-a63f-05d98d551c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:33.009558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61ca39-dee0-4935-a63f-05d98d551c8b admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:33.009941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61ca39-dee0-4935-a63f-05d98d551c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:33.010347 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61ca39-dee0-4935-a63f-05d98d551c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:33.011099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61ca39-dee0-4935-a63f-05d98d551c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:33.013237 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61ca39-dee0-4935-a63f-05d98d551c8b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:33.031802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1210/2418] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:33.035586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8bb68-490b-4153-87ca-5153c4ff0616 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:33.051642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8bb68-490b-4153-87ca-5153c4ff0616 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:33.060693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e8881-f196-48a3-8d7e-5c321baa42b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:33.062671 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8881-f196-48a3-8d7e-5c321baa42b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:33.063314 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8881-f196-48a3-8d7e-5c321baa42b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:33.064255 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8881-f196-48a3-8d7e-5c321baa42b2 admin admin] PATH_INFO: `/v3/projects/b7c15aa1a75048cc856555a9eedb1384/users/7655aab9391147f5aefa680068ff2a21/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:33.082839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e8881-f196-48a3-8d7e-5c321baa42b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c15aa1a75048cc856555a9eedb1384, user_id=7655aab9391147f5aefa680068ff2a21, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:33.086769 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e8881-f196-48a3-8d7e-5c321baa42b2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:33.225784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1209/2419] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:33 2022] PUT /identity/v3/projects/b7c15aa1a75048cc856555a9eedb1384/users/7655aab9391147f5aefa680068ff2a21/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:33.252565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad9a28-ebeb-4ae5-8fb1-e2ac9d7059d3 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:33.252841 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad9a28-ebeb-4ae5-8fb1-e2ac9d7059d3 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:33.253167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad9a28-ebeb-4ae5-8fb1-e2ac9d7059d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:33.298006 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c0ad9a28-ebeb-4ae5-8fb1-e2ac9d7059d3 None None] MFA Rules not processed for user `7655aab9391147f5aefa680068ff2a21`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:33.299515 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c0ad9a28-ebeb-4ae5-8fb1-e2ac9d7059d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:33.402019 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1211/2420] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:33.416483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e8881-f196-48a3-8d7e-5c321baa42b2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:33.418308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e63e8881-f196-48a3-8d7e-5c321baa42b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:33.458162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:33.492293 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e8881-f196-48a3-8d7e-5c321baa42b2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:33.501903 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ad3a8-643a-4dd7-964d-1735b28ce2cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:33.502541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ad3a8-643a-4dd7-964d-1735b28ce2cd service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:33.502819 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ad3a8-643a-4dd7-964d-1735b28ce2cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:33.503092 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ad3a8-643a-4dd7-964d-1735b28ce2cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:33.513054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ad3a8-643a-4dd7-964d-1735b28ce2cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:33.514689 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ad3a8-643a-4dd7-964d-1735b28ce2cd service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:33.527748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1210/2421] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:37.621405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad9a28-ebeb-4ae5-8fb1-e2ac9d7059d3 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:37.622934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c0ad9a28-ebeb-4ae5-8fb1-e2ac9d7059d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:37.702046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad9a28-ebeb-4ae5-8fb1-e2ac9d7059d3 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:37.712733 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108d800-93eb-4d92-a210-e2e9734e0a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:37.712733 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d800-93eb-4d92-a210-e2e9734e0a7a service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:37.712733 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d800-93eb-4d92-a210-e2e9734e0a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:37.713190 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d800-93eb-4d92-a210-e2e9734e0a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:37.714832 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5108d800-93eb-4d92-a210-e2e9734e0a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:37.769356 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:37.811904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108d800-93eb-4d92-a210-e2e9734e0a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:37.813589 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108d800-93eb-4d92-a210-e2e9734e0a7a service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:37.832500 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1212/2422] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:43.529412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee92c38-f6a0-4331-9305-21896ff7602f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:43.530278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee92c38-f6a0-4331-9305-21896ff7602f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:43.530718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee92c38-f6a0-4331-9305-21896ff7602f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:43.561376 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-aee92c38-f6a0-4331-9305-21896ff7602f None None] MFA Rules not processed for user `255138cca3254c5f939112b74a04011f`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:43.562990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aee92c38-f6a0-4331-9305-21896ff7602f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:43.714620 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1211/2423] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:44.229480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108d800-93eb-4d92-a210-e2e9734e0a7a service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:44.230891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5108d800-93eb-4d92-a210-e2e9734e0a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:44.242672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108d800-93eb-4d92-a210-e2e9734e0a7a service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:44.246298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6893578-a2d0-45c1-b6aa-9dda2f824d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:44.246889 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893578-a2d0-45c1-b6aa-9dda2f824d57 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:44.247164 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893578-a2d0-45c1-b6aa-9dda2f824d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:44.247435 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893578-a2d0-45c1-b6aa-9dda2f824d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:44.249413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f6893578-a2d0-45c1-b6aa-9dda2f824d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:44.260956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6893578-a2d0-45c1-b6aa-9dda2f824d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:44.262416 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6893578-a2d0-45c1-b6aa-9dda2f824d57 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:44.270501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1213/2424] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:44.430348 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee92c38-f6a0-4331-9305-21896ff7602f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:44.432187 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aee92c38-f6a0-4331-9305-21896ff7602f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:44.451510 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee92c38-f6a0-4331-9305-21896ff7602f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:44.456799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6c0e7-e224-4c41-9afe-363e002eb569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:44.463675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c0e7-e224-4c41-9afe-363e002eb569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:44.463675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c0e7-e224-4c41-9afe-363e002eb569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:44.463675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c0e7-e224-4c41-9afe-363e002eb569 admin admin] PATH_INFO: `/v3/users/c70f2ce21e9b49ffb3564873e09397e0` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:44.463675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6c0e7-e224-4c41-9afe-363e002eb569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70f2ce21e9b49ffb3564873e09397e0)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:44.463675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6c0e7-e224-4c41-9afe-363e002eb569 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:44.758244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-43a6c0e7-e224-4c41-9afe-363e002eb569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70f2ce21e9b49ffb3564873e09397e0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:44.767756 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-43a6c0e7-e224-4c41-9afe-363e002eb569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70f2ce21e9b49ffb3564873e09397e0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:44.824814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-43a6c0e7-e224-4c41-9afe-363e002eb569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70f2ce21e9b49ffb3564873e09397e0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:44.932428 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-43a6c0e7-e224-4c41-9afe-363e002eb569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70f2ce21e9b49ffb3564873e09397e0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:44.934014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-43a6c0e7-e224-4c41-9afe-363e002eb569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70f2ce21e9b49ffb3564873e09397e0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:44.956150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1212/2425] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:46:44 2022] DELETE /identity/v3/users/c70f2ce21e9b49ffb3564873e09397e0 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:45.471179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6893578-a2d0-45c1-b6aa-9dda2f824d57 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:45.485292 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6893578-a2d0-45c1-b6aa-9dda2f824d57 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:45.558488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58547eb-bfdc-4eec-957c-2a38ba1c8599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:45.559133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58547eb-bfdc-4eec-957c-2a38ba1c8599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:45.559500 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58547eb-bfdc-4eec-957c-2a38ba1c8599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:45.559694 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58547eb-bfdc-4eec-957c-2a38ba1c8599 admin admin] PATH_INFO: `/v3/projects/c90e000b02b3401ab9ae0b51510a4094` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:45.560839 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58547eb-bfdc-4eec-957c-2a38ba1c8599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c90e000b02b3401ab9ae0b51510a4094)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:45.562835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58547eb-bfdc-4eec-957c-2a38ba1c8599 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:45.705152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f58547eb-bfdc-4eec-957c-2a38ba1c8599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c90e000b02b3401ab9ae0b51510a4094', 'request_id': 'req-f58547eb-bfdc-4eec-957c-2a38ba1c8599'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:45.712220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f58547eb-bfdc-4eec-957c-2a38ba1c8599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c90e000b02b3401ab9ae0b51510a4094', 'request_id': 'req-f58547eb-bfdc-4eec-957c-2a38ba1c8599'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:45.817319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f58547eb-bfdc-4eec-957c-2a38ba1c8599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c90e000b02b3401ab9ae0b51510a4094', 'request_id': 'req-f58547eb-bfdc-4eec-957c-2a38ba1c8599'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:45.830969 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f58547eb-bfdc-4eec-957c-2a38ba1c8599 admin admin] The token cache is being invalidate because project c90e000b02b3401ab9ae0b51510a4094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:46:45.831640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f58547eb-bfdc-4eec-957c-2a38ba1c8599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:45.832456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f58547eb-bfdc-4eec-957c-2a38ba1c8599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:45.834254 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1214/2426] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:46:45 2022] DELETE /identity/v3/projects/c90e000b02b3401ab9ae0b51510a4094 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:45.840199 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eade14-4aef-4999-a1f2-1169f363fb9e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:45.840695 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eade14-4aef-4999-a1f2-1169f363fb9e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:45.841548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eade14-4aef-4999-a1f2-1169f363fb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:45.863512 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c8eade14-4aef-4999-a1f2-1169f363fb9e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:45.864780 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c8eade14-4aef-4999-a1f2-1169f363fb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:45.911108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:45.948460 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1213/2427] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:45.960088 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665b66-c4ac-4a82-9d13-d37d42e1f458 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:45.960370 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665b66-c4ac-4a82-9d13-d37d42e1f458 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:45.960674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665b66-c4ac-4a82-9d13-d37d42e1f458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:45.983128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-b4665b66-c4ac-4a82-9d13-d37d42e1f458 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:45.984440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b4665b66-c4ac-4a82-9d13-d37d42e1f458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:45.995099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1215/2428] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:45.998153 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eade14-4aef-4999-a1f2-1169f363fb9e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:46.009632 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eade14-4aef-4999-a1f2-1169f363fb9e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:46.014420 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b63200-4059-481d-9801-2e66c40dbad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:46.015152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b63200-4059-481d-9801-2e66c40dbad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:46.015432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b63200-4059-481d-9801-2e66c40dbad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:46.015697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b63200-4059-481d-9801-2e66c40dbad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:46.016487 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b63200-4059-481d-9801-2e66c40dbad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:46:46.016787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b63200-4059-481d-9801-2e66c40dbad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:46.018697 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b63200-4059-481d-9801-2e66c40dbad8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:46.031050 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1214/2429] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:46:46.035466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4665b66-c4ac-4a82-9d13-d37d42e1f458 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:46.054954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4665b66-c4ac-4a82-9d13-d37d42e1f458 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:46.054954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900f501-426c-401f-ac07-ce2487caee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:46.054954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900f501-426c-401f-ac07-ce2487caee72 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:46.054954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900f501-426c-401f-ac07-ce2487caee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:46.055358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900f501-426c-401f-ac07-ce2487caee72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:46.055358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900f501-426c-401f-ac07-ce2487caee72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:46.055358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900f501-426c-401f-ac07-ce2487caee72 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:46.156948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1216/2430] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:46:46 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:46.161342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b63200-4059-481d-9801-2e66c40dbad8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:46.173373 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b63200-4059-481d-9801-2e66c40dbad8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:46.241374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661f829-c5e1-4543-878e-11dabae7c2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:46.241751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661f829-c5e1-4543-878e-11dabae7c2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:46.243085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661f829-c5e1-4543-878e-11dabae7c2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:46.243085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661f829-c5e1-4543-878e-11dabae7c2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:46.243688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661f829-c5e1-4543-878e-11dabae7c2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:46.245680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661f829-c5e1-4543-878e-11dabae7c2a6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:46.352023 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1215/2431] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:46:46 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:46.357372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900f501-426c-401f-ac07-ce2487caee72 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:46.373801 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900f501-426c-401f-ac07-ce2487caee72 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:46.374789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9547a-a255-44da-be0a-0d09de67fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:46.375397 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9547a-a255-44da-be0a-0d09de67fbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:46.375675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9547a-a255-44da-be0a-0d09de67fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:46.376001 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9547a-a255-44da-be0a-0d09de67fbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:46.376645 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9547a-a255-44da-be0a-0d09de67fbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:46.378503 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9547a-a255-44da-be0a-0d09de67fbe3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:46.389769 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1217/2432] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:46.393465 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661f829-c5e1-4543-878e-11dabae7c2a6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:46.415985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661f829-c5e1-4543-878e-11dabae7c2a6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:46.431649 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd768676-4c35-4833-a1d2-505d897c13d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:46.432732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd768676-4c35-4833-a1d2-505d897c13d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:46.433108 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd768676-4c35-4833-a1d2-505d897c13d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:46.433621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd768676-4c35-4833-a1d2-505d897c13d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:46.434370 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd768676-4c35-4833-a1d2-505d897c13d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:46.436188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd768676-4c35-4833-a1d2-505d897c13d4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:46.450374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1216/2433] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:46:46.454771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9547a-a255-44da-be0a-0d09de67fbe3 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:46.467749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9547a-a255-44da-be0a-0d09de67fbe3 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:46.475765 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4276c3-e8c3-467e-ba0c-4570d6dd258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:46.477192 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4276c3-e8c3-467e-ba0c-4570d6dd258e admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:46.477483 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4276c3-e8c3-467e-ba0c-4570d6dd258e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:46.477749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4276c3-e8c3-467e-ba0c-4570d6dd258e admin admin] PATH_INFO: `/v3/projects/2aa795952fdd4b818f5b0491c65d7305/users/5415c6bbd3c4415a8f7ccf2edb3698a1/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:46.480479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:46.495159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4276c3-e8c3-467e-ba0c-4570d6dd258e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa795952fdd4b818f5b0491c65d7305, user_id=5415c6bbd3c4415a8f7ccf2edb3698a1, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:46.500050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4276c3-e8c3-467e-ba0c-4570d6dd258e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:46.609617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1218/2434] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:46 2022] PUT /identity/v3/projects/2aa795952fdd4b818f5b0491c65d7305/users/5415c6bbd3c4415a8f7ccf2edb3698a1/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:46.621066 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542d032-cc6e-4c1c-8758-a1c5b133ab1a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:46.621432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542d032-cc6e-4c1c-8758-a1c5b133ab1a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:46.621768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542d032-cc6e-4c1c-8758-a1c5b133ab1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:46.652047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f542d032-cc6e-4c1c-8758-a1c5b133ab1a None None] MFA Rules not processed for user `5415c6bbd3c4415a8f7ccf2edb3698a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:46.653349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f542d032-cc6e-4c1c-8758-a1c5b133ab1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:46.733226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1217/2435] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:46.737797 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4276c3-e8c3-467e-ba0c-4570d6dd258e admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:46.798597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4276c3-e8c3-467e-ba0c-4570d6dd258e admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:46.803232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebbfdf-3921-4a34-a31a-db92466d2a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:46.803827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebbfdf-3921-4a34-a31a-db92466d2a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:46.804101 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebbfdf-3921-4a34-a31a-db92466d2a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:46.804517 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebbfdf-3921-4a34-a31a-db92466d2a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:46.805246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebbfdf-3921-4a34-a31a-db92466d2a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:46.807147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebbfdf-3921-4a34-a31a-db92466d2a67 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:46.910833 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1219/2436] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:46:46 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:46:46.929941 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542d032-cc6e-4c1c-8758-a1c5b133ab1a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:46.942275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542d032-cc6e-4c1c-8758-a1c5b133ab1a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:46.991524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:47.013615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88260d36-7580-4d27-948c-a845113c3666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:47.014238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88260d36-7580-4d27-948c-a845113c3666 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:47.014518 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88260d36-7580-4d27-948c-a845113c3666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:47.014788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88260d36-7580-4d27-948c-a845113c3666 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:47.015423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88260d36-7580-4d27-948c-a845113c3666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:47.019408 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88260d36-7580-4d27-948c-a845113c3666 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:47.108507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1218/2437] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:46:46 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:47.112527 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebbfdf-3921-4a34-a31a-db92466d2a67 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:47.124138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebbfdf-3921-4a34-a31a-db92466d2a67 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:47.128911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da0023-311d-4233-986f-7be11a0a096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:47.129482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da0023-311d-4233-986f-7be11a0a096c admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:47.129766 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da0023-311d-4233-986f-7be11a0a096c admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:47.130038 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da0023-311d-4233-986f-7be11a0a096c admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:47.130707 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da0023-311d-4233-986f-7be11a0a096c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:47.132313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da0023-311d-4233-986f-7be11a0a096c admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:47.143618 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1220/2438] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:47.147894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88260d36-7580-4d27-948c-a845113c3666 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:47.159494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88260d36-7580-4d27-948c-a845113c3666 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:47.165660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33792a14-321e-44cc-a0be-5b697b814b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:47.166334 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792a14-321e-44cc-a0be-5b697b814b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:47.166772 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792a14-321e-44cc-a0be-5b697b814b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:47.167042 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792a14-321e-44cc-a0be-5b697b814b26 admin admin] PATH_INFO: `/v3/projects/9ab177679c89424d8fb3a8d986f009af/users/9a0d73aed93a491fa9ec320e3e197e55/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:47.185112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33792a14-321e-44cc-a0be-5b697b814b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab177679c89424d8fb3a8d986f009af, user_id=9a0d73aed93a491fa9ec320e3e197e55, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:47.187933 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33792a14-321e-44cc-a0be-5b697b814b26 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:47.280501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1219/2439] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:47 2022] PUT /identity/v3/projects/9ab177679c89424d8fb3a8d986f009af/users/9a0d73aed93a491fa9ec320e3e197e55/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:46:47.285257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da0023-311d-4233-986f-7be11a0a096c admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:47.297269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da0023-311d-4233-986f-7be11a0a096c admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:47.364980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41a151-340d-4833-88dc-70aa0107bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:47.365612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41a151-340d-4833-88dc-70aa0107bbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:47.365889 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41a151-340d-4833-88dc-70aa0107bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:47.366156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41a151-340d-4833-88dc-70aa0107bbd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:47.366844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41a151-340d-4833-88dc-70aa0107bbd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:47.368439 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41a151-340d-4833-88dc-70aa0107bbd6 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:47.378488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1221/2440] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:47.388674 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33792a14-321e-44cc-a0be-5b697b814b26 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:47.401239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33792a14-321e-44cc-a0be-5b697b814b26 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:47.406343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c082a0-7280-4f2e-a1ce-5563a35d7869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:47.407119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c082a0-7280-4f2e-a1ce-5563a35d7869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:47.408113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c082a0-7280-4f2e-a1ce-5563a35d7869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:47.408113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c082a0-7280-4f2e-a1ce-5563a35d7869 admin admin] PATH_INFO: `/v3/projects/9ab177679c89424d8fb3a8d986f009af/users/9a0d73aed93a491fa9ec320e3e197e55/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:47.410386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c082a0-7280-4f2e-a1ce-5563a35d7869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab177679c89424d8fb3a8d986f009af, user_id=9a0d73aed93a491fa9ec320e3e197e55, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:47.413139 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c082a0-7280-4f2e-a1ce-5563a35d7869 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:47.431982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1220/2441] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:47 2022] PUT /identity/v3/projects/9ab177679c89424d8fb3a8d986f009af/users/9a0d73aed93a491fa9ec320e3e197e55/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:47.441975 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6a909-9b1f-4efb-950a-496a1ba852b7 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:47.442259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6a909-9b1f-4efb-950a-496a1ba852b7 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:47.442530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6a909-9b1f-4efb-950a-496a1ba852b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:47.471089 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-44f6a909-9b1f-4efb-950a-496a1ba852b7 None None] MFA Rules not processed for user `9a0d73aed93a491fa9ec320e3e197e55`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:47.472688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-44f6a909-9b1f-4efb-950a-496a1ba852b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:47.519440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:47.547711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1222/2442] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:47.560121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c082a0-7280-4f2e-a1ce-5563a35d7869 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:47.561926 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f9c082a0-7280-4f2e-a1ce-5563a35d7869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:47.632357 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c082a0-7280-4f2e-a1ce-5563a35d7869 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:47.639842 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b4785-9307-45c3-98b3-350cd5002746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:47.639842 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b4785-9307-45c3-98b3-350cd5002746 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:47.640235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b4785-9307-45c3-98b3-350cd5002746 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:47.640694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b4785-9307-45c3-98b3-350cd5002746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:47.654585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b4785-9307-45c3-98b3-350cd5002746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:47.656206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b4785-9307-45c3-98b3-350cd5002746 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:47.666477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1221/2443] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:48.738316 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6a909-9b1f-4efb-950a-496a1ba852b7 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:48.821444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6a909-9b1f-4efb-950a-496a1ba852b7 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:48.826630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cd4db-87a4-42e0-b155-4d41a965c40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:48.827369 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cd4db-87a4-42e0-b155-4d41a965c40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:48.827648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cd4db-87a4-42e0-b155-4d41a965c40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:48.828512 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cd4db-87a4-42e0-b155-4d41a965c40b admin admin] PATH_INFO: `/v3/users/5415c6bbd3c4415a8f7ccf2edb3698a1` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:48.829311 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cd4db-87a4-42e0-b155-4d41a965c40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5415c6bbd3c4415a8f7ccf2edb3698a1)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:48.831345 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cd4db-87a4-42e0-b155-4d41a965c40b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:49.063191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2a3cd4db-87a4-42e0-b155-4d41a965c40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5415c6bbd3c4415a8f7ccf2edb3698a1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:49.150107 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2a3cd4db-87a4-42e0-b155-4d41a965c40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5415c6bbd3c4415a8f7ccf2edb3698a1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:49.150976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2a3cd4db-87a4-42e0-b155-4d41a965c40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5415c6bbd3c4415a8f7ccf2edb3698a1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:49.160129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2a3cd4db-87a4-42e0-b155-4d41a965c40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5415c6bbd3c4415a8f7ccf2edb3698a1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:49.176536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2a3cd4db-87a4-42e0-b155-4d41a965c40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5415c6bbd3c4415a8f7ccf2edb3698a1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:49.185053 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1223/2444] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:46:48 2022] DELETE /identity/v3/users/5415c6bbd3c4415a8f7ccf2edb3698a1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:49.191642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e360f-a478-4f74-bbfb-de44933c1bd9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:49.192163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e360f-a478-4f74-bbfb-de44933c1bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:49.192163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e360f-a478-4f74-bbfb-de44933c1bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:49.220786 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-649e360f-a478-4f74-bbfb-de44933c1bd9 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:49.222192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-649e360f-a478-4f74-bbfb-de44933c1bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:49.314728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1222/2445] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:49.326770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cd4db-87a4-42e0-b155-4d41a965c40b admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:49.328507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2a3cd4db-87a4-42e0-b155-4d41a965c40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:49.444000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cd4db-87a4-42e0-b155-4d41a965c40b admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:49.449674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03349d2f-2cc4-4d1b-b4bf-a3157da7c802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:49.450368 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03349d2f-2cc4-4d1b-b4bf-a3157da7c802 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:49.450720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03349d2f-2cc4-4d1b-b4bf-a3157da7c802 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:49.450998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03349d2f-2cc4-4d1b-b4bf-a3157da7c802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:49.461948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03349d2f-2cc4-4d1b-b4bf-a3157da7c802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:49.463861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03349d2f-2cc4-4d1b-b4bf-a3157da7c802 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:49.478429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:49.484314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1224/2446] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:50.144630 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e360f-a478-4f74-bbfb-de44933c1bd9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:50.146355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-649e360f-a478-4f74-bbfb-de44933c1bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:50.180558 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e360f-a478-4f74-bbfb-de44933c1bd9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:50.190462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:50.191165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:50.191841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:50.192379 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] PATH_INFO: `/v3/projects/2aa795952fdd4b818f5b0491c65d7305` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:50.193832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa795952fdd4b818f5b0491c65d7305)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:50.196538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:50.328443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:50.342090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa795952fdd4b818f5b0491c65d7305', 'request_id': 'req-dac63b69-3c6b-4608-9091-b62abf7d6f90'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:50.348415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa795952fdd4b818f5b0491c65d7305', 'request_id': 'req-dac63b69-3c6b-4608-9091-b62abf7d6f90'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:50.354057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa795952fdd4b818f5b0491c65d7305', 'request_id': 'req-dac63b69-3c6b-4608-9091-b62abf7d6f90'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:50.592517 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] The token cache is being invalidate because project 2aa795952fdd4b818f5b0491c65d7305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:46:50.593343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:50.594298 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:50.596028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1223/2447] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:46:50 2022] DELETE /identity/v3/projects/2aa795952fdd4b818f5b0491c65d7305 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:50.599995 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03349d2f-2cc4-4d1b-b4bf-a3157da7c802 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:50.611920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03349d2f-2cc4-4d1b-b4bf-a3157da7c802 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:50.693452 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901dbc4-32cf-4476-94c3-b7aa8bac14b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:50.694083 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901dbc4-32cf-4476-94c3-b7aa8bac14b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:50.694364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901dbc4-32cf-4476-94c3-b7aa8bac14b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:50.696728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901dbc4-32cf-4476-94c3-b7aa8bac14b5 admin admin] PATH_INFO: `/v3/users/9a0d73aed93a491fa9ec320e3e197e55` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:50.696728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901dbc4-32cf-4476-94c3-b7aa8bac14b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0d73aed93a491fa9ec320e3e197e55)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:50.697998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901dbc4-32cf-4476-94c3-b7aa8bac14b5 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:50.907760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9901dbc4-32cf-4476-94c3-b7aa8bac14b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0d73aed93a491fa9ec320e3e197e55'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:50.976174 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9901dbc4-32cf-4476-94c3-b7aa8bac14b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0d73aed93a491fa9ec320e3e197e55'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:50.977474 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9901dbc4-32cf-4476-94c3-b7aa8bac14b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0d73aed93a491fa9ec320e3e197e55'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:50.985959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9901dbc4-32cf-4476-94c3-b7aa8bac14b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0d73aed93a491fa9ec320e3e197e55'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:51.003482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9901dbc4-32cf-4476-94c3-b7aa8bac14b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0d73aed93a491fa9ec320e3e197e55'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:51.011080 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1225/2448] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:46:50 2022] DELETE /identity/v3/users/9a0d73aed93a491fa9ec320e3e197e55 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:51.639288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:51.640605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:51.658449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac63b69-3c6b-4608-9091-b62abf7d6f90 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:51.761736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbe158-5157-4c5f-a609-e0c06b36959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:51.762376 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbe158-5157-4c5f-a609-e0c06b36959e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:51.762655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbe158-5157-4c5f-a609-e0c06b36959e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:51.762927 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbe158-5157-4c5f-a609-e0c06b36959e admin admin] PATH_INFO: `/v3/projects/9ab177679c89424d8fb3a8d986f009af` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:51.764054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbe158-5157-4c5f-a609-e0c06b36959e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ab177679c89424d8fb3a8d986f009af)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:51.766060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbe158-5157-4c5f-a609-e0c06b36959e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:51.882164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29bbe158-5157-4c5f-a609-e0c06b36959e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ab177679c89424d8fb3a8d986f009af', 'request_id': 'req-29bbe158-5157-4c5f-a609-e0c06b36959e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:51.888958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29bbe158-5157-4c5f-a609-e0c06b36959e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ab177679c89424d8fb3a8d986f009af', 'request_id': 'req-29bbe158-5157-4c5f-a609-e0c06b36959e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:51.895235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29bbe158-5157-4c5f-a609-e0c06b36959e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ab177679c89424d8fb3a8d986f009af', 'request_id': 'req-29bbe158-5157-4c5f-a609-e0c06b36959e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:51.961485 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29bbe158-5157-4c5f-a609-e0c06b36959e admin admin] The token cache is being invalidate because project 9ab177679c89424d8fb3a8d986f009af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:46:51.964978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29bbe158-5157-4c5f-a609-e0c06b36959e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:51.964978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29bbe158-5157-4c5f-a609-e0c06b36959e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:51.964978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1224/2449] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:46:51 2022] DELETE /identity/v3/projects/9ab177679c89424d8fb3a8d986f009af => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:51.969334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce498ca7-fa8e-4e7b-8043-42b8e4855e67 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:51.969862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce498ca7-fa8e-4e7b-8043-42b8e4855e67 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:51.970191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce498ca7-fa8e-4e7b-8043-42b8e4855e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:51.990678 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ce498ca7-fa8e-4e7b-8043-42b8e4855e67 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:51.991913 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ce498ca7-fa8e-4e7b-8043-42b8e4855e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:52.052021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1226/2450] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:52.060348 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0133-1302-40aa-add6-3986cf0c3692 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:52.060636 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0133-1302-40aa-add6-3986cf0c3692 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:52.060907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0133-1302-40aa-add6-3986cf0c3692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:52.080888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-290b0133-1302-40aa-add6-3986cf0c3692 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:52.082161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-290b0133-1302-40aa-add6-3986cf0c3692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:52.091586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1225/2451] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:52.095835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce498ca7-fa8e-4e7b-8043-42b8e4855e67 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:52.106777 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce498ca7-fa8e-4e7b-8043-42b8e4855e67 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:52.111355 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade00be-aa08-445e-bcc8-52e45f2b60f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:52.111994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade00be-aa08-445e-bcc8-52e45f2b60f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:52.112271 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade00be-aa08-445e-bcc8-52e45f2b60f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:52.112540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade00be-aa08-445e-bcc8-52e45f2b60f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:52.113211 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade00be-aa08-445e-bcc8-52e45f2b60f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:46:52.113514 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade00be-aa08-445e-bcc8-52e45f2b60f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:52.115115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade00be-aa08-445e-bcc8-52e45f2b60f6 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:52.126770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1227/2452] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:46:52.131119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b0133-1302-40aa-add6-3986cf0c3692 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:52.141260 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b0133-1302-40aa-add6-3986cf0c3692 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:52.145915 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa009e8f-64b6-4bac-9fbf-ab25d9f17012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:52.146515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa009e8f-64b6-4bac-9fbf-ab25d9f17012 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:52.146789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa009e8f-64b6-4bac-9fbf-ab25d9f17012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:52.147059 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa009e8f-64b6-4bac-9fbf-ab25d9f17012 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:52.147774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa009e8f-64b6-4bac-9fbf-ab25d9f17012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:52.150149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa009e8f-64b6-4bac-9fbf-ab25d9f17012 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:52.272375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1226/2453] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:46:52 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:52.276931 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade00be-aa08-445e-bcc8-52e45f2b60f6 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:52.287550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade00be-aa08-445e-bcc8-52e45f2b60f6 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:52.293573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:52.354116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ae22a-d3e5-4563-a4c8-f80f88a938ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:52.354464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae22a-d3e5-4563-a4c8-f80f88a938ae admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:52.354758 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae22a-d3e5-4563-a4c8-f80f88a938ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:52.355050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae22a-d3e5-4563-a4c8-f80f88a938ae admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:52.355670 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ae22a-d3e5-4563-a4c8-f80f88a938ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:52.357802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ae22a-d3e5-4563-a4c8-f80f88a938ae admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:52.693811 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1228/2454] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:46:52 2022] POST /identity/v3/users => generated 289 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:46:52.699439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa009e8f-64b6-4bac-9fbf-ab25d9f17012 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:52.712062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa009e8f-64b6-4bac-9fbf-ab25d9f17012 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:52.717288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd57d8-0f2f-46aa-9d9e-90f00e174dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:52.718922 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd57d8-0f2f-46aa-9d9e-90f00e174dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:52.718922 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd57d8-0f2f-46aa-9d9e-90f00e174dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:52.718922 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd57d8-0f2f-46aa-9d9e-90f00e174dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:52.719216 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd57d8-0f2f-46aa-9d9e-90f00e174dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:52.720649 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd57d8-0f2f-46aa-9d9e-90f00e174dc6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:52.732463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1227/2455] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:52.736803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ae22a-d3e5-4563-a4c8-f80f88a938ae admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:52.748671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ae22a-d3e5-4563-a4c8-f80f88a938ae admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:52.753614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aa0dd-83e8-4b13-a546-e98609b32529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:52.754268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aa0dd-83e8-4b13-a546-e98609b32529 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:52.754550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aa0dd-83e8-4b13-a546-e98609b32529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:52.754825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aa0dd-83e8-4b13-a546-e98609b32529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:52.755583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815aa0dd-83e8-4b13-a546-e98609b32529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:52.757436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815aa0dd-83e8-4b13-a546-e98609b32529 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:52.771310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1229/2456] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:52.776367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd57d8-0f2f-46aa-9d9e-90f00e174dc6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:52.787122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd57d8-0f2f-46aa-9d9e-90f00e174dc6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:52.793830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bbef7-5ce2-4cf5-a12e-58f145b5cf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:52.794601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bbef7-5ce2-4cf5-a12e-58f145b5cf49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:52.794943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bbef7-5ce2-4cf5-a12e-58f145b5cf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:52.795284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bbef7-5ce2-4cf5-a12e-58f145b5cf49 admin admin] PATH_INFO: `/v3/projects/8329da8f9fcc48398fe29979508fa7ef/users/3145e08b552741ea9465558e6970efe7/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:52.799246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:52.818359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bbef7-5ce2-4cf5-a12e-58f145b5cf49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8329da8f9fcc48398fe29979508fa7ef, user_id=3145e08b552741ea9465558e6970efe7, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:52.823325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bbef7-5ce2-4cf5-a12e-58f145b5cf49 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:52.900581 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1228/2457] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:52 2022] PUT /identity/v3/projects/8329da8f9fcc48398fe29979508fa7ef/users/3145e08b552741ea9465558e6970efe7/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:52.922697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc11b9-09b3-4242-ada2-8d47fbdc4408 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:52.923536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc11b9-09b3-4242-ada2-8d47fbdc4408 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:52.923536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc11b9-09b3-4242-ada2-8d47fbdc4408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:52.960126 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c5fc11b9-09b3-4242-ada2-8d47fbdc4408 None None] MFA Rules not processed for user `3145e08b552741ea9465558e6970efe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:52.961843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c5fc11b9-09b3-4242-ada2-8d47fbdc4408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:53.037816 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1230/2458] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:53.042828 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bbef7-5ce2-4cf5-a12e-58f145b5cf49 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:53.138650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bbef7-5ce2-4cf5-a12e-58f145b5cf49 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:53.143443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d782dea-b047-433c-9c0e-7f3938ed6c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:53.144043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d782dea-b047-433c-9c0e-7f3938ed6c77 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:53.144324 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d782dea-b047-433c-9c0e-7f3938ed6c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:53.144597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d782dea-b047-433c-9c0e-7f3938ed6c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:53.145258 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d782dea-b047-433c-9c0e-7f3938ed6c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:53.147169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d782dea-b047-433c-9c0e-7f3938ed6c77 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:53.283451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1229/2459] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:46:53 2022] POST /identity/v3/projects => generated 377 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:53.287562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc11b9-09b3-4242-ada2-8d47fbdc4408 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:53.299726 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc11b9-09b3-4242-ada2-8d47fbdc4408 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:53.385428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576af13c-0daa-4124-9ae3-0ec7296b803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:53.388940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576af13c-0daa-4124-9ae3-0ec7296b803e admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:53.388940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576af13c-0daa-4124-9ae3-0ec7296b803e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:53.388940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576af13c-0daa-4124-9ae3-0ec7296b803e admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:53.388940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576af13c-0daa-4124-9ae3-0ec7296b803e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:53.389343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576af13c-0daa-4124-9ae3-0ec7296b803e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:53.495918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1231/2460] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:46:53 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:46:53.499703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d782dea-b047-433c-9c0e-7f3938ed6c77 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:53.512016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d782dea-b047-433c-9c0e-7f3938ed6c77 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:53.517423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aaa58-34f2-43bd-abd1-e3fab74b7c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:53.518157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aaa58-34f2-43bd-abd1-e3fab74b7c83 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:53.521125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aaa58-34f2-43bd-abd1-e3fab74b7c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:53.529103 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aaa58-34f2-43bd-abd1-e3fab74b7c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:53.529103 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823aaa58-34f2-43bd-abd1-e3fab74b7c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:53.529103 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823aaa58-34f2-43bd-abd1-e3fab74b7c83 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:53.537747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1230/2461] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:53.541531 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576af13c-0daa-4124-9ae3-0ec7296b803e admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:53.554598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576af13c-0daa-4124-9ae3-0ec7296b803e admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:53.563196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af727190-00b6-4aa4-830b-4a6a87bb0525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:53.563860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af727190-00b6-4aa4-830b-4a6a87bb0525 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:53.564142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af727190-00b6-4aa4-830b-4a6a87bb0525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:53.564553 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af727190-00b6-4aa4-830b-4a6a87bb0525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:53.565333 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af727190-00b6-4aa4-830b-4a6a87bb0525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:53.567144 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af727190-00b6-4aa4-830b-4a6a87bb0525 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:53.584296 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1232/2462] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:53.588171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aaa58-34f2-43bd-abd1-e3fab74b7c83 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:53.598590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aaa58-34f2-43bd-abd1-e3fab74b7c83 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:53.603543 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7b3f-2498-453f-a234-881857cc492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:53.604415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7b3f-2498-453f-a234-881857cc492f admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:53.604686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7b3f-2498-453f-a234-881857cc492f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:53.604952 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7b3f-2498-453f-a234-881857cc492f admin admin] PATH_INFO: `/v3/projects/866c3a61dbea44988831580495171f03/users/417601821d8a49e8a93bab582db01fd6/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:53.620626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e7b3f-2498-453f-a234-881857cc492f admin admin] RBAC: Authorizing `identity:create_grant(project_id=866c3a61dbea44988831580495171f03, user_id=417601821d8a49e8a93bab582db01fd6, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:53.623378 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e7b3f-2498-453f-a234-881857cc492f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:53.689750 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1231/2463] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:53 2022] PUT /identity/v3/projects/866c3a61dbea44988831580495171f03/users/417601821d8a49e8a93bab582db01fd6/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:53.701874 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa870d12-e8a5-4528-8cdd-6cb41b4b52a2 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:53.702164 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa870d12-e8a5-4528-8cdd-6cb41b4b52a2 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:53.702405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa870d12-e8a5-4528-8cdd-6cb41b4b52a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:53.737814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-aa870d12-e8a5-4528-8cdd-6cb41b4b52a2 None None] MFA Rules not processed for user `417601821d8a49e8a93bab582db01fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:53.739049 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-aa870d12-e8a5-4528-8cdd-6cb41b4b52a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:53.809710 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1233/2464] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:46:53.814690 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7b3f-2498-453f-a234-881857cc492f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:53.907031 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7b3f-2498-453f-a234-881857cc492f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:53.921271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99caaf5-6952-4fd8-a046-451a4a7cf012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:53.921775 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99caaf5-6952-4fd8-a046-451a4a7cf012 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:53.922104 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99caaf5-6952-4fd8-a046-451a4a7cf012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:53.922381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99caaf5-6952-4fd8-a046-451a4a7cf012 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:53.923226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99caaf5-6952-4fd8-a046-451a4a7cf012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:53.925377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99caaf5-6952-4fd8-a046-451a4a7cf012 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:54.040611 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:54.050350 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1232/2465] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:46:53 2022] POST /identity/v3/projects => generated 379 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:54.051392 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa870d12-e8a5-4528-8cdd-6cb41b4b52a2 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:54.066933 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa870d12-e8a5-4528-8cdd-6cb41b4b52a2 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:54.130323 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ca722-2c66-4c9f-8d0c-a936f625b0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:54.131056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ca722-2c66-4c9f-8d0c-a936f625b0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:54.131432 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ca722-2c66-4c9f-8d0c-a936f625b0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:54.131799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ca722-2c66-4c9f-8d0c-a936f625b0b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:54.133305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ca722-2c66-4c9f-8d0c-a936f625b0b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:54.135572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ca722-2c66-4c9f-8d0c-a936f625b0b4 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:54.232739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1234/2466] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:46:54 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:46:54.236761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99caaf5-6952-4fd8-a046-451a4a7cf012 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:54.248058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99caaf5-6952-4fd8-a046-451a4a7cf012 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:54.253156 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063fbcd-d32e-452b-ad68-f042714cdabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:54.253778 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063fbcd-d32e-452b-ad68-f042714cdabf admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:54.254055 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063fbcd-d32e-452b-ad68-f042714cdabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:54.254325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063fbcd-d32e-452b-ad68-f042714cdabf admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:54.254980 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063fbcd-d32e-452b-ad68-f042714cdabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:54.256595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063fbcd-d32e-452b-ad68-f042714cdabf admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:54.269730 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1233/2467] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:54.274443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ca722-2c66-4c9f-8d0c-a936f625b0b4 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:54.308851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ca722-2c66-4c9f-8d0c-a936f625b0b4 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:54.308851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd199d2d-9dcc-4c13-b5bd-487d828f7fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:54.308851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd199d2d-9dcc-4c13-b5bd-487d828f7fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:54.308851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd199d2d-9dcc-4c13-b5bd-487d828f7fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:54.309264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd199d2d-9dcc-4c13-b5bd-487d828f7fa2 admin admin] PATH_INFO: `/v3/projects/ede8b9edfd1a46738110a797f00e6297/users/f1aa84f59509464bb5e1958315821f12/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:54.323272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd199d2d-9dcc-4c13-b5bd-487d828f7fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede8b9edfd1a46738110a797f00e6297, user_id=f1aa84f59509464bb5e1958315821f12, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:54.326358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd199d2d-9dcc-4c13-b5bd-487d828f7fa2 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:54.423549 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1235/2468] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:54 2022] PUT /identity/v3/projects/ede8b9edfd1a46738110a797f00e6297/users/f1aa84f59509464bb5e1958315821f12/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:54.427388 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063fbcd-d32e-452b-ad68-f042714cdabf admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:54.441852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063fbcd-d32e-452b-ad68-f042714cdabf admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:54.452209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:54.503830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ac993-5a3d-4826-a6bd-c38cbb0f3806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:54.504433 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ac993-5a3d-4826-a6bd-c38cbb0f3806 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:54.504713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ac993-5a3d-4826-a6bd-c38cbb0f3806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:54.504985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ac993-5a3d-4826-a6bd-c38cbb0f3806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:54.505661 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ac993-5a3d-4826-a6bd-c38cbb0f3806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:54.507296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ac993-5a3d-4826-a6bd-c38cbb0f3806 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:54.517591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1234/2469] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:46:54.521753 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd199d2d-9dcc-4c13-b5bd-487d828f7fa2 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:54.532603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd199d2d-9dcc-4c13-b5bd-487d828f7fa2 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:54.537201 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae159a-4350-4336-9d39-7b498ef15e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:54.537849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae159a-4350-4336-9d39-7b498ef15e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:54.539177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae159a-4350-4336-9d39-7b498ef15e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:54.539878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae159a-4350-4336-9d39-7b498ef15e2f admin admin] PATH_INFO: `/v3/projects/ede8b9edfd1a46738110a797f00e6297/users/f1aa84f59509464bb5e1958315821f12/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:54.542118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae159a-4350-4336-9d39-7b498ef15e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede8b9edfd1a46738110a797f00e6297, user_id=f1aa84f59509464bb5e1958315821f12, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:54.553211 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae159a-4350-4336-9d39-7b498ef15e2f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:54.554798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1236/2470] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:46:54 2022] PUT /identity/v3/projects/ede8b9edfd1a46738110a797f00e6297/users/f1aa84f59509464bb5e1958315821f12/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:46:54.566303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c86e94-cc91-4bcf-96f4-b325cb420a5e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:54.566589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c86e94-cc91-4bcf-96f4-b325cb420a5e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:54.566863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c86e94-cc91-4bcf-96f4-b325cb420a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:54.599281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c2c86e94-cc91-4bcf-96f4-b325cb420a5e None None] MFA Rules not processed for user `f1aa84f59509464bb5e1958315821f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:54.600285 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c2c86e94-cc91-4bcf-96f4-b325cb420a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:54.670225 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1235/2471] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:46:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:54.683111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae159a-4350-4336-9d39-7b498ef15e2f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:54.685193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-0aae159a-4350-4336-9d39-7b498ef15e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:54.734467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:54.752399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae159a-4350-4336-9d39-7b498ef15e2f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:54.756007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5295a1e-3530-43fb-80a7-c0defce01324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:54.756612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5295a1e-3530-43fb-80a7-c0defce01324 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:54.756893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5295a1e-3530-43fb-80a7-c0defce01324 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:54.757229 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5295a1e-3530-43fb-80a7-c0defce01324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:54.767112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5295a1e-3530-43fb-80a7-c0defce01324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:54.768575 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5295a1e-3530-43fb-80a7-c0defce01324 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:54.779723 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1237/2472] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:54.883954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c86e94-cc91-4bcf-96f4-b325cb420a5e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:54.885403 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c2c86e94-cc91-4bcf-96f4-b325cb420a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:54.896894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c86e94-cc91-4bcf-96f4-b325cb420a5e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:54.900469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a021a1-7cdc-40e8-bf3d-8e263eb07b5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:54.901088 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a021a1-7cdc-40e8-bf3d-8e263eb07b5d service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:54.901366 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a021a1-7cdc-40e8-bf3d-8e263eb07b5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:54.901633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a021a1-7cdc-40e8-bf3d-8e263eb07b5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:54.973476 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a021a1-7cdc-40e8-bf3d-8e263eb07b5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:54.975885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a021a1-7cdc-40e8-bf3d-8e263eb07b5d service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:54.988770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1236/2473] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:46:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:46:56.031415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379706e0-9413-4aea-9253-5ea0c98e6dc5 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:56.031996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379706e0-9413-4aea-9253-5ea0c98e6dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:56.031996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379706e0-9413-4aea-9253-5ea0c98e6dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:56.065641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-379706e0-9413-4aea-9253-5ea0c98e6dc5 None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:46:56.066954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-379706e0-9413-4aea-9253-5ea0c98e6dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:56.131987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1238/2474] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:46:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:46:56.144634 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a021a1-7cdc-40e8-bf3d-8e263eb07b5d service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:56.146127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c4a021a1-7cdc-40e8-bf3d-8e263eb07b5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:46:56.183271 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:56.257472 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a021a1-7cdc-40e8-bf3d-8e263eb07b5d service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:56.262928 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d6319-e777-4567-95f2-a697b18e2fca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:56.264259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d6319-e777-4567-95f2-a697b18e2fca service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:56.264259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d6319-e777-4567-95f2-a697b18e2fca service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:56.264259 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d6319-e777-4567-95f2-a697b18e2fca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:56.272300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d6319-e777-4567-95f2-a697b18e2fca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:56.274484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d6319-e777-4567-95f2-a697b18e2fca service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:56.283330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1237/2475] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:46:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 04:46:59.565272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379706e0-9413-4aea-9253-5ea0c98e6dc5 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:46:59.683014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379706e0-9413-4aea-9253-5ea0c98e6dc5 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:46:59.687912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f07e2-a54a-45d6-bff0-a10474fa79b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:46:59.688622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f07e2-a54a-45d6-bff0-a10474fa79b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:46:59.689021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f07e2-a54a-45d6-bff0-a10474fa79b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:46:59.689477 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f07e2-a54a-45d6-bff0-a10474fa79b0 admin admin] PATH_INFO: `/v3/users/3145e08b552741ea9465558e6970efe7` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:46:59.690702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f07e2-a54a-45d6-bff0-a10474fa79b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3145e08b552741ea9465558e6970efe7)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:46:59.693061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f07e2-a54a-45d6-bff0-a10474fa79b0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:46:59.893296 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8a5f07e2-a54a-45d6-bff0-a10474fa79b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3145e08b552741ea9465558e6970efe7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:59.965988 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8a5f07e2-a54a-45d6-bff0-a10474fa79b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3145e08b552741ea9465558e6970efe7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:59.966745 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8a5f07e2-a54a-45d6-bff0-a10474fa79b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3145e08b552741ea9465558e6970efe7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:46:59.968827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:46:59.982845 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8a5f07e2-a54a-45d6-bff0-a10474fa79b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3145e08b552741ea9465558e6970efe7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:00.001543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8a5f07e2-a54a-45d6-bff0-a10474fa79b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3145e08b552741ea9465558e6970efe7'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:00.007991 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1239/2476] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:46:59 2022] DELETE /identity/v3/users/3145e08b552741ea9465558e6970efe7 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:47:00.013105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17ae7c-bc8a-4ea2-a2dd-f800f1c3a549 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:00.013619 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17ae7c-bc8a-4ea2-a2dd-f800f1c3a549 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:00.013717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17ae7c-bc8a-4ea2-a2dd-f800f1c3a549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:00.077846 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5d17ae7c-bc8a-4ea2-a2dd-f800f1c3a549 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:00.079320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5d17ae7c-bc8a-4ea2-a2dd-f800f1c3a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:00.147257 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1238/2477] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:47:00.162043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f07e2-a54a-45d6-bff0-a10474fa79b0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:00.162043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8a5f07e2-a54a-45d6-bff0-a10474fa79b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:00.268454 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f07e2-a54a-45d6-bff0-a10474fa79b0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:00.271995 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33de4a-492d-4b19-9cd5-2b533bba3a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:00.272598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33de4a-492d-4b19-9cd5-2b533bba3a04 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:00.272874 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33de4a-492d-4b19-9cd5-2b533bba3a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:00.273171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33de4a-492d-4b19-9cd5-2b533bba3a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:00.285202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33de4a-492d-4b19-9cd5-2b533bba3a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:00.286950 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33de4a-492d-4b19-9cd5-2b533bba3a04 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:00.306486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1240/2478] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:00.429191 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17ae7c-bc8a-4ea2-a2dd-f800f1c3a549 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:00.431463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5d17ae7c-bc8a-4ea2-a2dd-f800f1c3a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:00.536588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17ae7c-bc8a-4ea2-a2dd-f800f1c3a549 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:00.543898 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d307f9-e6ee-412e-aac5-ba0686b8d6be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:00.544496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d307f9-e6ee-412e-aac5-ba0686b8d6be service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:00.544785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d307f9-e6ee-412e-aac5-ba0686b8d6be service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:00.545142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d307f9-e6ee-412e-aac5-ba0686b8d6be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:00.557986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-61d307f9-e6ee-412e-aac5-ba0686b8d6be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:00.608161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:00.672029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d307f9-e6ee-412e-aac5-ba0686b8d6be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:00.673930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d307f9-e6ee-412e-aac5-ba0686b8d6be service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:00.688488 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1239/2479] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:00.970448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33de4a-492d-4b19-9cd5-2b533bba3a04 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:00.971948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8d33de4a-492d-4b19-9cd5-2b533bba3a04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:00.986123 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33de4a-492d-4b19-9cd5-2b533bba3a04 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:00.991085 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:00.991792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:00.992143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:00.992483 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] PATH_INFO: `/v3/projects/8329da8f9fcc48398fe29979508fa7ef` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:00.994664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8329da8f9fcc48398fe29979508fa7ef)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:00.996653 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:01.115351 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8329da8f9fcc48398fe29979508fa7ef', 'request_id': 'req-2f3599bb-e6f6-4d01-bcca-9de100c08b27'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:01.124429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8329da8f9fcc48398fe29979508fa7ef', 'request_id': 'req-2f3599bb-e6f6-4d01-bcca-9de100c08b27'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:01.199823 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8329da8f9fcc48398fe29979508fa7ef', 'request_id': 'req-2f3599bb-e6f6-4d01-bcca-9de100c08b27'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:01.212459 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] The token cache is being invalidate because project 8329da8f9fcc48398fe29979508fa7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:47:01.212891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:01.213878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:01.215937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1241/2480] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:47:00 2022] DELETE /identity/v3/projects/8329da8f9fcc48398fe29979508fa7ef => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:01.219749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d307f9-e6ee-412e-aac5-ba0686b8d6be service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:01.231756 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d307f9-e6ee-412e-aac5-ba0686b8d6be service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:01.295537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8bc1f-7dbe-4781-bc72-d39634ed28c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:01.296188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8bc1f-7dbe-4781-bc72-d39634ed28c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:01.296470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8bc1f-7dbe-4781-bc72-d39634ed28c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:01.296749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8bc1f-7dbe-4781-bc72-d39634ed28c3 admin admin] PATH_INFO: `/v3/users/417601821d8a49e8a93bab582db01fd6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:01.298001 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8bc1f-7dbe-4781-bc72-d39634ed28c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=417601821d8a49e8a93bab582db01fd6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:01.299975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8bc1f-7dbe-4781-bc72-d39634ed28c3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:01.510806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-81c8bc1f-7dbe-4781-bc72-d39634ed28c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '417601821d8a49e8a93bab582db01fd6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:01.518623 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-81c8bc1f-7dbe-4781-bc72-d39634ed28c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '417601821d8a49e8a93bab582db01fd6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:01.533507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-81c8bc1f-7dbe-4781-bc72-d39634ed28c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '417601821d8a49e8a93bab582db01fd6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:01.596739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-81c8bc1f-7dbe-4781-bc72-d39634ed28c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '417601821d8a49e8a93bab582db01fd6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:01.597413 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-81c8bc1f-7dbe-4781-bc72-d39634ed28c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '417601821d8a49e8a93bab582db01fd6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:01.615680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1240/2481] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:47:01 2022] DELETE /identity/v3/users/417601821d8a49e8a93bab582db01fd6 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:02.969041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:02.970522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:02.993295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3599bb-e6f6-4d01-bcca-9de100c08b27 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:03.052722 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:03.110854 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:03.111541 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:03.111818 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:03.112109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] PATH_INFO: `/v3/projects/866c3a61dbea44988831580495171f03` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:03.113295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=866c3a61dbea44988831580495171f03)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:03.115323 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:03.288820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866c3a61dbea44988831580495171f03', 'request_id': 'req-42857d43-0a36-478e-8aee-79104a0e1182'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:03.297026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866c3a61dbea44988831580495171f03', 'request_id': 'req-42857d43-0a36-478e-8aee-79104a0e1182'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:03.405986 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866c3a61dbea44988831580495171f03', 'request_id': 'req-42857d43-0a36-478e-8aee-79104a0e1182'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:03.421118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] The token cache is being invalidate because project 866c3a61dbea44988831580495171f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:47:03.421503 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:03.422065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:03.423808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1242/2482] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:47:02 2022] DELETE /identity/v3/projects/866c3a61dbea44988831580495171f03 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:03.427730 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8bc1f-7dbe-4781-bc72-d39634ed28c3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:03.429359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-81c8bc1f-7dbe-4781-bc72-d39634ed28c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:03.446852 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8bc1f-7dbe-4781-bc72-d39634ed28c3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:03.481354 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:03.510618 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a7b65-78ac-46e7-a53b-f26957834283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:03.511278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a7b65-78ac-46e7-a53b-f26957834283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:03.511588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a7b65-78ac-46e7-a53b-f26957834283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:03.511882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a7b65-78ac-46e7-a53b-f26957834283 admin admin] PATH_INFO: `/v3/users/f1aa84f59509464bb5e1958315821f12` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:03.513162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a7b65-78ac-46e7-a53b-f26957834283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1aa84f59509464bb5e1958315821f12)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:03.515081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a7b65-78ac-46e7-a53b-f26957834283 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:03.779846 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ff9a7b65-78ac-46e7-a53b-f26957834283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1aa84f59509464bb5e1958315821f12'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:03.786972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ff9a7b65-78ac-46e7-a53b-f26957834283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1aa84f59509464bb5e1958315821f12'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:03.799254 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ff9a7b65-78ac-46e7-a53b-f26957834283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1aa84f59509464bb5e1958315821f12'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:03.902804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ff9a7b65-78ac-46e7-a53b-f26957834283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1aa84f59509464bb5e1958315821f12'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:03.903542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ff9a7b65-78ac-46e7-a53b-f26957834283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1aa84f59509464bb5e1958315821f12'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:03.910902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1241/2483] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:47:03 2022] DELETE /identity/v3/users/f1aa84f59509464bb5e1958315821f12 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:04.373406 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:04.375666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:04.390488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42857d43-0a36-478e-8aee-79104a0e1182 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:04.451426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1f456-aa84-4958-a826-24d8fd8513b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:04.452113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1f456-aa84-4958-a826-24d8fd8513b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:04.452390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1f456-aa84-4958-a826-24d8fd8513b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:04.452686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1f456-aa84-4958-a826-24d8fd8513b1 admin admin] PATH_INFO: `/v3/projects/ede8b9edfd1a46738110a797f00e6297` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:04.453870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1f456-aa84-4958-a826-24d8fd8513b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede8b9edfd1a46738110a797f00e6297)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:04.456010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1f456-aa84-4958-a826-24d8fd8513b1 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:04.563709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e6e1f456-aa84-4958-a826-24d8fd8513b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede8b9edfd1a46738110a797f00e6297', 'request_id': 'req-e6e1f456-aa84-4958-a826-24d8fd8513b1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:04.570801 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e6e1f456-aa84-4958-a826-24d8fd8513b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede8b9edfd1a46738110a797f00e6297', 'request_id': 'req-e6e1f456-aa84-4958-a826-24d8fd8513b1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:04.573944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:04.674342 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e6e1f456-aa84-4958-a826-24d8fd8513b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede8b9edfd1a46738110a797f00e6297', 'request_id': 'req-e6e1f456-aa84-4958-a826-24d8fd8513b1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:04.686291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e6e1f456-aa84-4958-a826-24d8fd8513b1 admin admin] The token cache is being invalidate because project ede8b9edfd1a46738110a797f00e6297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:47:04.686574 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e6e1f456-aa84-4958-a826-24d8fd8513b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:04.687206 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-e6e1f456-aa84-4958-a826-24d8fd8513b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:04.688663 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1243/2484] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:47:04 2022] DELETE /identity/v3/projects/ede8b9edfd1a46738110a797f00e6297 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:04.694493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81bc56-d17e-4679-895e-526b3a3f1e62 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:04.694963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81bc56-d17e-4679-895e-526b3a3f1e62 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:04.695058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81bc56-d17e-4679-895e-526b3a3f1e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:04.745564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7a81bc56-d17e-4679-895e-526b3a3f1e62 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:04.746776 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7a81bc56-d17e-4679-895e-526b3a3f1e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:04.804466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1242/2485] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:47:04.813524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ba9ca-5e68-48b7-a457-775bf9af75b7 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:04.813880 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ba9ca-5e68-48b7-a457-775bf9af75b7 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:04.814159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ba9ca-5e68-48b7-a457-775bf9af75b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:04.834573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-b02ba9ca-5e68-48b7-a457-775bf9af75b7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:04.835788 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b02ba9ca-5e68-48b7-a457-775bf9af75b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:04.844063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1244/2486] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:47:04.848188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81bc56-d17e-4679-895e-526b3a3f1e62 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:04.857802 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81bc56-d17e-4679-895e-526b3a3f1e62 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:04.862320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5deeb5-a92f-43d7-83be-4e6d6ec52acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:04.862911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5deeb5-a92f-43d7-83be-4e6d6ec52acd admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:04.863186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5deeb5-a92f-43d7-83be-4e6d6ec52acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:04.863455 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5deeb5-a92f-43d7-83be-4e6d6ec52acd admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:04.864094 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5deeb5-a92f-43d7-83be-4e6d6ec52acd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:47:04.864396 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5deeb5-a92f-43d7-83be-4e6d6ec52acd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:04.866033 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5deeb5-a92f-43d7-83be-4e6d6ec52acd admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:04.878104 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1243/2487] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:47:04.882468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ba9ca-5e68-48b7-a457-775bf9af75b7 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:04.892228 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ba9ca-5e68-48b7-a457-775bf9af75b7 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:04.897035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b1e79-a531-4edd-82cc-86cfe4ebe990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:04.897630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b1e79-a531-4edd-82cc-86cfe4ebe990 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:04.897905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b1e79-a531-4edd-82cc-86cfe4ebe990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:04.898212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b1e79-a531-4edd-82cc-86cfe4ebe990 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:04.898836 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b1e79-a531-4edd-82cc-86cfe4ebe990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:04.900860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b1e79-a531-4edd-82cc-86cfe4ebe990 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:05.009840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1245/2488] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:47:04 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:47:05.014222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5deeb5-a92f-43d7-83be-4e6d6ec52acd admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:05.024215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5deeb5-a92f-43d7-83be-4e6d6ec52acd admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:05.035903 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:05.081250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc958-6d7c-424e-ae40-909d13e2c8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:05.081250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc958-6d7c-424e-ae40-909d13e2c8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:05.081250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc958-6d7c-424e-ae40-909d13e2c8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:05.081250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc958-6d7c-424e-ae40-909d13e2c8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:05.081804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cc958-6d7c-424e-ae40-909d13e2c8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:05.083716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cc958-6d7c-424e-ae40-909d13e2c8e2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:05.168978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1244/2489] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:47:05 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:47:05.172984 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b1e79-a531-4edd-82cc-86cfe4ebe990 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:05.184262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b1e79-a531-4edd-82cc-86cfe4ebe990 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:05.189152 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6270d4f-4bca-4bfb-9f62-f5a315f8f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:05.189789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6270d4f-4bca-4bfb-9f62-f5a315f8f221 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:05.190064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6270d4f-4bca-4bfb-9f62-f5a315f8f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:05.190330 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6270d4f-4bca-4bfb-9f62-f5a315f8f221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:05.190960 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6270d4f-4bca-4bfb-9f62-f5a315f8f221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:05.192585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6270d4f-4bca-4bfb-9f62-f5a315f8f221 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:05.202806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1246/2490] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:47:05.206842 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc958-6d7c-424e-ae40-909d13e2c8e2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:05.217505 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc958-6d7c-424e-ae40-909d13e2c8e2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:05.222357 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953daed-18d4-4950-8b5b-55bbaff75c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:05.222945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953daed-18d4-4950-8b5b-55bbaff75c77 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:05.223221 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953daed-18d4-4950-8b5b-55bbaff75c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:05.223492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953daed-18d4-4950-8b5b-55bbaff75c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:05.224129 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953daed-18d4-4950-8b5b-55bbaff75c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:05.225781 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953daed-18d4-4950-8b5b-55bbaff75c77 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:05.237525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1245/2491] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:47:05.245494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6270d4f-4bca-4bfb-9f62-f5a315f8f221 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:05.252072 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6270d4f-4bca-4bfb-9f62-f5a315f8f221 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:05.256666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f4885-efe2-4824-b59b-4e756c59bf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:05.257335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4885-efe2-4824-b59b-4e756c59bf1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:05.257612 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4885-efe2-4824-b59b-4e756c59bf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:05.257886 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4885-efe2-4824-b59b-4e756c59bf1c admin admin] PATH_INFO: `/v3/projects/d016dc08edc64ce1b499c4f7fa53dd2b/users/2c072acd8d1541339fae5c057848d715/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:05.272851 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f4885-efe2-4824-b59b-4e756c59bf1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d016dc08edc64ce1b499c4f7fa53dd2b, user_id=2c072acd8d1541339fae5c057848d715, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:05.275704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f4885-efe2-4824-b59b-4e756c59bf1c admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:05.394836 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1247/2492] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:47:05 2022] PUT /identity/v3/projects/d016dc08edc64ce1b499c4f7fa53dd2b/users/2c072acd8d1541339fae5c057848d715/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:05.406483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8686fde-9121-40b8-9f58-a2f585e35a1b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:05.406930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8686fde-9121-40b8-9f58-a2f585e35a1b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:05.407235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8686fde-9121-40b8-9f58-a2f585e35a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:05.437600 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d8686fde-9121-40b8-9f58-a2f585e35a1b None None] MFA Rules not processed for user `2c072acd8d1541339fae5c057848d715`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:05.438837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d8686fde-9121-40b8-9f58-a2f585e35a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:05.503974 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1246/2493] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:47:05.508451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f4885-efe2-4824-b59b-4e756c59bf1c admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:05.570192 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f4885-efe2-4824-b59b-4e756c59bf1c admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:05.574901 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ff7ec-6331-474b-9fa0-bf451163c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:05.575497 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ff7ec-6331-474b-9fa0-bf451163c2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:05.575778 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ff7ec-6331-474b-9fa0-bf451163c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:05.576050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ff7ec-6331-474b-9fa0-bf451163c2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:05.576677 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ff7ec-6331-474b-9fa0-bf451163c2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:05.578731 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ff7ec-6331-474b-9fa0-bf451163c2f3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:05.654970 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1248/2494] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:47:05 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:47:05.659057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8686fde-9121-40b8-9f58-a2f585e35a1b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:05.673283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8686fde-9121-40b8-9f58-a2f585e35a1b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:05.736503 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57f7e5-cac4-45f8-8995-5f18ab6870d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:05.737139 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57f7e5-cac4-45f8-8995-5f18ab6870d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:05.737419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57f7e5-cac4-45f8-8995-5f18ab6870d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:05.737687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57f7e5-cac4-45f8-8995-5f18ab6870d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:05.738358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57f7e5-cac4-45f8-8995-5f18ab6870d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:05.740354 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57f7e5-cac4-45f8-8995-5f18ab6870d9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:05.841750 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1247/2495] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:47:05 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:47:05.845615 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ff7ec-6331-474b-9fa0-bf451163c2f3 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:05.856057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ff7ec-6331-474b-9fa0-bf451163c2f3 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:05.860567 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ada8a-45a2-451d-a606-49945985ee01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:05.861198 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ada8a-45a2-451d-a606-49945985ee01 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:05.861475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ada8a-45a2-451d-a606-49945985ee01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:05.861802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ada8a-45a2-451d-a606-49945985ee01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:05.862443 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ada8a-45a2-451d-a606-49945985ee01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:05.864029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ada8a-45a2-451d-a606-49945985ee01 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:05.874614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1249/2496] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:47:05.878648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57f7e5-cac4-45f8-8995-5f18ab6870d9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:05.889162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57f7e5-cac4-45f8-8995-5f18ab6870d9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:05.893781 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd54fa-6686-4706-a853-ce20a8fbfca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:05.894422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd54fa-6686-4706-a853-ce20a8fbfca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:05.894703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd54fa-6686-4706-a853-ce20a8fbfca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:05.894972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd54fa-6686-4706-a853-ce20a8fbfca4 admin admin] PATH_INFO: `/v3/projects/3092e4649cbd4ee3a3db5208a18adfe2/users/b4fe3beb6a7945769d2ef7aed0a03944/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:05.906707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:05.910440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd54fa-6686-4706-a853-ce20a8fbfca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3092e4649cbd4ee3a3db5208a18adfe2, user_id=b4fe3beb6a7945769d2ef7aed0a03944, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:05.913146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd54fa-6686-4706-a853-ce20a8fbfca4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:06.052033 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1248/2497] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:47:05 2022] PUT /identity/v3/projects/3092e4649cbd4ee3a3db5208a18adfe2/users/b4fe3beb6a7945769d2ef7aed0a03944/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:06.056672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ada8a-45a2-451d-a606-49945985ee01 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:06.066820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ada8a-45a2-451d-a606-49945985ee01 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:06.108604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:06.124244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6dfb5-5828-4226-b42f-0c6aaf9acd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:06.124881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6dfb5-5828-4226-b42f-0c6aaf9acd78 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:06.125189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6dfb5-5828-4226-b42f-0c6aaf9acd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:06.125496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6dfb5-5828-4226-b42f-0c6aaf9acd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:06.126149 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6dfb5-5828-4226-b42f-0c6aaf9acd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:06.127734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6dfb5-5828-4226-b42f-0c6aaf9acd78 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:06.138469 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1250/2498] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:47:06.142712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd54fa-6686-4706-a853-ce20a8fbfca4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:06.153111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd54fa-6686-4706-a853-ce20a8fbfca4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:06.159807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241bc12-36e6-43ab-92a0-aa627d2b92fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:06.159807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241bc12-36e6-43ab-92a0-aa627d2b92fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:06.159807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241bc12-36e6-43ab-92a0-aa627d2b92fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:06.160177 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241bc12-36e6-43ab-92a0-aa627d2b92fa admin admin] PATH_INFO: `/v3/projects/3092e4649cbd4ee3a3db5208a18adfe2/users/b4fe3beb6a7945769d2ef7aed0a03944/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:06.162285 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241bc12-36e6-43ab-92a0-aa627d2b92fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3092e4649cbd4ee3a3db5208a18adfe2, user_id=b4fe3beb6a7945769d2ef7aed0a03944, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:06.164959 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241bc12-36e6-43ab-92a0-aa627d2b92fa admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:06.175660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1249/2499] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:47:06 2022] PUT /identity/v3/projects/3092e4649cbd4ee3a3db5208a18adfe2/users/b4fe3beb6a7945769d2ef7aed0a03944/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:47:06.187638 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f70a0a-9dc4-4d5b-8a52-c935c53e1da2 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:06.187920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f70a0a-9dc4-4d5b-8a52-c935c53e1da2 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:06.188187 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f70a0a-9dc4-4d5b-8a52-c935c53e1da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:06.218236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-74f70a0a-9dc4-4d5b-8a52-c935c53e1da2 None None] MFA Rules not processed for user `b4fe3beb6a7945769d2ef7aed0a03944`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:06.219533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-74f70a0a-9dc4-4d5b-8a52-c935c53e1da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:06.293219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1251/2500] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:47:06.304785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241bc12-36e6-43ab-92a0-aa627d2b92fa admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:06.307093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9241bc12-36e6-43ab-92a0-aa627d2b92fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:06.390013 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241bc12-36e6-43ab-92a0-aa627d2b92fa admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:06.393701 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613770c-e216-4597-9043-a3254c962320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:06.394302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613770c-e216-4597-9043-a3254c962320 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:06.394574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613770c-e216-4597-9043-a3254c962320 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:06.394841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613770c-e216-4597-9043-a3254c962320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:06.403888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613770c-e216-4597-9043-a3254c962320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:06.405438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613770c-e216-4597-9043-a3254c962320 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:06.414867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1250/2501] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:06.684637 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f70a0a-9dc4-4d5b-8a52-c935c53e1da2 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:06.694889 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f70a0a-9dc4-4d5b-8a52-c935c53e1da2 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:06.698622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef2b0d-9994-4e8b-b6e4-63b93c7f7cad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:06.699236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef2b0d-9994-4e8b-b6e4-63b93c7f7cad service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:06.699520 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef2b0d-9994-4e8b-b6e4-63b93c7f7cad service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:06.699794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef2b0d-9994-4e8b-b6e4-63b93c7f7cad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:06.761036 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef2b0d-9994-4e8b-b6e4-63b93c7f7cad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:06.765603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef2b0d-9994-4e8b-b6e4-63b93c7f7cad service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:06.773310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1252/2502] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:08.326704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613770c-e216-4597-9043-a3254c962320 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:08.328220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e613770c-e216-4597-9043-a3254c962320 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:08.403893 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613770c-e216-4597-9043-a3254c962320 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:08.410902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633276c-9620-47d4-bfc4-1686b9e90e8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:08.410902 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633276c-9620-47d4-bfc4-1686b9e90e8f service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:08.411200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633276c-9620-47d4-bfc4-1686b9e90e8f service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:08.411316 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633276c-9620-47d4-bfc4-1686b9e90e8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:08.412953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5633276c-9620-47d4-bfc4-1686b9e90e8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:08.426515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633276c-9620-47d4-bfc4-1686b9e90e8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:08.428162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633276c-9620-47d4-bfc4-1686b9e90e8f service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:08.439320 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1251/2503] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:11.981177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a20ad-f8c6-4c73-b233-d94cfd36ee95 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:11.981699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a20ad-f8c6-4c73-b233-d94cfd36ee95 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:11.981699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a20ad-f8c6-4c73-b233-d94cfd36ee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:12.016238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-7d0a20ad-f8c6-4c73-b233-d94cfd36ee95 None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:12.017473 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7d0a20ad-f8c6-4c73-b233-d94cfd36ee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:12.069796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:12.078279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1253/2504] 10.222.0.50 () {58 vars in 967 bytes} [Sat Sep 17 04:47:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:47:12.091124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633276c-9620-47d4-bfc4-1686b9e90e8f service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:12.092529 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5633276c-9620-47d4-bfc4-1686b9e90e8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:12.140085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:12.162596 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633276c-9620-47d4-bfc4-1686b9e90e8f service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:12.173588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f4be9-f7fe-4003-8575-77e34a41e05d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:12.173588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f4be9-f7fe-4003-8575-77e34a41e05d service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:12.173588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f4be9-f7fe-4003-8575-77e34a41e05d service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:12.173588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f4be9-f7fe-4003-8575-77e34a41e05d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:12.177464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f4be9-f7fe-4003-8575-77e34a41e05d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:12.179049 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f4be9-f7fe-4003-8575-77e34a41e05d service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:12.187385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1252/2505] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:47:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 04:47:12.997748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a20ad-f8c6-4c73-b233-d94cfd36ee95 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:12.999161 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7d0a20ad-f8c6-4c73-b233-d94cfd36ee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:13.068410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a20ad-f8c6-4c73-b233-d94cfd36ee95 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:13.074354 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181362e4-0643-4c3e-8106-e5f32b722ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:13.074936 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181362e4-0643-4c3e-8106-e5f32b722ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:13.075218 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181362e4-0643-4c3e-8106-e5f32b722ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:13.075530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181362e4-0643-4c3e-8106-e5f32b722ac3 admin admin] PATH_INFO: `/v3/users/7655aab9391147f5aefa680068ff2a21` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:13.076685 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181362e4-0643-4c3e-8106-e5f32b722ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7655aab9391147f5aefa680068ff2a21)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:13.078675 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181362e4-0643-4c3e-8106-e5f32b722ac3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:13.343726 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-181362e4-0643-4c3e-8106-e5f32b722ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7655aab9391147f5aefa680068ff2a21'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:13.420791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-181362e4-0643-4c3e-8106-e5f32b722ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7655aab9391147f5aefa680068ff2a21'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:13.421472 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-181362e4-0643-4c3e-8106-e5f32b722ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7655aab9391147f5aefa680068ff2a21'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:13.433978 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-181362e4-0643-4c3e-8106-e5f32b722ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7655aab9391147f5aefa680068ff2a21'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:13.446668 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-181362e4-0643-4c3e-8106-e5f32b722ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7655aab9391147f5aefa680068ff2a21'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:13.453121 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1254/2506] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:47:12 2022] DELETE /identity/v3/users/7655aab9391147f5aefa680068ff2a21 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:13.461912 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fe3ed-1c92-4669-87c3-666d26d409a5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:13.462404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fe3ed-1c92-4669-87c3-666d26d409a5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:13.462574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fe3ed-1c92-4669-87c3-666d26d409a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:13.483636 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d13fe3ed-1c92-4669-87c3-666d26d409a5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:13.484925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d13fe3ed-1c92-4669-87c3-666d26d409a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:13.544757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1253/2507] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:47:13.554508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181362e4-0643-4c3e-8106-e5f32b722ac3 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:13.556065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-181362e4-0643-4c3e-8106-e5f32b722ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:13.615984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fe3ed-1c92-4669-87c3-666d26d409a5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:13.617343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d13fe3ed-1c92-4669-87c3-666d26d409a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:13.617461 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181362e4-0643-4c3e-8106-e5f32b722ac3 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:13.622201 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda45e-49dd-49dc-b61c-3276aa4e456f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:13.623098 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda45e-49dd-49dc-b61c-3276aa4e456f service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:13.623554 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda45e-49dd-49dc-b61c-3276aa4e456f service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:13.624561 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda45e-49dd-49dc-b61c-3276aa4e456f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:13.629065 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fe3ed-1c92-4669-87c3-666d26d409a5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:13.634373 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82ab3c-be16-4531-b9c3-2fc6ffd6aaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:13.634373 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82ab3c-be16-4531-b9c3-2fc6ffd6aaca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:13.634691 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82ab3c-be16-4531-b9c3-2fc6ffd6aaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:13.635464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82ab3c-be16-4531-b9c3-2fc6ffd6aaca admin admin] PATH_INFO: `/v3/users/2c072acd8d1541339fae5c057848d715` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:13.635569 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cda45e-49dd-49dc-b61c-3276aa4e456f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:13.636002 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82ab3c-be16-4531-b9c3-2fc6ffd6aaca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c072acd8d1541339fae5c057848d715)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:13.636403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cda45e-49dd-49dc-b61c-3276aa4e456f service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:13.638028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82ab3c-be16-4531-b9c3-2fc6ffd6aaca admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:13.647177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1255/2508] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:13.854014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-be82ab3c-be16-4531-b9c3-2fc6ffd6aaca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c072acd8d1541339fae5c057848d715'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:13.857747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-be82ab3c-be16-4531-b9c3-2fc6ffd6aaca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c072acd8d1541339fae5c057848d715'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:13.870757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-be82ab3c-be16-4531-b9c3-2fc6ffd6aaca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c072acd8d1541339fae5c057848d715'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:13.934832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-be82ab3c-be16-4531-b9c3-2fc6ffd6aaca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c072acd8d1541339fae5c057848d715'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:13.935714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-be82ab3c-be16-4531-b9c3-2fc6ffd6aaca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c072acd8d1541339fae5c057848d715'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:13.942352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1254/2509] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:47:13 2022] DELETE /identity/v3/users/2c072acd8d1541339fae5c057848d715 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:47:13.948510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51ed4b-e8f5-4dac-8e44-6b26486b676e None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:13.949236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51ed4b-e8f5-4dac-8e44-6b26486b676e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:13.949236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51ed4b-e8f5-4dac-8e44-6b26486b676e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:13.968504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-4c51ed4b-e8f5-4dac-8e44-6b26486b676e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:13.969746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-4c51ed4b-e8f5-4dac-8e44-6b26486b676e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:13.988543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:14.030881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1256/2510] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:47:14.040579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82ab3c-be16-4531-b9c3-2fc6ffd6aaca admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:14.042735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-be82ab3c-be16-4531-b9c3-2fc6ffd6aaca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:14.096186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:14.102134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82ab3c-be16-4531-b9c3-2fc6ffd6aaca admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:14.102734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51ed4b-e8f5-4dac-8e44-6b26486b676e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:14.106477 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-4c51ed4b-e8f5-4dac-8e44-6b26486b676e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:14.111667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51c044-ed8c-4aa1-b18a-d670f4b6d5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:14.117044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51c044-ed8c-4aa1-b18a-d670f4b6d5ba service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:14.117044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51c044-ed8c-4aa1-b18a-d670f4b6d5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:14.117044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51c044-ed8c-4aa1-b18a-d670f4b6d5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:14.120527 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51ed4b-e8f5-4dac-8e44-6b26486b676e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:14.125721 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9b41d-b6e7-479c-ae43-0adde8756f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:14.126017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51c044-ed8c-4aa1-b18a-d670f4b6d5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:14.126953 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9b41d-b6e7-479c-ae43-0adde8756f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:14.127288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51c044-ed8c-4aa1-b18a-d670f4b6d5ba service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:14.127413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9b41d-b6e7-479c-ae43-0adde8756f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:14.127716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9b41d-b6e7-479c-ae43-0adde8756f37 admin admin] PATH_INFO: `/v3/projects/b7c15aa1a75048cc856555a9eedb1384` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:14.129172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9b41d-b6e7-479c-ae43-0adde8756f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c15aa1a75048cc856555a9eedb1384)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:14.131585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9b41d-b6e7-479c-ae43-0adde8756f37 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:14.139012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1255/2511] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:14.316789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-62e9b41d-b6e7-479c-ae43-0adde8756f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c15aa1a75048cc856555a9eedb1384', 'request_id': 'req-62e9b41d-b6e7-479c-ae43-0adde8756f37'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:14.323633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-62e9b41d-b6e7-479c-ae43-0adde8756f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c15aa1a75048cc856555a9eedb1384', 'request_id': 'req-62e9b41d-b6e7-479c-ae43-0adde8756f37'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:14.412661 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-62e9b41d-b6e7-479c-ae43-0adde8756f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c15aa1a75048cc856555a9eedb1384', 'request_id': 'req-62e9b41d-b6e7-479c-ae43-0adde8756f37'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:14.443802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-62e9b41d-b6e7-479c-ae43-0adde8756f37 admin admin] The token cache is being invalidate because project b7c15aa1a75048cc856555a9eedb1384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:47:14.443802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-62e9b41d-b6e7-479c-ae43-0adde8756f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:14.443802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-62e9b41d-b6e7-479c-ae43-0adde8756f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:14.443802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1257/2512] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:47:14 2022] DELETE /identity/v3/projects/b7c15aa1a75048cc856555a9eedb1384 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:47:14.444343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978ee41-25dc-408b-85d6-2b10f7a646bd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:14.444343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978ee41-25dc-408b-85d6-2b10f7a646bd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:14.444343 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978ee41-25dc-408b-85d6-2b10f7a646bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:14.456610 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3978ee41-25dc-408b-85d6-2b10f7a646bd None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:14.458117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3978ee41-25dc-408b-85d6-2b10f7a646bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:14.518947 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1256/2513] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:47:14.527272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65122b-c240-4660-bc8c-44b3e3b66f44 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:14.527519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65122b-c240-4660-bc8c-44b3e3b66f44 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:14.530724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65122b-c240-4660-bc8c-44b3e3b66f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:14.547831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2f65122b-c240-4660-bc8c-44b3e3b66f44 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:14.549096 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2f65122b-c240-4660-bc8c-44b3e3b66f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:14.557302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1258/2514] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:47:14.561492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978ee41-25dc-408b-85d6-2b10f7a646bd None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:14.571054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978ee41-25dc-408b-85d6-2b10f7a646bd None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:14.575664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6717715-7fb2-4273-a1cf-8e0b3b132df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:14.576255 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6717715-7fb2-4273-a1cf-8e0b3b132df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:14.576528 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6717715-7fb2-4273-a1cf-8e0b3b132df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:14.576795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6717715-7fb2-4273-a1cf-8e0b3b132df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:14.577472 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6717715-7fb2-4273-a1cf-8e0b3b132df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:47:14.577769 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6717715-7fb2-4273-a1cf-8e0b3b132df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:14.579368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6717715-7fb2-4273-a1cf-8e0b3b132df5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:14.585583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65122b-c240-4660-bc8c-44b3e3b66f44 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:14.587519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2f65122b-c240-4660-bc8c-44b3e3b66f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:14.593220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1257/2515] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:47:14.598597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6717715-7fb2-4273-a1cf-8e0b3b132df5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:14.604859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65122b-c240-4660-bc8c-44b3e3b66f44 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:14.609834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:14.610417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6717715-7fb2-4273-a1cf-8e0b3b132df5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:14.610587 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:14.610754 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:14.611007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] PATH_INFO: `/v3/projects/d016dc08edc64ce1b499c4f7fa53dd2b` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:14.612110 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d016dc08edc64ce1b499c4f7fa53dd2b)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:14.614148 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:14.616266 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc136f-a6c2-46ea-a316-0db76ef10763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:14.616970 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc136f-a6c2-46ea-a316-0db76ef10763 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:14.617395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc136f-a6c2-46ea-a316-0db76ef10763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:14.617556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc136f-a6c2-46ea-a316-0db76ef10763 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:14.618172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc136f-a6c2-46ea-a316-0db76ef10763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:14.620326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc136f-a6c2-46ea-a316-0db76ef10763 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:14.708621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1258/2516] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:47:14 2022] POST /identity/v3/projects => generated 397 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:47:14.709721 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc136f-a6c2-46ea-a316-0db76ef10763 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:14.731013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd016dc08edc64ce1b499c4f7fa53dd2b', 'request_id': 'req-db95968a-0a91-4631-99f0-c9382ee31762'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:14.737760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd016dc08edc64ce1b499c4f7fa53dd2b', 'request_id': 'req-db95968a-0a91-4631-99f0-c9382ee31762'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:14.781729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc136f-a6c2-46ea-a316-0db76ef10763 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:14.808945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd016dc08edc64ce1b499c4f7fa53dd2b', 'request_id': 'req-db95968a-0a91-4631-99f0-c9382ee31762'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:14.820097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] The token cache is being invalidate because project d016dc08edc64ce1b499c4f7fa53dd2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:47:14.820383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:14.821093 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:14.823393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1259/2517] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:47:14 2022] DELETE /identity/v3/projects/d016dc08edc64ce1b499c4f7fa53dd2b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:47:14.827310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:14.828678 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:14.842756 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722fd8b-4ee0-4195-9092-9f0e4f7dbb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:14.843362 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722fd8b-4ee0-4195-9092-9f0e4f7dbb89 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:14.843639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722fd8b-4ee0-4195-9092-9f0e4f7dbb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:14.843911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722fd8b-4ee0-4195-9092-9f0e4f7dbb89 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:14.844570 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722fd8b-4ee0-4195-9092-9f0e4f7dbb89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:14.846519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722fd8b-4ee0-4195-9092-9f0e4f7dbb89 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:14.855745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:14.857188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:14.894532 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95968a-0a91-4631-99f0-c9382ee31762 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:14.899128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1d133-41b9-40c1-865d-38648cd00357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:14.899774 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d133-41b9-40c1-865d-38648cd00357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:14.900045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d133-41b9-40c1-865d-38648cd00357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:14.900895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d133-41b9-40c1-865d-38648cd00357 admin admin] PATH_INFO: `/v3/users/b4fe3beb6a7945769d2ef7aed0a03944` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:14.902117 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1d133-41b9-40c1-865d-38648cd00357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4fe3beb6a7945769d2ef7aed0a03944)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:14.904022 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1d133-41b9-40c1-865d-38648cd00357 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:14.953370 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1259/2518] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:47:14 2022] POST /identity/v3/users => generated 299 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:47:14.957513 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722fd8b-4ee0-4195-9092-9f0e4f7dbb89 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:14.959147 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a722fd8b-4ee0-4195-9092-9f0e4f7dbb89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:14.971562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722fd8b-4ee0-4195-9092-9f0e4f7dbb89 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:14.976192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf1ab1-b9cd-4418-a0af-369ccf9875a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:14.976771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf1ab1-b9cd-4418-a0af-369ccf9875a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:14.977078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf1ab1-b9cd-4418-a0af-369ccf9875a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:14.977348 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf1ab1-b9cd-4418-a0af-369ccf9875a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:14.977977 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf1ab1-b9cd-4418-a0af-369ccf9875a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:14.979888 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf1ab1-b9cd-4418-a0af-369ccf9875a7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:14.990194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1260/2519] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:47:15.005322 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf1ab1-b9cd-4418-a0af-369ccf9875a7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:15.015811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf1ab1-b9cd-4418-a0af-369ccf9875a7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:15.020507 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421ec06-bf09-4cf8-923b-1571f1035335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:15.021187 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ec06-bf09-4cf8-923b-1571f1035335 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:15.021469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ec06-bf09-4cf8-923b-1571f1035335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:15.021740 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ec06-bf09-4cf8-923b-1571f1035335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:15.022401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421ec06-bf09-4cf8-923b-1571f1035335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:15.024020 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421ec06-bf09-4cf8-923b-1571f1035335 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:15.037784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1261/2520] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:47:15.041966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421ec06-bf09-4cf8-923b-1571f1035335 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:15.051393 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421ec06-bf09-4cf8-923b-1571f1035335 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:15.055991 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29840b-60e0-4ed5-8c1d-7135ef91b2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:15.057273 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29840b-60e0-4ed5-8c1d-7135ef91b2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:15.058585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29840b-60e0-4ed5-8c1d-7135ef91b2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:15.058585 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29840b-60e0-4ed5-8c1d-7135ef91b2b2 admin admin] PATH_INFO: `/v3/projects/f9ec20ee9af444a7b0be111816fda505/users/0e0cc77533d24b509ba3c10a1c1db197/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:15.072783 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29840b-60e0-4ed5-8c1d-7135ef91b2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ec20ee9af444a7b0be111816fda505, user_id=0e0cc77533d24b509ba3c10a1c1db197, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:15.075651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29840b-60e0-4ed5-8c1d-7135ef91b2b2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:15.122024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bdd1d133-41b9-40c1-865d-38648cd00357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4fe3beb6a7945769d2ef7aed0a03944'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:15.152657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1262/2521] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:47:15 2022] PUT /identity/v3/projects/f9ec20ee9af444a7b0be111816fda505/users/0e0cc77533d24b509ba3c10a1c1db197/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:47:15.163385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f7506-25cf-4a81-b5b5-87d6d17825a0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:15.163673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f7506-25cf-4a81-b5b5-87d6d17825a0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:15.163972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f7506-25cf-4a81-b5b5-87d6d17825a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:15.189686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bdd1d133-41b9-40c1-865d-38648cd00357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4fe3beb6a7945769d2ef7aed0a03944'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:15.190334 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bdd1d133-41b9-40c1-865d-38648cd00357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4fe3beb6a7945769d2ef7aed0a03944'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:15.192421 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a56f7506-25cf-4a81-b5b5-87d6d17825a0 None None] MFA Rules not processed for user `0e0cc77533d24b509ba3c10a1c1db197`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:15.193657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a56f7506-25cf-4a81-b5b5-87d6d17825a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:15.199165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bdd1d133-41b9-40c1-865d-38648cd00357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4fe3beb6a7945769d2ef7aed0a03944'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:15.216036 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bdd1d133-41b9-40c1-865d-38648cd00357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4fe3beb6a7945769d2ef7aed0a03944'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:15.220575 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1260/2522] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:47:14 2022] DELETE /identity/v3/users/b4fe3beb6a7945769d2ef7aed0a03944 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:47:15.260909 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1263/2523] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:47:15.272320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1d133-41b9-40c1-865d-38648cd00357 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:15.273910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-bdd1d133-41b9-40c1-865d-38648cd00357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:15.334839 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1d133-41b9-40c1-865d-38648cd00357 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:15.339588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b86a48-d0be-463c-8521-f18696b42280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:15.340166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b86a48-d0be-463c-8521-f18696b42280 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:15.340448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b86a48-d0be-463c-8521-f18696b42280 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:15.347757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b86a48-d0be-463c-8521-f18696b42280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:15.397478 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:15.400001 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b86a48-d0be-463c-8521-f18696b42280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:15.402099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b86a48-d0be-463c-8521-f18696b42280 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:15.411385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1261/2524] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:15 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:15.649148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f7506-25cf-4a81-b5b5-87d6d17825a0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:15.651878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a56f7506-25cf-4a81-b5b5-87d6d17825a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:15.721506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f7506-25cf-4a81-b5b5-87d6d17825a0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:15.760743 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:15.779857 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d35639-db5f-4f4b-9054-b0983b2ac544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:15.780493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d35639-db5f-4f4b-9054-b0983b2ac544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:15.780770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d35639-db5f-4f4b-9054-b0983b2ac544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:15.781074 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d35639-db5f-4f4b-9054-b0983b2ac544 admin admin] PATH_INFO: `/v3/projects/3092e4649cbd4ee3a3db5208a18adfe2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:15.782212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d35639-db5f-4f4b-9054-b0983b2ac544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3092e4649cbd4ee3a3db5208a18adfe2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:15.784338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d35639-db5f-4f4b-9054-b0983b2ac544 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:15.902538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e5d35639-db5f-4f4b-9054-b0983b2ac544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3092e4649cbd4ee3a3db5208a18adfe2', 'request_id': 'req-e5d35639-db5f-4f4b-9054-b0983b2ac544'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:15.908849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e5d35639-db5f-4f4b-9054-b0983b2ac544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3092e4649cbd4ee3a3db5208a18adfe2', 'request_id': 'req-e5d35639-db5f-4f4b-9054-b0983b2ac544'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:15.914681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e5d35639-db5f-4f4b-9054-b0983b2ac544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3092e4649cbd4ee3a3db5208a18adfe2', 'request_id': 'req-e5d35639-db5f-4f4b-9054-b0983b2ac544'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:15.998014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e5d35639-db5f-4f4b-9054-b0983b2ac544 admin admin] The token cache is being invalidate because project 3092e4649cbd4ee3a3db5208a18adfe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:47:15.998305 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e5d35639-db5f-4f4b-9054-b0983b2ac544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:15.998934 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e5d35639-db5f-4f4b-9054-b0983b2ac544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:16.000453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1264/2525] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:47:15 2022] DELETE /identity/v3/projects/3092e4649cbd4ee3a3db5208a18adfe2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:16.005412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d44f2-0629-4656-90ae-f3501f0e647d None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:16.005703 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d44f2-0629-4656-90ae-f3501f0e647d None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:16.005984 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d44f2-0629-4656-90ae-f3501f0e647d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:16.031987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-9e8d44f2-0629-4656-90ae-f3501f0e647d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:16.031987 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9e8d44f2-0629-4656-90ae-f3501f0e647d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:16.092020 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1262/2526] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:47:16.103883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5365cd7-fb69-4c58-9673-a863a8a41bb2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:16.104177 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5365cd7-fb69-4c58-9673-a863a8a41bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:16.104488 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5365cd7-fb69-4c58-9673-a863a8a41bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:16.124739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a5365cd7-fb69-4c58-9673-a863a8a41bb2 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:16.125995 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a5365cd7-fb69-4c58-9673-a863a8a41bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:16.134011 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1265/2527] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:47:16.138907 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d44f2-0629-4656-90ae-f3501f0e647d None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:16.150730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d44f2-0629-4656-90ae-f3501f0e647d None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:16.166955 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42bda9-f036-4985-ab03-31ec4253c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:16.167732 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42bda9-f036-4985-ab03-31ec4253c9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:16.168097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42bda9-f036-4985-ab03-31ec4253c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:16.168436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42bda9-f036-4985-ab03-31ec4253c9e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:16.169259 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42bda9-f036-4985-ab03-31ec4253c9e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:47:16.169584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42bda9-f036-4985-ab03-31ec4253c9e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:16.171509 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42bda9-f036-4985-ab03-31ec4253c9e7 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:16.186196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1263/2528] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:47:16.193856 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5365cd7-fb69-4c58-9673-a863a8a41bb2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:16.203440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5365cd7-fb69-4c58-9673-a863a8a41bb2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:16.212829 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346737c-0414-4ab1-a0bf-7557a9553f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:16.213472 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346737c-0414-4ab1-a0bf-7557a9553f0a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:16.213746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346737c-0414-4ab1-a0bf-7557a9553f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:16.214106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346737c-0414-4ab1-a0bf-7557a9553f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:16.214838 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346737c-0414-4ab1-a0bf-7557a9553f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:16.217062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346737c-0414-4ab1-a0bf-7557a9553f0a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:16.305498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1266/2529] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:47:16 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:47:16.307272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42bda9-f036-4985-ab03-31ec4253c9e7 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:16.317148 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42bda9-f036-4985-ab03-31ec4253c9e7 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:16.374715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985bb60-9949-41df-a1ee-61f761a71e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:16.375346 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985bb60-9949-41df-a1ee-61f761a71e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:16.375629 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985bb60-9949-41df-a1ee-61f761a71e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:16.375905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985bb60-9949-41df-a1ee-61f761a71e33 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:16.376543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985bb60-9949-41df-a1ee-61f761a71e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:16.378522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985bb60-9949-41df-a1ee-61f761a71e33 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:16.489687 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1264/2530] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:47:16 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:47:16.493747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346737c-0414-4ab1-a0bf-7557a9553f0a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:16.505012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346737c-0414-4ab1-a0bf-7557a9553f0a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:16.509537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d1762-00dc-4bf7-bf95-3bf00d4e8f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:16.510151 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d1762-00dc-4bf7-bf95-3bf00d4e8f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:16.510449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d1762-00dc-4bf7-bf95-3bf00d4e8f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:16.510730 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d1762-00dc-4bf7-bf95-3bf00d4e8f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:16.511313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d1762-00dc-4bf7-bf95-3bf00d4e8f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:16.512930 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d1762-00dc-4bf7-bf95-3bf00d4e8f7f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:16.522744 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1267/2531] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:47:16.526923 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985bb60-9949-41df-a1ee-61f761a71e33 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:16.537371 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985bb60-9949-41df-a1ee-61f761a71e33 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:16.542722 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66150192-0aba-42cb-bd8c-50f2aad4ec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:16.543338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66150192-0aba-42cb-bd8c-50f2aad4ec40 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:16.543615 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66150192-0aba-42cb-bd8c-50f2aad4ec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:16.543883 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66150192-0aba-42cb-bd8c-50f2aad4ec40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:16.544519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66150192-0aba-42cb-bd8c-50f2aad4ec40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:16.546243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66150192-0aba-42cb-bd8c-50f2aad4ec40 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:16.557670 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1265/2532] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:47:16.561548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d1762-00dc-4bf7-bf95-3bf00d4e8f7f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:16.571576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d1762-00dc-4bf7-bf95-3bf00d4e8f7f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:16.576407 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee57ca-cacd-4d5b-b8b6-2be570ccda8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:16.577090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee57ca-cacd-4d5b-b8b6-2be570ccda8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:16.577372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee57ca-cacd-4d5b-b8b6-2be570ccda8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:16.577739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee57ca-cacd-4d5b-b8b6-2be570ccda8d admin admin] PATH_INFO: `/v3/projects/14f1352f28e847caa90d6919b9a2f838/users/689649d2918c42eba3266c8fc44a9125/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:16.593768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee57ca-cacd-4d5b-b8b6-2be570ccda8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f1352f28e847caa90d6919b9a2f838, user_id=689649d2918c42eba3266c8fc44a9125, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:16.596441 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee57ca-cacd-4d5b-b8b6-2be570ccda8d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:16.701415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1268/2533] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:47:16 2022] PUT /identity/v3/projects/14f1352f28e847caa90d6919b9a2f838/users/689649d2918c42eba3266c8fc44a9125/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:16.706724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f3b03-7a2c-41d0-8006-6eebe39772f2 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:16.707002 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f3b03-7a2c-41d0-8006-6eebe39772f2 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:16.707272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f3b03-7a2c-41d0-8006-6eebe39772f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:16.728239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c52f3b03-7a2c-41d0-8006-6eebe39772f2 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:16.733715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c52f3b03-7a2c-41d0-8006-6eebe39772f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:16.788044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1266/2534] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:47:16.798380 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee57ca-cacd-4d5b-b8b6-2be570ccda8d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:16.800132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-04ee57ca-cacd-4d5b-b8b6-2be570ccda8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:16.856904 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee57ca-cacd-4d5b-b8b6-2be570ccda8d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:16.860581 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3e274-06f7-4d47-83ae-5b6d85486326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:16.861208 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3e274-06f7-4d47-83ae-5b6d85486326 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:16.861481 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3e274-06f7-4d47-83ae-5b6d85486326 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:16.861746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3e274-06f7-4d47-83ae-5b6d85486326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:16.871084 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3e274-06f7-4d47-83ae-5b6d85486326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:16.872495 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3e274-06f7-4d47-83ae-5b6d85486326 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:16.881845 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1269/2535] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:18.370427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8cf22-8050-4c8f-9c95-353c542a3361 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:18.371099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8cf22-8050-4c8f-9c95-353c542a3361 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:18.371099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8cf22-8050-4c8f-9c95-353c542a3361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:18.378554 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:18.401820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-a7f8cf22-8050-4c8f-9c95-353c542a3361 None None] MFA Rules not processed for user `689649d2918c42eba3266c8fc44a9125`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:18.402604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a7f8cf22-8050-4c8f-9c95-353c542a3361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:18.472951 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1267/2536] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:47:18.477527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3e274-06f7-4d47-83ae-5b6d85486326 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:18.490962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3e274-06f7-4d47-83ae-5b6d85486326 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:18.496645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f1668-63d7-478a-98a6-0cfc5621e13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:18.497333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f1668-63d7-478a-98a6-0cfc5621e13d admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:18.497667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f1668-63d7-478a-98a6-0cfc5621e13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:18.497983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f1668-63d7-478a-98a6-0cfc5621e13d admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:18.498795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f1668-63d7-478a-98a6-0cfc5621e13d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:18.500722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f1668-63d7-478a-98a6-0cfc5621e13d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:18.511459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:18.637928 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1270/2537] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:47:18 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:47:18.641914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8cf22-8050-4c8f-9c95-353c542a3361 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:18.652539 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8cf22-8050-4c8f-9c95-353c542a3361 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:18.709992 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228f930-18d1-4e04-a7e9-4866b4f99b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:18.710517 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228f930-18d1-4e04-a7e9-4866b4f99b3f admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:18.711422 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228f930-18d1-4e04-a7e9-4866b4f99b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:18.711698 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228f930-18d1-4e04-a7e9-4866b4f99b3f admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:18.712536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228f930-18d1-4e04-a7e9-4866b4f99b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:18.714570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228f930-18d1-4e04-a7e9-4866b4f99b3f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:18.784186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1268/2538] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:47:18 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:47:18.788154 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f1668-63d7-478a-98a6-0cfc5621e13d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:18.799087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f1668-63d7-478a-98a6-0cfc5621e13d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:18.803802 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d173f7-e20f-47f6-a36d-7f678f282a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:18.804394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d173f7-e20f-47f6-a36d-7f678f282a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:18.804675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d173f7-e20f-47f6-a36d-7f678f282a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:18.804950 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d173f7-e20f-47f6-a36d-7f678f282a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:18.805660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d173f7-e20f-47f6-a36d-7f678f282a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:18.807923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d173f7-e20f-47f6-a36d-7f678f282a7e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:18.817955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1271/2539] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:47:18.822030 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228f930-18d1-4e04-a7e9-4866b4f99b3f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:18.833057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228f930-18d1-4e04-a7e9-4866b4f99b3f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:18.837647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451d3a-5a82-4402-add3-248d4cd5c601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:18.838859 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451d3a-5a82-4402-add3-248d4cd5c601 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:18.839138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451d3a-5a82-4402-add3-248d4cd5c601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:18.839423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451d3a-5a82-4402-add3-248d4cd5c601 admin admin] PATH_INFO: `/v3/projects/f23509fc0efe4258a94b4aaf1038af8b/users/b5a816b0a7044e5482bdeb49abbe0fde/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:18.855450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d451d3a-5a82-4402-add3-248d4cd5c601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23509fc0efe4258a94b4aaf1038af8b, user_id=b5a816b0a7044e5482bdeb49abbe0fde, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:18.858312 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d451d3a-5a82-4402-add3-248d4cd5c601 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:18.926881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1269/2540] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:47:18 2022] PUT /identity/v3/projects/f23509fc0efe4258a94b4aaf1038af8b/users/b5a816b0a7044e5482bdeb49abbe0fde/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:47:18.930833 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d173f7-e20f-47f6-a36d-7f678f282a7e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:18.940839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d173f7-e20f-47f6-a36d-7f678f282a7e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:19.000146 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef467c-2b57-4992-8ab1-c5be5ca52259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:19.000754 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef467c-2b57-4992-8ab1-c5be5ca52259 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:19.001072 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef467c-2b57-4992-8ab1-c5be5ca52259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:19.001347 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef467c-2b57-4992-8ab1-c5be5ca52259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:19.001985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef467c-2b57-4992-8ab1-c5be5ca52259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:19.003629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef467c-2b57-4992-8ab1-c5be5ca52259 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:19.017280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1272/2541] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:47:19.018834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451d3a-5a82-4402-add3-248d4cd5c601 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:19.038218 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451d3a-5a82-4402-add3-248d4cd5c601 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:19.042804 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f427b-cd44-4753-9acf-1582f1fcdd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:19.043559 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f427b-cd44-4753-9acf-1582f1fcdd8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:19.043911 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f427b-cd44-4753-9acf-1582f1fcdd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:19.044363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f427b-cd44-4753-9acf-1582f1fcdd8b admin admin] PATH_INFO: `/v3/projects/f23509fc0efe4258a94b4aaf1038af8b/users/b5a816b0a7044e5482bdeb49abbe0fde/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:19.046473 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f427b-cd44-4753-9acf-1582f1fcdd8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23509fc0efe4258a94b4aaf1038af8b, user_id=b5a816b0a7044e5482bdeb49abbe0fde, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:19.049156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f427b-cd44-4753-9acf-1582f1fcdd8b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:19.060687 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1270/2542] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:47:19 2022] PUT /identity/v3/projects/f23509fc0efe4258a94b4aaf1038af8b/users/b5a816b0a7044e5482bdeb49abbe0fde/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:20.377248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8a601-5723-4dca-8463-06342baa1e36 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:20.377813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8a601-5723-4dca-8463-06342baa1e36 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:20.377813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8a601-5723-4dca-8463-06342baa1e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:20.407978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8af8a601-5723-4dca-8463-06342baa1e36 None None] MFA Rules not processed for user `b5a816b0a7044e5482bdeb49abbe0fde`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:20.409300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8af8a601-5723-4dca-8463-06342baa1e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:20.488911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1273/2543] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:47:20.505291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dc053-8e2f-41e5-9dba-62c7f18bf38f None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:20.505763 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dc053-8e2f-41e5-9dba-62c7f18bf38f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:20.505893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dc053-8e2f-41e5-9dba-62c7f18bf38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:20.527658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-bd6dc053-8e2f-41e5-9dba-62c7f18bf38f None None] MFA Rules not processed for user `689649d2918c42eba3266c8fc44a9125`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:20.528875 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-bd6dc053-8e2f-41e5-9dba-62c7f18bf38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:20.569926 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:20.584286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1271/2544] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:47:20.596434 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8a601-5723-4dca-8463-06342baa1e36 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:20.597985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8af8a601-5723-4dca-8463-06342baa1e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:20.657679 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:20.674333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8a601-5723-4dca-8463-06342baa1e36 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:20.680006 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb571eb-d772-4d1a-9010-52a52c229136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:20.680608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb571eb-d772-4d1a-9010-52a52c229136 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:20.680884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb571eb-d772-4d1a-9010-52a52c229136 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:20.681181 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb571eb-d772-4d1a-9010-52a52c229136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:20.689603 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb571eb-d772-4d1a-9010-52a52c229136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:20.691198 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb571eb-d772-4d1a-9010-52a52c229136 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:20.699836 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1274/2545] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:21.544098 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dc053-8e2f-41e5-9dba-62c7f18bf38f None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:21.545603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-bd6dc053-8e2f-41e5-9dba-62c7f18bf38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:21.619151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dc053-8e2f-41e5-9dba-62c7f18bf38f None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:21.623717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d494-66eb-4645-a18f-2612e42ad137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:21.624333 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d494-66eb-4645-a18f-2612e42ad137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:21.624610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d494-66eb-4645-a18f-2612e42ad137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:21.624877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d494-66eb-4645-a18f-2612e42ad137 admin admin] PATH_INFO: `/v3/users/0e0cc77533d24b509ba3c10a1c1db197` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:21.626018 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732d494-66eb-4645-a18f-2612e42ad137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0cc77533d24b509ba3c10a1c1db197)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:21.627990 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732d494-66eb-4645-a18f-2612e42ad137 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:21.847446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7732d494-66eb-4645-a18f-2612e42ad137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0cc77533d24b509ba3c10a1c1db197'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:21.935394 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7732d494-66eb-4645-a18f-2612e42ad137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0cc77533d24b509ba3c10a1c1db197'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:21.936004 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7732d494-66eb-4645-a18f-2612e42ad137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0cc77533d24b509ba3c10a1c1db197'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:21.943418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7732d494-66eb-4645-a18f-2612e42ad137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0cc77533d24b509ba3c10a1c1db197'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:21.955997 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7732d494-66eb-4645-a18f-2612e42ad137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0cc77533d24b509ba3c10a1c1db197'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:21.961954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1272/2546] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:47:21 2022] DELETE /identity/v3/users/0e0cc77533d24b509ba3c10a1c1db197 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:47:21.966814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a210e9-f063-43fb-a02e-08dd8e64ed19 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:21.967310 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a210e9-f063-43fb-a02e-08dd8e64ed19 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:21.967407 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a210e9-f063-43fb-a02e-08dd8e64ed19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:21.990185 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-42a210e9-f063-43fb-a02e-08dd8e64ed19 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:47:21.992130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-42a210e9-f063-43fb-a02e-08dd8e64ed19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:22.052172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1275/2547] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:47:22.062895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d494-66eb-4645-a18f-2612e42ad137 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:22.064408 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7732d494-66eb-4645-a18f-2612e42ad137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:22.124548 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d494-66eb-4645-a18f-2612e42ad137 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:22.128172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13480d7b-e202-4daa-a650-77b8bf431dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:22.128776 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13480d7b-e202-4daa-a650-77b8bf431dac service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:22.129091 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13480d7b-e202-4daa-a650-77b8bf431dac service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:22.129362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13480d7b-e202-4daa-a650-77b8bf431dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:22.138672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13480d7b-e202-4daa-a650-77b8bf431dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:22.140097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13480d7b-e202-4daa-a650-77b8bf431dac service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:22.149610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1273/2548] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:22.603540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a210e9-f063-43fb-a02e-08dd8e64ed19 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:22.605434 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-42a210e9-f063-43fb-a02e-08dd8e64ed19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:22.622010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a210e9-f063-43fb-a02e-08dd8e64ed19 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:22.637047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:22.637552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:22.637830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:22.638101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] PATH_INFO: `/v3/projects/f9ec20ee9af444a7b0be111816fda505` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:22.639310 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ec20ee9af444a7b0be111816fda505)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:22.641314 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:22.767936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ec20ee9af444a7b0be111816fda505', 'request_id': 'req-3cf72f3c-da91-40c8-859f-bdb38e17690e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:22.775264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ec20ee9af444a7b0be111816fda505', 'request_id': 'req-3cf72f3c-da91-40c8-859f-bdb38e17690e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:22.782325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ec20ee9af444a7b0be111816fda505', 'request_id': 'req-3cf72f3c-da91-40c8-859f-bdb38e17690e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:22.867355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] The token cache is being invalidate because project f9ec20ee9af444a7b0be111816fda505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:47:22.867734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:22.868363 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:22.870808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1276/2549] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:47:22 2022] DELETE /identity/v3/projects/f9ec20ee9af444a7b0be111816fda505 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:32.145479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:32.683438 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13480d7b-e202-4daa-a650-77b8bf431dac service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:32.686146 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-13480d7b-e202-4daa-a650-77b8bf431dac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:32.770504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13480d7b-e202-4daa-a650-77b8bf431dac service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:32.856750 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab11bf-f24a-4e14-ae17-f52b8282ba4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:32.857735 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab11bf-f24a-4e14-ae17-f52b8282ba4d service nova] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:32.858012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab11bf-f24a-4e14-ae17-f52b8282ba4d service nova] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:32.858286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab11bf-f24a-4e14-ae17-f52b8282ba4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:32.860176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-10ab11bf-f24a-4e14-ae17-f52b8282ba4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:32.864914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=61,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:32.939560 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab11bf-f24a-4e14-ae17-f52b8282ba4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:32.941201 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab11bf-f24a-4e14-ae17-f52b8282ba4d service nova] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:32.951305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1274/2550] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:34.207699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:34.209142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:34.265729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf72f3c-da91-40c8-859f-bdb38e17690e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:34.269341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f71d54-5a85-4c74-b4fe-2daca601fc5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:34.269935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f71d54-5a85-4c74-b4fe-2daca601fc5e service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:34.270211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f71d54-5a85-4c74-b4fe-2daca601fc5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:34.270481 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f71d54-5a85-4c74-b4fe-2daca601fc5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:34.272186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f9f71d54-5a85-4c74-b4fe-2daca601fc5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:34.333943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f71d54-5a85-4c74-b4fe-2daca601fc5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:34.335303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f71d54-5a85-4c74-b4fe-2daca601fc5e service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:34.345564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1277/2551] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:39.599155 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab11bf-f24a-4e14-ae17-f52b8282ba4d service nova] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:39.602269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-10ab11bf-f24a-4e14-ae17-f52b8282ba4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:39.643607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:39.661362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab11bf-f24a-4e14-ae17-f52b8282ba4d service nova] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:39.664941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed902c3-12e9-43a6-9c94-ace23b6db058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:39.665668 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed902c3-12e9-43a6-9c94-ace23b6db058 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:39.665947 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed902c3-12e9-43a6-9c94-ace23b6db058 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:39.666220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed902c3-12e9-43a6-9c94-ace23b6db058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:39.667929 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7ed902c3-12e9-43a6-9c94-ace23b6db058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:39.731392 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed902c3-12e9-43a6-9c94-ace23b6db058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:39.732817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed902c3-12e9-43a6-9c94-ace23b6db058 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:39.742283 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1275/2552] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:43.131889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f71d54-5a85-4c74-b4fe-2daca601fc5e service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:43.133861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f9f71d54-5a85-4c74-b4fe-2daca601fc5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:43.223871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f71d54-5a85-4c74-b4fe-2daca601fc5e service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:43.229039 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58429f3-ef60-4d7f-af30-7e9000e86f44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931a947711a2468baaeef701bbee60c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:43.229765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58429f3-ef60-4d7f-af30-7e9000e86f44 service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:43.231678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58429f3-ef60-4d7f-af30-7e9000e86f44 service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:43.231678 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58429f3-ef60-4d7f-af30-7e9000e86f44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:43.232280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a58429f3-ef60-4d7f-af30-7e9000e86f44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:43.244278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58429f3-ef60-4d7f-af30-7e9000e86f44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:43.245901 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58429f3-ef60-4d7f-af30-7e9000e86f44 service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:43.263540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1278/2553] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:47.629289 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed902c3-12e9-43a6-9c94-ace23b6db058 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:47.631325 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7ed902c3-12e9-43a6-9c94-ace23b6db058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:47.644800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed902c3-12e9-43a6-9c94-ace23b6db058 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:47.650066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c900ea8-64ec-4d9a-84fa-9c8d9a45ab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:47.650698 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c900ea8-64ec-4d9a-84fa-9c8d9a45ab58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:47.650979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c900ea8-64ec-4d9a-84fa-9c8d9a45ab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:47.651439 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c900ea8-64ec-4d9a-84fa-9c8d9a45ab58 admin admin] PATH_INFO: `/v3/users/99bd3ecdc90b4858b75e38569d74061d` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:47.653929 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c900ea8-64ec-4d9a-84fa-9c8d9a45ab58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99bd3ecdc90b4858b75e38569d74061d)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:47.656173 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c900ea8-64ec-4d9a-84fa-9c8d9a45ab58 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:47.868411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-1c900ea8-64ec-4d9a-84fa-9c8d9a45ab58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99bd3ecdc90b4858b75e38569d74061d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:47.949336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-1c900ea8-64ec-4d9a-84fa-9c8d9a45ab58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99bd3ecdc90b4858b75e38569d74061d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:47.953143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-1c900ea8-64ec-4d9a-84fa-9c8d9a45ab58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99bd3ecdc90b4858b75e38569d74061d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:47.968912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-1c900ea8-64ec-4d9a-84fa-9c8d9a45ab58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99bd3ecdc90b4858b75e38569d74061d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:47.982057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-1c900ea8-64ec-4d9a-84fa-9c8d9a45ab58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99bd3ecdc90b4858b75e38569d74061d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:47.988153 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1276/2554] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:47:47 2022] DELETE /identity/v3/users/99bd3ecdc90b4858b75e38569d74061d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:48.293474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58429f3-ef60-4d7f-af30-7e9000e86f44 service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:48.304900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58429f3-ef60-4d7f-af30-7e9000e86f44 service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:48.347817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:48.366465 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:48.367094 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:48.367369 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:48.367638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] PATH_INFO: `/v3/projects/ab96ef65234f4902be491defdb342df7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:48.368768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab96ef65234f4902be491defdb342df7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:48.370803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:48.542131 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab96ef65234f4902be491defdb342df7', 'request_id': 'req-498ebc54-a9bb-4c43-82e1-8533d23f16c0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:48.549209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab96ef65234f4902be491defdb342df7', 'request_id': 'req-498ebc54-a9bb-4c43-82e1-8533d23f16c0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:48.555177 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab96ef65234f4902be491defdb342df7', 'request_id': 'req-498ebc54-a9bb-4c43-82e1-8533d23f16c0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:48.637177 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] The token cache is being invalidate because project ab96ef65234f4902be491defdb342df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:47:48.639275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:48.639275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:48.640414 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1279/2555] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:47:48 2022] DELETE /identity/v3/projects/ab96ef65234f4902be491defdb342df7 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:48.644415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c900ea8-64ec-4d9a-84fa-9c8d9a45ab58 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:48.646096 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1c900ea8-64ec-4d9a-84fa-9c8d9a45ab58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:48.659256 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c900ea8-64ec-4d9a-84fa-9c8d9a45ab58 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:48.712112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:48.718420 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10c7c8-5e43-45f5-b32f-4a4de12b7a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:48.719035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10c7c8-5e43-45f5-b32f-4a4de12b7a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:48.719314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10c7c8-5e43-45f5-b32f-4a4de12b7a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:48.719580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10c7c8-5e43-45f5-b32f-4a4de12b7a9c admin admin] PATH_INFO: `/v3/users/18496859f88e4cd5bef0190ef2c252ea` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:48.720698 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10c7c8-5e43-45f5-b32f-4a4de12b7a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18496859f88e4cd5bef0190ef2c252ea)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:48.722702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10c7c8-5e43-45f5-b32f-4a4de12b7a9c admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:48.880335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3d10c7c8-5e43-45f5-b32f-4a4de12b7a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18496859f88e4cd5bef0190ef2c252ea'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:48.963168 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3d10c7c8-5e43-45f5-b32f-4a4de12b7a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18496859f88e4cd5bef0190ef2c252ea'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:48.963785 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3d10c7c8-5e43-45f5-b32f-4a4de12b7a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18496859f88e4cd5bef0190ef2c252ea'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:48.974592 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3d10c7c8-5e43-45f5-b32f-4a4de12b7a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18496859f88e4cd5bef0190ef2c252ea'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:48.987532 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-3d10c7c8-5e43-45f5-b32f-4a4de12b7a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18496859f88e4cd5bef0190ef2c252ea'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:48.995080 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1277/2556] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:47:48 2022] DELETE /identity/v3/users/18496859f88e4cd5bef0190ef2c252ea => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:49.253294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:49.254772 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:49.269670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ebc54-a9bb-4c43-82e1-8533d23f16c0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:49.330375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:49.331072 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:49.331310 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:49.331574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] PATH_INFO: `/v3/projects/efb06f919d494bc9a3d044d025bccf9c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:49.332708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb06f919d494bc9a3d044d025bccf9c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:49.334651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:49.500591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb06f919d494bc9a3d044d025bccf9c', 'request_id': 'req-49d26c09-49e1-4349-881b-2aa645bd6ca4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:49.507477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb06f919d494bc9a3d044d025bccf9c', 'request_id': 'req-49d26c09-49e1-4349-881b-2aa645bd6ca4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:49.516757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb06f919d494bc9a3d044d025bccf9c', 'request_id': 'req-49d26c09-49e1-4349-881b-2aa645bd6ca4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:49.658561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:49.662515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] The token cache is being invalidate because project efb06f919d494bc9a3d044d025bccf9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:47:49.662783 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:49.663424 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:49.664908 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1280/2557] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:47:49 2022] DELETE /identity/v3/projects/efb06f919d494bc9a3d044d025bccf9c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:56.381187 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10c7c8-5e43-45f5-b32f-4a4de12b7a9c admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:56.382733 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-3d10c7c8-5e43-45f5-b32f-4a4de12b7a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:56.448698 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10c7c8-5e43-45f5-b32f-4a4de12b7a9c admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:56.501995 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21d0fd-e416-496e-8e11-08dd53b304fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:56.502659 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21d0fd-e416-496e-8e11-08dd53b304fa service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:56.502938 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21d0fd-e416-496e-8e11-08dd53b304fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:56.503261 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21d0fd-e416-496e-8e11-08dd53b304fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:56.505129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ae21d0fd-e416-496e-8e11-08dd53b304fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:56.556614 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:47:56.574219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21d0fd-e416-496e-8e11-08dd53b304fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:56.575682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21d0fd-e416-496e-8e11-08dd53b304fa service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:56.585262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1278/2558] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:47:59.104435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:59.106012 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:47:59.129662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d26c09-49e1-4349-881b-2aa645bd6ca4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:59.136973 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fac6d8-4453-4bda-b71d-3970b43b1539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:59.138544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fac6d8-4453-4bda-b71d-3970b43b1539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:59.140159 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fac6d8-4453-4bda-b71d-3970b43b1539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:59.140790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fac6d8-4453-4bda-b71d-3970b43b1539 admin admin] PATH_INFO: `/v3/users/689649d2918c42eba3266c8fc44a9125` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:59.142826 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fac6d8-4453-4bda-b71d-3970b43b1539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=689649d2918c42eba3266c8fc44a9125)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:59.145542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fac6d8-4453-4bda-b71d-3970b43b1539 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:59.395498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-10fac6d8-4453-4bda-b71d-3970b43b1539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '689649d2918c42eba3266c8fc44a9125'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:59.402708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-10fac6d8-4453-4bda-b71d-3970b43b1539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '689649d2918c42eba3266c8fc44a9125'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:59.415706 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-10fac6d8-4453-4bda-b71d-3970b43b1539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '689649d2918c42eba3266c8fc44a9125'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:59.498179 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-10fac6d8-4453-4bda-b71d-3970b43b1539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '689649d2918c42eba3266c8fc44a9125'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:59.498905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-10fac6d8-4453-4bda-b71d-3970b43b1539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '689649d2918c42eba3266c8fc44a9125'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:59.506174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1281/2559] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:47:59 2022] DELETE /identity/v3/users/689649d2918c42eba3266c8fc44a9125 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:47:59.754524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21d0fd-e416-496e-8e11-08dd53b304fa service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:47:59.771644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21d0fd-e416-496e-8e11-08dd53b304fa service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:47:59.840392 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:47:59.841110 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:47:59.841323 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:47:59.841592 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] PATH_INFO: `/v3/projects/14f1352f28e847caa90d6919b9a2f838` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:47:59.842713 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f1352f28e847caa90d6919b9a2f838)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:47:59.845537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:47:59.979021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f1352f28e847caa90d6919b9a2f838', 'request_id': 'req-631ad126-17c4-4a86-8a08-11dad051cfa3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:47:59.988536 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f1352f28e847caa90d6919b9a2f838', 'request_id': 'req-631ad126-17c4-4a86-8a08-11dad051cfa3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:00.079069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f1352f28e847caa90d6919b9a2f838', 'request_id': 'req-631ad126-17c4-4a86-8a08-11dad051cfa3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:00.091057 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] The token cache is being invalidate because project 14f1352f28e847caa90d6919b9a2f838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:00.091349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:00.091982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:00.093607 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1279/2560] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:47:59 2022] DELETE /identity/v3/projects/14f1352f28e847caa90d6919b9a2f838 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:00.097807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fac6d8-4453-4bda-b71d-3970b43b1539 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:00.099303 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-10fac6d8-4453-4bda-b71d-3970b43b1539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:00.112638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fac6d8-4453-4bda-b71d-3970b43b1539 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:00.173119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00648a3d-921c-4854-b5c3-fd318e14b88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:00.173752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00648a3d-921c-4854-b5c3-fd318e14b88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:00.174028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00648a3d-921c-4854-b5c3-fd318e14b88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:00.179044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00648a3d-921c-4854-b5c3-fd318e14b88c admin admin] PATH_INFO: `/v3/users/b5a816b0a7044e5482bdeb49abbe0fde` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:00.179044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00648a3d-921c-4854-b5c3-fd318e14b88c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a816b0a7044e5482bdeb49abbe0fde)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:00.179044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00648a3d-921c-4854-b5c3-fd318e14b88c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:00.416444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-00648a3d-921c-4854-b5c3-fd318e14b88c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a816b0a7044e5482bdeb49abbe0fde'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:00.435143 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-00648a3d-921c-4854-b5c3-fd318e14b88c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a816b0a7044e5482bdeb49abbe0fde'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:00.453335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-00648a3d-921c-4854-b5c3-fd318e14b88c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a816b0a7044e5482bdeb49abbe0fde'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:00.455233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:00.572471 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-00648a3d-921c-4854-b5c3-fd318e14b88c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a816b0a7044e5482bdeb49abbe0fde'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:00.572471 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-00648a3d-921c-4854-b5c3-fd318e14b88c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a816b0a7044e5482bdeb49abbe0fde'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:00.578199 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1282/2561] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:00 2022] DELETE /identity/v3/users/b5a816b0a7044e5482bdeb49abbe0fde => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:00.854524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:00.857040 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:00.876255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ad126-17c4-4a86-8a08-11dad051cfa3 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:00.960280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb96547-a066-4acb-9ba9-b77912d1e209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:00.960895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb96547-a066-4acb-9ba9-b77912d1e209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:00.961207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb96547-a066-4acb-9ba9-b77912d1e209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:00.961479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb96547-a066-4acb-9ba9-b77912d1e209 admin admin] PATH_INFO: `/v3/projects/f23509fc0efe4258a94b4aaf1038af8b` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:00.962754 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb96547-a066-4acb-9ba9-b77912d1e209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f23509fc0efe4258a94b4aaf1038af8b)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:00.964797 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb96547-a066-4acb-9ba9-b77912d1e209 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:00.985109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:01.016815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00648a3d-921c-4854-b5c3-fd318e14b88c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:01.018430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-00648a3d-921c-4854-b5c3-fd318e14b88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:01.035150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00648a3d-921c-4854-b5c3-fd318e14b88c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:01.040160 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad7227-cd2c-40d1-8233-920ddc825c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:01.040796 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad7227-cd2c-40d1-8233-920ddc825c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:01.041638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad7227-cd2c-40d1-8233-920ddc825c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:01.041638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad7227-cd2c-40d1-8233-920ddc825c43 admin admin] PATH_INFO: `/v3/users/811bb431ddbb42638f909ebf6d921536` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:01.042532 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad7227-cd2c-40d1-8233-920ddc825c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=811bb431ddbb42638f909ebf6d921536)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:01.044440 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad7227-cd2c-40d1-8233-920ddc825c43 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:01.090115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bbb96547-a066-4acb-9ba9-b77912d1e209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f23509fc0efe4258a94b4aaf1038af8b', 'request_id': 'req-bbb96547-a066-4acb-9ba9-b77912d1e209'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:01.097222 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bbb96547-a066-4acb-9ba9-b77912d1e209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f23509fc0efe4258a94b4aaf1038af8b', 'request_id': 'req-bbb96547-a066-4acb-9ba9-b77912d1e209'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:01.159578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bbb96547-a066-4acb-9ba9-b77912d1e209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f23509fc0efe4258a94b4aaf1038af8b', 'request_id': 'req-bbb96547-a066-4acb-9ba9-b77912d1e209'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:01.171982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bbb96547-a066-4acb-9ba9-b77912d1e209 admin admin] The token cache is being invalidate because project f23509fc0efe4258a94b4aaf1038af8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:01.172276 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bbb96547-a066-4acb-9ba9-b77912d1e209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:01.172947 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-bbb96547-a066-4acb-9ba9-b77912d1e209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:01.174623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1280/2562] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:00 2022] DELETE /identity/v3/projects/f23509fc0efe4258a94b4aaf1038af8b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:01.179242 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479f40-9760-458a-88d3-82bf1e08ddf4 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:01.179522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479f40-9760-458a-88d3-82bf1e08ddf4 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:01.179791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479f40-9760-458a-88d3-82bf1e08ddf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:01.200294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-36479f40-9760-458a-88d3-82bf1e08ddf4 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:01.201551 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-36479f40-9760-458a-88d3-82bf1e08ddf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:01.261055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1281/2563] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:01.269281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39caffd-62b5-4348-9536-9e0638b3a395 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:01.269653 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39caffd-62b5-4348-9536-9e0638b3a395 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:01.269995 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39caffd-62b5-4348-9536-9e0638b3a395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:01.279795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-97ad7227-cd2c-40d1-8233-920ddc825c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '811bb431ddbb42638f909ebf6d921536'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:01.292239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c39caffd-62b5-4348-9536-9e0638b3a395 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:01.293566 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c39caffd-62b5-4348-9536-9e0638b3a395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:01.293708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-97ad7227-cd2c-40d1-8233-920ddc825c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '811bb431ddbb42638f909ebf6d921536'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:01.302846 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1282/2564] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:01.306890 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-97ad7227-cd2c-40d1-8233-920ddc825c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '811bb431ddbb42638f909ebf6d921536'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:01.307026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39caffd-62b5-4348-9536-9e0638b3a395 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:01.316545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39caffd-62b5-4348-9536-9e0638b3a395 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:01.321519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60548e35-2eaa-4205-b3f3-d246963d3ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:01.322747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60548e35-2eaa-4205-b3f3-d246963d3ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:01.323025 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60548e35-2eaa-4205-b3f3-d246963d3ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:01.323293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60548e35-2eaa-4205-b3f3-d246963d3ac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:01.323930 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60548e35-2eaa-4205-b3f3-d246963d3ac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:01.324232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60548e35-2eaa-4205-b3f3-d246963d3ac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:01.325957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60548e35-2eaa-4205-b3f3-d246963d3ac6 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:01.338215 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1283/2565] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:48:01.342523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60548e35-2eaa-4205-b3f3-d246963d3ac6 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:01.353681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60548e35-2eaa-4205-b3f3-d246963d3ac6 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:01.358451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e88e8a-9f3b-4804-86a6-9a622bb4af7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:01.361197 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e88e8a-9f3b-4804-86a6-9a622bb4af7e admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:01.361197 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e88e8a-9f3b-4804-86a6-9a622bb4af7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:01.361197 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e88e8a-9f3b-4804-86a6-9a622bb4af7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:01.361197 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e88e8a-9f3b-4804-86a6-9a622bb4af7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:01.362124 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e88e8a-9f3b-4804-86a6-9a622bb4af7e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:01.418292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-97ad7227-cd2c-40d1-8233-920ddc825c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '811bb431ddbb42638f909ebf6d921536'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:01.418932 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-97ad7227-cd2c-40d1-8233-920ddc825c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '811bb431ddbb42638f909ebf6d921536'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:01.425548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1283/2566] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:01 2022] DELETE /identity/v3/users/811bb431ddbb42638f909ebf6d921536 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:01.474566 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1284/2567] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:01 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:01.476133 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad7227-cd2c-40d1-8233-920ddc825c43 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:01.477685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-97ad7227-cd2c-40d1-8233-920ddc825c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:01.544641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad7227-cd2c-40d1-8233-920ddc825c43 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:01.604062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2796-252c-4a03-a15c-eb2bea435a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:01.604591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2796-252c-4a03-a15c-eb2bea435a37 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:01.604898 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2796-252c-4a03-a15c-eb2bea435a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:01.605197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2796-252c-4a03-a15c-eb2bea435a37 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:01.605836 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b2796-252c-4a03-a15c-eb2bea435a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:01.607746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b2796-252c-4a03-a15c-eb2bea435a37 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:01.703935 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e88e8a-9f3b-4804-86a6-9a622bb4af7e admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:01.705714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-93e88e8a-9f3b-4804-86a6-9a622bb4af7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:01.720161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=5,keystone:DELETE=11,keystone:SELECT=84 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:01.722892 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e88e8a-9f3b-4804-86a6-9a622bb4af7e admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:01.727830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1284/2568] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:01 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:01.730133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fb15f-7644-49fc-bbaf-64a7e4665618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:01.730133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fb15f-7644-49fc-bbaf-64a7e4665618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:01.730492 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fb15f-7644-49fc-bbaf-64a7e4665618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:01.730789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fb15f-7644-49fc-bbaf-64a7e4665618 admin admin] PATH_INFO: `/v3/projects/97a5a5fe7ded4421b43e435975a4dc3c` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:01.732736 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fb15f-7644-49fc-bbaf-64a7e4665618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a5a5fe7ded4421b43e435975a4dc3c)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:01.733229 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2796-252c-4a03-a15c-eb2bea435a37 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:01.736284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fb15f-7644-49fc-bbaf-64a7e4665618 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:01.743582 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2796-252c-4a03-a15c-eb2bea435a37 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:01.748462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80541c0e-de10-44c4-b232-a366e06f8bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:01.749069 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541c0e-de10-44c4-b232-a366e06f8bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:01.750133 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541c0e-de10-44c4-b232-a366e06f8bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:01.750563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541c0e-de10-44c4-b232-a366e06f8bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:01.751209 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80541c0e-de10-44c4-b232-a366e06f8bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:01.752938 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80541c0e-de10-44c4-b232-a366e06f8bf1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:01.763405 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1285/2569] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:01.768208 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80541c0e-de10-44c4-b232-a366e06f8bf1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:01.778429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80541c0e-de10-44c4-b232-a366e06f8bf1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:01.783626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f7192-a607-4338-9375-a5ecef9561ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:01.784229 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f7192-a607-4338-9375-a5ecef9561ab admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:01.784513 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f7192-a607-4338-9375-a5ecef9561ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:01.784787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f7192-a607-4338-9375-a5ecef9561ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:01.785474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f7192-a607-4338-9375-a5ecef9561ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:01.787166 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f7192-a607-4338-9375-a5ecef9561ab admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:01.798218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1286/2570] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:01.802364 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f7192-a607-4338-9375-a5ecef9561ab admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:01.812519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f7192-a607-4338-9375-a5ecef9561ab admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:01.817366 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439680fc-ca00-45ed-8ca4-8f05d276cc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:01.817990 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439680fc-ca00-45ed-8ca4-8f05d276cc13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:01.818262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439680fc-ca00-45ed-8ca4-8f05d276cc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:01.818557 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439680fc-ca00-45ed-8ca4-8f05d276cc13 admin admin] PATH_INFO: `/v3/projects/4d14830a19504c3fa0892cbd45743048/users/4ee6e8f85ab34c01b438f5badf29c55a/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:01.834339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439680fc-ca00-45ed-8ca4-8f05d276cc13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d14830a19504c3fa0892cbd45743048, user_id=4ee6e8f85ab34c01b438f5badf29c55a, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:01.836985 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439680fc-ca00-45ed-8ca4-8f05d276cc13 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:01.911621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1287/2571] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:01 2022] PUT /identity/v3/projects/4d14830a19504c3fa0892cbd45743048/users/4ee6e8f85ab34c01b438f5badf29c55a/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:01.922177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f02fb15f-7644-49fc-bbaf-64a7e4665618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a5a5fe7ded4421b43e435975a4dc3c', 'request_id': 'req-f02fb15f-7644-49fc-bbaf-64a7e4665618'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:01.925813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44792b-787d-4be1-9c88-b54afb8aa0e3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:01.926095 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44792b-787d-4be1-9c88-b54afb8aa0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:01.926366 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44792b-787d-4be1-9c88-b54afb8aa0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:01.931098 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f02fb15f-7644-49fc-bbaf-64a7e4665618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a5a5fe7ded4421b43e435975a4dc3c', 'request_id': 'req-f02fb15f-7644-49fc-bbaf-64a7e4665618'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:01.934352 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:01.957062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8b44792b-787d-4be1-9c88-b54afb8aa0e3 None None] MFA Rules not processed for user `4ee6e8f85ab34c01b438f5badf29c55a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:01.959950 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8b44792b-787d-4be1-9c88-b54afb8aa0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:01.985026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f02fb15f-7644-49fc-bbaf-64a7e4665618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a5a5fe7ded4421b43e435975a4dc3c', 'request_id': 'req-f02fb15f-7644-49fc-bbaf-64a7e4665618'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:02.013045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f02fb15f-7644-49fc-bbaf-64a7e4665618 admin admin] The token cache is being invalidate because project 97a5a5fe7ded4421b43e435975a4dc3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:02.013045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f02fb15f-7644-49fc-bbaf-64a7e4665618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:02.013045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-f02fb15f-7644-49fc-bbaf-64a7e4665618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:02.013045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1285/2572] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:01 2022] DELETE /identity/v3/projects/97a5a5fe7ded4421b43e435975a4dc3c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:02.013752 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc549-1abe-4ef9-a54f-7756573fdf16 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:02.014035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc549-1abe-4ef9-a54f-7756573fdf16 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:02.014309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc549-1abe-4ef9-a54f-7756573fdf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:02.038286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ef5bc549-1abe-4ef9-a54f-7756573fdf16 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:02.038286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ef5bc549-1abe-4ef9-a54f-7756573fdf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:02.051383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1288/2573] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:02.064562 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44792b-787d-4be1-9c88-b54afb8aa0e3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:02.066087 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8b44792b-787d-4be1-9c88-b54afb8aa0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:02.117940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1286/2574] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:02.130820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24300-8e1b-4afe-86dd-a6b3ef325232 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:02.131257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24300-8e1b-4afe-86dd-a6b3ef325232 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:02.131686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24300-8e1b-4afe-86dd-a6b3ef325232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:02.133976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44792b-787d-4be1-9c88-b54afb8aa0e3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:02.138000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8a6d1-e75e-4610-82e8-db2bac2a29e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:02.138679 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8a6d1-e75e-4610-82e8-db2bac2a29e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:02.139097 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8a6d1-e75e-4610-82e8-db2bac2a29e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:02.139570 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8a6d1-e75e-4610-82e8-db2bac2a29e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:02.151884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8a6d1-e75e-4610-82e8-db2bac2a29e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:02.151884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8a6d1-e75e-4610-82e8-db2bac2a29e7 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:02.153559 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-76f24300-8e1b-4afe-86dd-a6b3ef325232 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:02.154831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-76f24300-8e1b-4afe-86dd-a6b3ef325232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:02.161817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1289/2575] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:48:02.165484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1287/2576] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:02.169663 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8a6d1-e75e-4610-82e8-db2bac2a29e7 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:02.182290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8a6d1-e75e-4610-82e8-db2bac2a29e7 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:02.188398 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf1a51-a671-4741-a878-3931a7859132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:02.189026 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1a51-a671-4741-a878-3931a7859132 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:02.189332 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1a51-a671-4741-a878-3931a7859132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:02.189602 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1a51-a671-4741-a878-3931a7859132 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:02.189920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f24300-8e1b-4afe-86dd-a6b3ef325232 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:02.190276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf1a51-a671-4741-a878-3931a7859132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:02.190652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf1a51-a671-4741-a878-3931a7859132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:02.191328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-76f24300-8e1b-4afe-86dd-a6b3ef325232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:02.192342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf1a51-a671-4741-a878-3931a7859132 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:02.203714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f24300-8e1b-4afe-86dd-a6b3ef325232 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:02.207870 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1290/2577] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:48:02.209578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57285319-efe0-4b49-bce3-93b51524951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:02.209730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57285319-efe0-4b49-bce3-93b51524951c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:02.209994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57285319-efe0-4b49-bce3-93b51524951c admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:02.210264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57285319-efe0-4b49-bce3-93b51524951c admin admin] PATH_INFO: `/v3/users/4ee6e8f85ab34c01b438f5badf29c55a` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:02.211388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57285319-efe0-4b49-bce3-93b51524951c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee6e8f85ab34c01b438f5badf29c55a)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:02.212767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf1a51-a671-4741-a878-3931a7859132 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:02.213475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57285319-efe0-4b49-bce3-93b51524951c admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:02.222876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf1a51-a671-4741-a878-3931a7859132 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:02.228052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f21118-62f0-43e1-bb9d-a5ce7e64aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:02.228641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f21118-62f0-43e1-bb9d-a5ce7e64aaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:02.228914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f21118-62f0-43e1-bb9d-a5ce7e64aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:02.229211 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f21118-62f0-43e1-bb9d-a5ce7e64aaa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:02.229831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f21118-62f0-43e1-bb9d-a5ce7e64aaa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:02.231746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f21118-62f0-43e1-bb9d-a5ce7e64aaa8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:02.310628 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1291/2578] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:02 2022] POST /identity/v3/projects => generated 403 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:02.315978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f21118-62f0-43e1-bb9d-a5ce7e64aaa8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:02.330234 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:02.380062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f21118-62f0-43e1-bb9d-a5ce7e64aaa8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:02.384923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ea7ec-1952-478a-b677-5e12735757c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:02.385621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ea7ec-1952-478a-b677-5e12735757c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:02.385898 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ea7ec-1952-478a-b677-5e12735757c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:02.389586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ea7ec-1952-478a-b677-5e12735757c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:02.389586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ea7ec-1952-478a-b677-5e12735757c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:02.389586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ea7ec-1952-478a-b677-5e12735757c4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:02.395230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-57285319-efe0-4b49-bce3-93b51524951c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee6e8f85ab34c01b438f5badf29c55a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:02.490139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-57285319-efe0-4b49-bce3-93b51524951c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee6e8f85ab34c01b438f5badf29c55a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:02.490820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-57285319-efe0-4b49-bce3-93b51524951c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee6e8f85ab34c01b438f5badf29c55a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:02.499145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1292/2579] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:02 2022] POST /identity/v3/users => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:02.499360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-57285319-efe0-4b49-bce3-93b51524951c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee6e8f85ab34c01b438f5badf29c55a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:02.500846 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ea7ec-1952-478a-b677-5e12735757c4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:02.502680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c22ea7ec-1952-478a-b677-5e12735757c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:02.511041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-57285319-efe0-4b49-bce3-93b51524951c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee6e8f85ab34c01b438f5badf29c55a'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:02.516212 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ea7ec-1952-478a-b677-5e12735757c4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:02.517180 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1288/2580] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:02 2022] DELETE /identity/v3/users/4ee6e8f85ab34c01b438f5badf29c55a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:02.521510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566747b-561a-46f2-a5a9-ceea6906ab62 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:02.521790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566747b-561a-46f2-a5a9-ceea6906ab62 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:02.522068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566747b-561a-46f2-a5a9-ceea6906ab62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:02.542077 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-6566747b-561a-46f2-a5a9-ceea6906ab62 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:02.543264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6566747b-561a-46f2-a5a9-ceea6906ab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:02.579382 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8010e-442f-4b8b-a763-0d899afa2bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:02.580017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8010e-442f-4b8b-a763-0d899afa2bab admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:02.580292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8010e-442f-4b8b-a763-0d899afa2bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:02.580580 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8010e-442f-4b8b-a763-0d899afa2bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:02.581235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8010e-442f-4b8b-a763-0d899afa2bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:02.582844 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8010e-442f-4b8b-a763-0d899afa2bab admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:02.592632 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1293/2581] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:02.597578 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8010e-442f-4b8b-a763-0d899afa2bab admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:02.601977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1289/2582] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:02.607433 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8010e-442f-4b8b-a763-0d899afa2bab admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:02.613072 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cf3e6-7a2d-4104-8a1f-512aea956be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:02.613667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cf3e6-7a2d-4104-8a1f-512aea956be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:02.614105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cf3e6-7a2d-4104-8a1f-512aea956be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:02.614388 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cf3e6-7a2d-4104-8a1f-512aea956be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:02.615079 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cf3e6-7a2d-4104-8a1f-512aea956be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:02.616472 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566747b-561a-46f2-a5a9-ceea6906ab62 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:02.616705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cf3e6-7a2d-4104-8a1f-512aea956be8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:02.617877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-6566747b-561a-46f2-a5a9-ceea6906ab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:02.630342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1294/2583] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:02.631537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cf3e6-7a2d-4104-8a1f-512aea956be8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:02.641627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cf3e6-7a2d-4104-8a1f-512aea956be8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:02.646295 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ab7d7-5274-46cf-aaeb-d1c90b148a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:02.646983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ab7d7-5274-46cf-aaeb-d1c90b148a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:02.647262 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ab7d7-5274-46cf-aaeb-d1c90b148a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:02.647530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ab7d7-5274-46cf-aaeb-d1c90b148a44 admin admin] PATH_INFO: `/v3/projects/1b7af4097fc64ceab1b552d1ee7994fa/users/16a7a6f69739469fad76735b158c01c6/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:02.663017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ab7d7-5274-46cf-aaeb-d1c90b148a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7af4097fc64ceab1b552d1ee7994fa, user_id=16a7a6f69739469fad76735b158c01c6, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:02.666059 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ab7d7-5274-46cf-aaeb-d1c90b148a44 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:02.676423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:02.678914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566747b-561a-46f2-a5a9-ceea6906ab62 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:02.682689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa05242-80b4-4e25-bbef-408e647d5322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:02.683340 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05242-80b4-4e25-bbef-408e647d5322 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:02.683618 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05242-80b4-4e25-bbef-408e647d5322 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:02.683894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05242-80b4-4e25-bbef-408e647d5322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:02.693601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa05242-80b4-4e25-bbef-408e647d5322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:02.695055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa05242-80b4-4e25-bbef-408e647d5322 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:02.704670 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1290/2584] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:02.757629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1295/2585] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:02 2022] PUT /identity/v3/projects/1b7af4097fc64ceab1b552d1ee7994fa/users/16a7a6f69739469fad76735b158c01c6/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:02.762564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43d16b-8a46-43b3-8f3b-4257f47035f0 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:02.762861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43d16b-8a46-43b3-8f3b-4257f47035f0 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:02.763138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43d16b-8a46-43b3-8f3b-4257f47035f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:02.783189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ca43d16b-8a46-43b3-8f3b-4257f47035f0 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:02.784409 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ca43d16b-8a46-43b3-8f3b-4257f47035f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:02.845245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1291/2586] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:02.855072 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ab7d7-5274-46cf-aaeb-d1c90b148a44 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:02.856830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bd6ab7d7-5274-46cf-aaeb-d1c90b148a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:02.918804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ab7d7-5274-46cf-aaeb-d1c90b148a44 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:02.923972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebcbaa-576f-45f0-b8a8-217a4d31d3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:02.924588 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebcbaa-576f-45f0-b8a8-217a4d31d3ff service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:02.924867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebcbaa-576f-45f0-b8a8-217a4d31d3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:02.925171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebcbaa-576f-45f0-b8a8-217a4d31d3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:02.935076 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebcbaa-576f-45f0-b8a8-217a4d31d3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:02.937489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebcbaa-576f-45f0-b8a8-217a4d31d3ff service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:02.948686 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1296/2587] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:03.204569 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43d16b-8a46-43b3-8f3b-4257f47035f0 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:03.206448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ca43d16b-8a46-43b3-8f3b-4257f47035f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:03.219647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43d16b-8a46-43b3-8f3b-4257f47035f0 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:03.224798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806b9ed-0ea9-4936-bf46-469c0c8d449f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:03.226061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806b9ed-0ea9-4936-bf46-469c0c8d449f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:03.226061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806b9ed-0ea9-4936-bf46-469c0c8d449f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:03.226537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806b9ed-0ea9-4936-bf46-469c0c8d449f admin admin] PATH_INFO: `/v3/projects/4d14830a19504c3fa0892cbd45743048` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:03.227541 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806b9ed-0ea9-4936-bf46-469c0c8d449f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d14830a19504c3fa0892cbd45743048)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:03.229546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806b9ed-0ea9-4936-bf46-469c0c8d449f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:03.348516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d806b9ed-0ea9-4936-bf46-469c0c8d449f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d14830a19504c3fa0892cbd45743048', 'request_id': 'req-d806b9ed-0ea9-4936-bf46-469c0c8d449f'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:03.355039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d806b9ed-0ea9-4936-bf46-469c0c8d449f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d14830a19504c3fa0892cbd45743048', 'request_id': 'req-d806b9ed-0ea9-4936-bf46-469c0c8d449f'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:03.461276 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d806b9ed-0ea9-4936-bf46-469c0c8d449f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d14830a19504c3fa0892cbd45743048', 'request_id': 'req-d806b9ed-0ea9-4936-bf46-469c0c8d449f'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:03.464812 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebcbaa-576f-45f0-b8a8-217a4d31d3ff service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:03.473186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:03.477561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebcbaa-576f-45f0-b8a8-217a4d31d3ff service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:03.478988 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d806b9ed-0ea9-4936-bf46-469c0c8d449f admin admin] The token cache is being invalidate because project 4d14830a19504c3fa0892cbd45743048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:03.479277 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d806b9ed-0ea9-4936-bf46-469c0c8d449f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:03.480044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d806b9ed-0ea9-4936-bf46-469c0c8d449f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:03.481906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1292/2588] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:03 2022] DELETE /identity/v3/projects/4d14830a19504c3fa0892cbd45743048 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:03.486774 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fc852-3f44-4185-8a1a-1fea53424cc5 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:03.487092 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fc852-3f44-4185-8a1a-1fea53424cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:03.487369 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fc852-3f44-4185-8a1a-1fea53424cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:03.507806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-280fc852-3f44-4185-8a1a-1fea53424cc5 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:03.509081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-280fc852-3f44-4185-8a1a-1fea53424cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:03.522892 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:03.532660 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3d249-5ba8-41ae-a778-0f1c6a0973c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:03.533304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3d249-5ba8-41ae-a778-0f1c6a0973c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:03.533595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3d249-5ba8-41ae-a778-0f1c6a0973c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:03.533922 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3d249-5ba8-41ae-a778-0f1c6a0973c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:03.535694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e9f3d249-5ba8-41ae-a778-0f1c6a0973c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:03.577940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1293/2589] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:03.610048 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3d249-5ba8-41ae-a778-0f1c6a0973c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:03.611693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3d249-5ba8-41ae-a778-0f1c6a0973c2 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:03.628383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1297/2590] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:48:03.646239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3480da-c7a1-433a-972c-29527cbbad3c None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:03.646524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3480da-c7a1-433a-972c-29527cbbad3c None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:03.648062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3480da-c7a1-433a-972c-29527cbbad3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:03.668230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ae3480da-c7a1-433a-972c-29527cbbad3c None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:03.669479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ae3480da-c7a1-433a-972c-29527cbbad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:03.692180 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1294/2591] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:03.693553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3d249-5ba8-41ae-a778-0f1c6a0973c2 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:03.708257 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3d249-5ba8-41ae-a778-0f1c6a0973c2 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:03.713272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41e2b4-f9bd-452f-9d09-ffb1cbb6a3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:03.714016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e2b4-f9bd-452f-9d09-ffb1cbb6a3ae admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:03.714400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e2b4-f9bd-452f-9d09-ffb1cbb6a3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:03.714788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e2b4-f9bd-452f-9d09-ffb1cbb6a3ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:03.715538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41e2b4-f9bd-452f-9d09-ffb1cbb6a3ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:03.715948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41e2b4-f9bd-452f-9d09-ffb1cbb6a3ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:03.717747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41e2b4-f9bd-452f-9d09-ffb1cbb6a3ae admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:03.731166 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1298/2592] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:48:03.736205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3480da-c7a1-433a-972c-29527cbbad3c None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:03.746447 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3480da-c7a1-433a-972c-29527cbbad3c None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:03.752213 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb1a83-5fc2-4f74-a371-307d5175182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:03.753043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb1a83-5fc2-4f74-a371-307d5175182d admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:03.753322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb1a83-5fc2-4f74-a371-307d5175182d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:03.753588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb1a83-5fc2-4f74-a371-307d5175182d admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:03.754225 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb1a83-5fc2-4f74-a371-307d5175182d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:03.756122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb1a83-5fc2-4f74-a371-307d5175182d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:03.853596 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1295/2593] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:03 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:03.859444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41e2b4-f9bd-452f-9d09-ffb1cbb6a3ae admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:03.871043 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41e2b4-f9bd-452f-9d09-ffb1cbb6a3ae admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:03.938427 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2669f-3cd4-43b9-937e-44a60bb25c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:03.939044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2669f-3cd4-43b9-937e-44a60bb25c3a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:03.939328 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2669f-3cd4-43b9-937e-44a60bb25c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:03.939637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2669f-3cd4-43b9-937e-44a60bb25c3a admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:03.940277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2669f-3cd4-43b9-937e-44a60bb25c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:03.942247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2669f-3cd4-43b9-937e-44a60bb25c3a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:04.027847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1299/2594] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:03 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:04.029113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb1a83-5fc2-4f74-a371-307d5175182d admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:04.040594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb1a83-5fc2-4f74-a371-307d5175182d admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:04.045282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b4a40-fe27-466f-9baa-87c802dabccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:04.046000 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b4a40-fe27-466f-9baa-87c802dabccd admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:04.047012 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b4a40-fe27-466f-9baa-87c802dabccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:04.047291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b4a40-fe27-466f-9baa-87c802dabccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:04.048087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b4a40-fe27-466f-9baa-87c802dabccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:04.050543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b4a40-fe27-466f-9baa-87c802dabccd admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:04.065437 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1296/2595] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:04.066666 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2669f-3cd4-43b9-937e-44a60bb25c3a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:04.077378 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2669f-3cd4-43b9-937e-44a60bb25c3a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:04.082559 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e83f93-f1af-4a1b-a228-6d68b8c8b1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:04.083414 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e83f93-f1af-4a1b-a228-6d68b8c8b1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:04.083775 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e83f93-f1af-4a1b-a228-6d68b8c8b1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:04.084125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e83f93-f1af-4a1b-a228-6d68b8c8b1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:04.085022 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e83f93-f1af-4a1b-a228-6d68b8c8b1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:04.086719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e83f93-f1af-4a1b-a228-6d68b8c8b1f6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:04.100284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1300/2596] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:04.104328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b4a40-fe27-466f-9baa-87c802dabccd admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:04.116847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b4a40-fe27-466f-9baa-87c802dabccd admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:04.121994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3568ff4-b94a-4d22-9b34-b055e6a9cab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:04.122719 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3568ff4-b94a-4d22-9b34-b055e6a9cab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:04.122997 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3568ff4-b94a-4d22-9b34-b055e6a9cab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:04.123268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3568ff4-b94a-4d22-9b34-b055e6a9cab7 admin admin] PATH_INFO: `/v3/projects/52c079037d5943ecb71137c285132ecd/users/54dad9824a6b4bf49f85b19d41b69576/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:04.142436 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3568ff4-b94a-4d22-9b34-b055e6a9cab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c079037d5943ecb71137c285132ecd, user_id=54dad9824a6b4bf49f85b19d41b69576, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:04.145550 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3568ff4-b94a-4d22-9b34-b055e6a9cab7 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:04.213448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1297/2597] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:04 2022] PUT /identity/v3/projects/52c079037d5943ecb71137c285132ecd/users/54dad9824a6b4bf49f85b19d41b69576/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:04.224599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cbb39-a2b7-4b45-ad81-8c420ec40cc8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:04.224882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cbb39-a2b7-4b45-ad81-8c420ec40cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:04.225230 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cbb39-a2b7-4b45-ad81-8c420ec40cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:04.255937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e89cbb39-a2b7-4b45-ad81-8c420ec40cc8 None None] MFA Rules not processed for user `54dad9824a6b4bf49f85b19d41b69576`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:04.257383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e89cbb39-a2b7-4b45-ad81-8c420ec40cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:04.266657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:04.324047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1301/2598] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:04.341049 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3568ff4-b94a-4d22-9b34-b055e6a9cab7 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:04.341049 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d3568ff4-b94a-4d22-9b34-b055e6a9cab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:04.401750 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3568ff4-b94a-4d22-9b34-b055e6a9cab7 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:04.412519 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01262-f085-4eab-9f0d-d6c8960fe364 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:04.413140 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01262-f085-4eab-9f0d-d6c8960fe364 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:04.413418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01262-f085-4eab-9f0d-d6c8960fe364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:04.416434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86b60d-b707-45a9-a1a7-bf3e6bf9ad1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ba9aba795f423a8ffabe419b64507a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:04.417583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86b60d-b707-45a9-a1a7-bf3e6bf9ad1d service glance] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:04.418045 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86b60d-b707-45a9-a1a7-bf3e6bf9ad1d service glance] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:04.419242 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86b60d-b707-45a9-a1a7-bf3e6bf9ad1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:04.434079 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86b60d-b707-45a9-a1a7-bf3e6bf9ad1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:04.437903 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86b60d-b707-45a9-a1a7-bf3e6bf9ad1d service glance] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:04.449368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f9c01262-f085-4eab-9f0d-d6c8960fe364 None None] MFA Rules not processed for user `16a7a6f69739469fad76735b158c01c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:04.450843 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1298/2599] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:04.453680 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f9c01262-f085-4eab-9f0d-d6c8960fe364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:04.537829 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1302/2600] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:04 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:04.549342 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86b60d-b707-45a9-a1a7-bf3e6bf9ad1d service glance] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:04.550788 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-fd86b60d-b707-45a9-a1a7-bf3e6bf9ad1d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:04.622941 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:04.627728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86b60d-b707-45a9-a1a7-bf3e6bf9ad1d service glance] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:04.632269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca601a-2c61-4a24-b67a-9d686a6129ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:04.632872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca601a-2c61-4a24-b67a-9d686a6129ed admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:04.633193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca601a-2c61-4a24-b67a-9d686a6129ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:04.633469 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca601a-2c61-4a24-b67a-9d686a6129ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:04.634114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca601a-2c61-4a24-b67a-9d686a6129ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:04.636052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca601a-2c61-4a24-b67a-9d686a6129ed admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:04.761980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1299/2601] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:04 2022] POST /identity/v3/projects => generated 405 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:04.763057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c01262-f085-4eab-9f0d-d6c8960fe364 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:04.775451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c01262-f085-4eab-9f0d-d6c8960fe364 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:04.854635 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbf2bd-c69a-44af-90fa-c73ba5aae7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:04.855572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbf2bd-c69a-44af-90fa-c73ba5aae7cb admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:04.855947 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbf2bd-c69a-44af-90fa-c73ba5aae7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:04.856708 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbf2bd-c69a-44af-90fa-c73ba5aae7cb admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:04.857081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbf2bd-c69a-44af-90fa-c73ba5aae7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:04.860200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbf2bd-c69a-44af-90fa-c73ba5aae7cb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:04.981621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1303/2602] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:04 2022] POST /identity/v3/users => generated 309 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:04.986375 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca601a-2c61-4a24-b67a-9d686a6129ed admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:04.996946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca601a-2c61-4a24-b67a-9d686a6129ed admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:05.002672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1f3b3-1b06-43e5-9ebd-aed3efa4c1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:05.003412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1f3b3-1b06-43e5-9ebd-aed3efa4c1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:05.003698 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1f3b3-1b06-43e5-9ebd-aed3efa4c1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:05.003970 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1f3b3-1b06-43e5-9ebd-aed3efa4c1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:05.004620 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1f3b3-1b06-43e5-9ebd-aed3efa4c1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:05.006287 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1f3b3-1b06-43e5-9ebd-aed3efa4c1e3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:05.018227 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1300/2603] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:05.023353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbf2bd-c69a-44af-90fa-c73ba5aae7cb admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:05.037621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbf2bd-c69a-44af-90fa-c73ba5aae7cb admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:05.042349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11587c50-511a-4af6-8b4d-30714472b13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:05.043083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11587c50-511a-4af6-8b4d-30714472b13c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:05.043274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11587c50-511a-4af6-8b4d-30714472b13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:05.043573 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11587c50-511a-4af6-8b4d-30714472b13c admin admin] PATH_INFO: `/v3/projects/4a8aef07f2804ca387446776e4af925c/users/eaac3e9a9f74467c90b6288041a157a5/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:05.061339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11587c50-511a-4af6-8b4d-30714472b13c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8aef07f2804ca387446776e4af925c, user_id=eaac3e9a9f74467c90b6288041a157a5, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:05.066382 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11587c50-511a-4af6-8b4d-30714472b13c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:05.139774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1304/2604] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:05 2022] PUT /identity/v3/projects/4a8aef07f2804ca387446776e4af925c/users/eaac3e9a9f74467c90b6288041a157a5/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:05.144117 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1f3b3-1b06-43e5-9ebd-aed3efa4c1e3 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:05.154504 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1f3b3-1b06-43e5-9ebd-aed3efa4c1e3 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:05.216760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1af595-3d73-4de3-9ffe-d7b50fca21d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:05.217458 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1af595-3d73-4de3-9ffe-d7b50fca21d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:05.217750 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1af595-3d73-4de3-9ffe-d7b50fca21d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:05.218295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1af595-3d73-4de3-9ffe-d7b50fca21d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:05.219616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1af595-3d73-4de3-9ffe-d7b50fca21d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:05.225024 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1af595-3d73-4de3-9ffe-d7b50fca21d3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:05.232272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1301/2605] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:05.237404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11587c50-511a-4af6-8b4d-30714472b13c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:05.244786 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:05.250538 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11587c50-511a-4af6-8b4d-30714472b13c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:05.256237 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac8393-04cd-4b94-8c57-fbaa646bdc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:05.257152 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8393-04cd-4b94-8c57-fbaa646bdc0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:05.257629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8393-04cd-4b94-8c57-fbaa646bdc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:05.257999 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8393-04cd-4b94-8c57-fbaa646bdc0b admin admin] PATH_INFO: `/v3/projects/4a8aef07f2804ca387446776e4af925c/users/eaac3e9a9f74467c90b6288041a157a5/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:05.260243 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac8393-04cd-4b94-8c57-fbaa646bdc0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8aef07f2804ca387446776e4af925c, user_id=eaac3e9a9f74467c90b6288041a157a5, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:05.263312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac8393-04cd-4b94-8c57-fbaa646bdc0b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:05.276676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1305/2606] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:05 2022] PUT /identity/v3/projects/4a8aef07f2804ca387446776e4af925c/users/eaac3e9a9f74467c90b6288041a157a5/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:06.972619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849c839-6a22-4bb0-944d-03aebbf68b58 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:06.973202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849c839-6a22-4bb0-944d-03aebbf68b58 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:06.973202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849c839-6a22-4bb0-944d-03aebbf68b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:07.005062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-7849c839-6a22-4bb0-944d-03aebbf68b58 None None] MFA Rules not processed for user `eaac3e9a9f74467c90b6288041a157a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:07.006498 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-7849c839-6a22-4bb0-944d-03aebbf68b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:07.113887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1302/2607] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:06 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:08.050715 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac8393-04cd-4b94-8c57-fbaa646bdc0b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:08.052599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-79ac8393-04cd-4b94-8c57-fbaa646bdc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:08.132299 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac8393-04cd-4b94-8c57-fbaa646bdc0b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:08.137139 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1134f-9d0f-4d4b-8266-09f71df357e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:08.137770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1134f-9d0f-4d4b-8266-09f71df357e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:08.138174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1134f-9d0f-4d4b-8266-09f71df357e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:08.138446 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1134f-9d0f-4d4b-8266-09f71df357e7 admin admin] PATH_INFO: `/v3/users/255138cca3254c5f939112b74a04011f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:08.139670 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1134f-9d0f-4d4b-8266-09f71df357e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=255138cca3254c5f939112b74a04011f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:08.142307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1134f-9d0f-4d4b-8266-09f71df357e7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:08.402216 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6dc1134f-9d0f-4d4b-8266-09f71df357e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255138cca3254c5f939112b74a04011f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:08.410894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6dc1134f-9d0f-4d4b-8266-09f71df357e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255138cca3254c5f939112b74a04011f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:08.432702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6dc1134f-9d0f-4d4b-8266-09f71df357e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255138cca3254c5f939112b74a04011f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:08.584857 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6dc1134f-9d0f-4d4b-8266-09f71df357e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255138cca3254c5f939112b74a04011f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:08.585649 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6dc1134f-9d0f-4d4b-8266-09f71df357e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255138cca3254c5f939112b74a04011f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:08.595281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1306/2608] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:08 2022] DELETE /identity/v3/users/255138cca3254c5f939112b74a04011f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:08.852549 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849c839-6a22-4bb0-944d-03aebbf68b58 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:08.856718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1134f-9d0f-4d4b-8266-09f71df357e7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:08.862658 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6dc1134f-9d0f-4d4b-8266-09f71df357e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:08.874006 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849c839-6a22-4bb0-944d-03aebbf68b58 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:08.941734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:08.953345 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21312ed3-22be-4e47-b0dd-88ad24f107bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:08.954699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21312ed3-22be-4e47-b0dd-88ad24f107bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:08.954983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21312ed3-22be-4e47-b0dd-88ad24f107bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:08.956589 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21312ed3-22be-4e47-b0dd-88ad24f107bf admin admin] PATH_INFO: `/v3/projects/be0eecb808a147ae83c30745133de87a` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:08.956589 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21312ed3-22be-4e47-b0dd-88ad24f107bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=be0eecb808a147ae83c30745133de87a)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:08.958420 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21312ed3-22be-4e47-b0dd-88ad24f107bf admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:08.970461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1134f-9d0f-4d4b-8266-09f71df357e7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:08.977429 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcead2d-c8e7-4e57-8165-6149bda7ba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:08.977746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcead2d-c8e7-4e57-8165-6149bda7ba92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:08.978021 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcead2d-c8e7-4e57-8165-6149bda7ba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:08.978294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcead2d-c8e7-4e57-8165-6149bda7ba92 admin admin] PATH_INFO: `/v3/users/16a7a6f69739469fad76735b158c01c6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:08.979448 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcead2d-c8e7-4e57-8165-6149bda7ba92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a7a6f69739469fad76735b158c01c6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:08.981575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcead2d-c8e7-4e57-8165-6149bda7ba92 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:08.995711 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:09.078309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-21312ed3-22be-4e47-b0dd-88ad24f107bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be0eecb808a147ae83c30745133de87a', 'request_id': 'req-21312ed3-22be-4e47-b0dd-88ad24f107bf'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.086998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-21312ed3-22be-4e47-b0dd-88ad24f107bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be0eecb808a147ae83c30745133de87a', 'request_id': 'req-21312ed3-22be-4e47-b0dd-88ad24f107bf'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.181558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-21312ed3-22be-4e47-b0dd-88ad24f107bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be0eecb808a147ae83c30745133de87a', 'request_id': 'req-21312ed3-22be-4e47-b0dd-88ad24f107bf'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.193523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-21312ed3-22be-4e47-b0dd-88ad24f107bf admin admin] The token cache is being invalidate because project be0eecb808a147ae83c30745133de87a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:09.193797 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-21312ed3-22be-4e47-b0dd-88ad24f107bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.194401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-21312ed3-22be-4e47-b0dd-88ad24f107bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.195928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1303/2609] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:08 2022] DELETE /identity/v3/projects/be0eecb808a147ae83c30745133de87a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:09.196925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7fcead2d-c8e7-4e57-8165-6149bda7ba92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a7a6f69739469fad76735b158c01c6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.200916 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326788b-0d11-41f0-ba2a-d1541aab065a None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:09.201226 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326788b-0d11-41f0-ba2a-d1541aab065a None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:09.201505 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326788b-0d11-41f0-ba2a-d1541aab065a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:09.205197 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7fcead2d-c8e7-4e57-8165-6149bda7ba92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a7a6f69739469fad76735b158c01c6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.216943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7fcead2d-c8e7-4e57-8165-6149bda7ba92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a7a6f69739469fad76735b158c01c6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.222333 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c326788b-0d11-41f0-ba2a-d1541aab065a None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:09.223565 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c326788b-0d11-41f0-ba2a-d1541aab065a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:09.284556 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7fcead2d-c8e7-4e57-8165-6149bda7ba92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a7a6f69739469fad76735b158c01c6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.285684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7fcead2d-c8e7-4e57-8165-6149bda7ba92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a7a6f69739469fad76735b158c01c6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.287255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1304/2610] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:09.292548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1307/2611] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:08 2022] DELETE /identity/v3/users/16a7a6f69739469fad76735b158c01c6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:09.294780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90570f04-111a-492c-8da0-f0d03ecc1adb None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:09.295063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90570f04-111a-492c-8da0-f0d03ecc1adb None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:09.295332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90570f04-111a-492c-8da0-f0d03ecc1adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:09.316457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-90570f04-111a-492c-8da0-f0d03ecc1adb None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:09.317724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-90570f04-111a-492c-8da0-f0d03ecc1adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:09.385366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1305/2612] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:09.390049 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcead2d-c8e7-4e57-8165-6149bda7ba92 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:09.401204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcead2d-c8e7-4e57-8165-6149bda7ba92 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:09.406149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506eecc6-9df0-4434-81a3-2a661695f2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:09.407002 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506eecc6-9df0-4434-81a3-2a661695f2db admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:09.407284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506eecc6-9df0-4434-81a3-2a661695f2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:09.407584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506eecc6-9df0-4434-81a3-2a661695f2db admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:09.408240 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506eecc6-9df0-4434-81a3-2a661695f2db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:09.408547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506eecc6-9df0-4434-81a3-2a661695f2db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:09.410224 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506eecc6-9df0-4434-81a3-2a661695f2db admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:09.426453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1308/2613] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:48:09.427264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90570f04-111a-492c-8da0-f0d03ecc1adb None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:09.436624 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90570f04-111a-492c-8da0-f0d03ecc1adb None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:09.442821 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decee22-0c7c-49d5-bb31-ccb48ec1ae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:09.443469 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decee22-0c7c-49d5-bb31-ccb48ec1ae69 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:09.443866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decee22-0c7c-49d5-bb31-ccb48ec1ae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:09.444134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decee22-0c7c-49d5-bb31-ccb48ec1ae69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:09.444806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decee22-0c7c-49d5-bb31-ccb48ec1ae69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:09.446809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decee22-0c7c-49d5-bb31-ccb48ec1ae69 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:09.587302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1306/2614] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:09 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:09.591466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506eecc6-9df0-4434-81a3-2a661695f2db admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:09.604451 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506eecc6-9df0-4434-81a3-2a661695f2db admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:09.643523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decee22-0c7c-49d5-bb31-ccb48ec1ae69 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:09.645268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8decee22-0c7c-49d5-bb31-ccb48ec1ae69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:09.651307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:09.679039 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a62b86-357e-445e-98c4-aa6d77cdfb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:09.679653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a62b86-357e-445e-98c4-aa6d77cdfb1a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:09.679933 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a62b86-357e-445e-98c4-aa6d77cdfb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:09.680203 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a62b86-357e-445e-98c4-aa6d77cdfb1a admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:09.680851 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a62b86-357e-445e-98c4-aa6d77cdfb1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:09.682845 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a62b86-357e-445e-98c4-aa6d77cdfb1a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:09.726091 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decee22-0c7c-49d5-bb31-ccb48ec1ae69 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:09.730934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:09.735059 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:09.735059 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:09.735059 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] PATH_INFO: `/v3/projects/1b7af4097fc64ceab1b552d1ee7994fa` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:09.735059 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b7af4097fc64ceab1b552d1ee7994fa)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:09.735944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:09.788641 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1309/2615] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:09 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:09.792763 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a62b86-357e-445e-98c4-aa6d77cdfb1a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:09.803854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a62b86-357e-445e-98c4-aa6d77cdfb1a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:09.808551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb76f5b-f2eb-41d4-93c8-56ed85d2cd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:09.809185 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb76f5b-f2eb-41d4-93c8-56ed85d2cd57 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:09.809491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb76f5b-f2eb-41d4-93c8-56ed85d2cd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:09.809762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb76f5b-f2eb-41d4-93c8-56ed85d2cd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:09.810436 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb76f5b-f2eb-41d4-93c8-56ed85d2cd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:09.812080 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb76f5b-f2eb-41d4-93c8-56ed85d2cd57 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:09.823279 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1310/2616] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:09.827456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb76f5b-f2eb-41d4-93c8-56ed85d2cd57 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:09.838553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb76f5b-f2eb-41d4-93c8-56ed85d2cd57 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:09.846021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b7af4097fc64ceab1b552d1ee7994fa', 'request_id': 'req-8dcbd8cd-fead-446e-b122-fda8517252a3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.853379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b7af4097fc64ceab1b552d1ee7994fa', 'request_id': 'req-8dcbd8cd-fead-446e-b122-fda8517252a3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.891103 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:09.897833 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3aa93-fb9c-442a-a21d-547bbd09eb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:09.898438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3aa93-fb9c-442a-a21d-547bbd09eb92 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:09.898712 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3aa93-fb9c-442a-a21d-547bbd09eb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:09.898971 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3aa93-fb9c-442a-a21d-547bbd09eb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:09.899611 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3aa93-fb9c-442a-a21d-547bbd09eb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:09.901353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3aa93-fb9c-442a-a21d-547bbd09eb92 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:09.912119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1311/2617] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:09.916177 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3aa93-fb9c-442a-a21d-547bbd09eb92 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:09.926652 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3aa93-fb9c-442a-a21d-547bbd09eb92 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:09.931611 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bd2b0-c404-4b24-b593-9f13e612f165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:09.932245 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bd2b0-c404-4b24-b593-9f13e612f165 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:09.932520 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bd2b0-c404-4b24-b593-9f13e612f165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:09.932792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bd2b0-c404-4b24-b593-9f13e612f165 admin admin] PATH_INFO: `/v3/projects/b335b9a73a0245fd8df77233a9a51ce7/users/a443f1dd9d684affbbcb05d9300e35e8/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:09.941275 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b7af4097fc64ceab1b552d1ee7994fa', 'request_id': 'req-8dcbd8cd-fead-446e-b122-fda8517252a3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.948106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bd2b0-c404-4b24-b593-9f13e612f165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b335b9a73a0245fd8df77233a9a51ce7, user_id=a443f1dd9d684affbbcb05d9300e35e8, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:09.950873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bd2b0-c404-4b24-b593-9f13e612f165 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:09.965156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] The token cache is being invalidate because project 1b7af4097fc64ceab1b552d1ee7994fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:09.965572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.966291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:09.967842 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1307/2618] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:09 2022] DELETE /identity/v3/projects/1b7af4097fc64ceab1b552d1ee7994fa => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:09.973035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:09.974415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:09.990401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbd8cd-fead-446e-b122-fda8517252a3 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:09.995606 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2925f-042b-470b-8d7f-4632efa52cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:09.996243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2925f-042b-470b-8d7f-4632efa52cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:09.996520 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2925f-042b-470b-8d7f-4632efa52cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:09.996791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2925f-042b-470b-8d7f-4632efa52cc4 admin admin] PATH_INFO: `/v3/users/eaac3e9a9f74467c90b6288041a157a5` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:09.998064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2925f-042b-470b-8d7f-4632efa52cc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaac3e9a9f74467c90b6288041a157a5)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:10.000281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2925f-042b-470b-8d7f-4632efa52cc4 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:10.051657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1312/2619] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:09 2022] PUT /identity/v3/projects/b335b9a73a0245fd8df77233a9a51ce7/users/a443f1dd9d684affbbcb05d9300e35e8/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:10.063224 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc733-469f-454c-860a-9a11bef271b2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:10.063537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc733-469f-454c-860a-9a11bef271b2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:10.063764 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc733-469f-454c-860a-9a11bef271b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:10.094301 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-430dc733-469f-454c-860a-9a11bef271b2 None None] MFA Rules not processed for user `a443f1dd9d684affbbcb05d9300e35e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:10.096101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-430dc733-469f-454c-860a-9a11bef271b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:10.170395 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1313/2620] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:10.181845 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dc733-469f-454c-860a-9a11bef271b2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:10.183281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-430dc733-469f-454c-860a-9a11bef271b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:10.198463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-90b2925f-042b-470b-8d7f-4632efa52cc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaac3e9a9f74467c90b6288041a157a5'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:10.271978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dc733-469f-454c-860a-9a11bef271b2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:10.277672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f117b-b799-483f-b062-0d7cc0094b48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb70408fecfe41e0b2ea9a53c7ae0823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:10.278296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f117b-b799-483f-b062-0d7cc0094b48 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:10.278573 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f117b-b799-483f-b062-0d7cc0094b48 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:10.278843 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f117b-b799-483f-b062-0d7cc0094b48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:10.279352 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-90b2925f-042b-470b-8d7f-4632efa52cc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaac3e9a9f74467c90b6288041a157a5'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:10.280038 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-90b2925f-042b-470b-8d7f-4632efa52cc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaac3e9a9f74467c90b6288041a157a5'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:10.288109 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f117b-b799-483f-b062-0d7cc0094b48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:10.289775 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f117b-b799-483f-b062-0d7cc0094b48 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:10.293341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-90b2925f-042b-470b-8d7f-4632efa52cc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaac3e9a9f74467c90b6288041a157a5'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:10.299880 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1314/2621] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:48:10.310264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-90b2925f-042b-470b-8d7f-4632efa52cc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaac3e9a9f74467c90b6288041a157a5'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:10.320659 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1308/2622] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:09 2022] DELETE /identity/v3/users/eaac3e9a9f74467c90b6288041a157a5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:10.564467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f117b-b799-483f-b062-0d7cc0094b48 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:10.621969 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:10.642302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f117b-b799-483f-b062-0d7cc0094b48 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:10.704081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:10.704710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:10.704998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:10.705282 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa admin admin] PATH_INFO: `/v3/projects/4a8aef07f2804ca387446776e4af925c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:10.706462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a8aef07f2804ca387446776e4af925c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:10.708353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:10.832107 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a8aef07f2804ca387446776e4af925c', 'request_id': 'req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:10.838719 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a8aef07f2804ca387446776e4af925c', 'request_id': 'req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:10.845358 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a8aef07f2804ca387446776e4af925c', 'request_id': 'req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:10.944410 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa admin admin] The token cache is being invalidate because project 4a8aef07f2804ca387446776e4af925c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:10.945104 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:10.945441 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-90ab910d-a7cc-490d-9cf0-b08e8f13b8aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:10.946969 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1315/2623] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:10 2022] DELETE /identity/v3/projects/4a8aef07f2804ca387446776e4af925c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:10.951967 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73faafd-83de-4197-9a55-4341ddc3d91e None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:10.952479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73faafd-83de-4197-9a55-4341ddc3d91e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:10.952588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73faafd-83de-4197-9a55-4341ddc3d91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:10.961930 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:10.973704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c73faafd-83de-4197-9a55-4341ddc3d91e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:10.974921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c73faafd-83de-4197-9a55-4341ddc3d91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:11.049361 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1309/2624] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:11.057252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2f771-47c5-4090-9166-9de82ab8a9ec None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:11.057368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2f771-47c5-4090-9166-9de82ab8a9ec None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:11.057608 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2f771-47c5-4090-9166-9de82ab8a9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:11.079286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1de2f771-47c5-4090-9166-9de82ab8a9ec None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:11.080547 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1de2f771-47c5-4090-9166-9de82ab8a9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:11.088848 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1316/2625] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:11.093116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73faafd-83de-4197-9a55-4341ddc3d91e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:11.103286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73faafd-83de-4197-9a55-4341ddc3d91e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:11.108039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c50ba-bc2b-4ee0-9e82-53abcaf82394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:11.108650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c50ba-bc2b-4ee0-9e82-53abcaf82394 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:11.108931 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c50ba-bc2b-4ee0-9e82-53abcaf82394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:11.109742 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c50ba-bc2b-4ee0-9e82-53abcaf82394 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:11.110467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c50ba-bc2b-4ee0-9e82-53abcaf82394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:11.111032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c50ba-bc2b-4ee0-9e82-53abcaf82394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:11.113286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c50ba-bc2b-4ee0-9e82-53abcaf82394 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:11.128923 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1310/2626] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:48:11.133752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2f771-47c5-4090-9166-9de82ab8a9ec None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:11.144389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2f771-47c5-4090-9166-9de82ab8a9ec None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:11.152627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eef50d-98fe-4fdf-9dff-054c6680f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:11.152627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eef50d-98fe-4fdf-9dff-054c6680f5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:11.152627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eef50d-98fe-4fdf-9dff-054c6680f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:11.152627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eef50d-98fe-4fdf-9dff-054c6680f5f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:11.153066 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eef50d-98fe-4fdf-9dff-054c6680f5f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:11.153066 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eef50d-98fe-4fdf-9dff-054c6680f5f8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:11.272748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1317/2627] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:11 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:11.277010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c50ba-bc2b-4ee0-9e82-53abcaf82394 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:11.287781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c50ba-bc2b-4ee0-9e82-53abcaf82394 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:11.344095 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0b812-5f5d-4c54-8d1e-cdc57f6fad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:11.344953 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0b812-5f5d-4c54-8d1e-cdc57f6fad22 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:11.345264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0b812-5f5d-4c54-8d1e-cdc57f6fad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:11.345534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0b812-5f5d-4c54-8d1e-cdc57f6fad22 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:11.346174 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0b812-5f5d-4c54-8d1e-cdc57f6fad22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:11.348076 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0b812-5f5d-4c54-8d1e-cdc57f6fad22 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:11.443273 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1311/2628] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:11 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:11.447457 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eef50d-98fe-4fdf-9dff-054c6680f5f8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:11.458090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eef50d-98fe-4fdf-9dff-054c6680f5f8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:11.462735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7c0a1-e61e-4274-9a51-b5b965954017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:11.463328 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7c0a1-e61e-4274-9a51-b5b965954017 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:11.463606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7c0a1-e61e-4274-9a51-b5b965954017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:11.463878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7c0a1-e61e-4274-9a51-b5b965954017 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:11.464520 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7c0a1-e61e-4274-9a51-b5b965954017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:11.466492 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7c0a1-e61e-4274-9a51-b5b965954017 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:11.478284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1318/2629] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:11.482307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0b812-5f5d-4c54-8d1e-cdc57f6fad22 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:11.494106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0b812-5f5d-4c54-8d1e-cdc57f6fad22 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:11.498812 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb599bdf-a0c6-4e44-8799-553012472c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:11.499420 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb599bdf-a0c6-4e44-8799-553012472c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:11.499715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb599bdf-a0c6-4e44-8799-553012472c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:11.500017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb599bdf-a0c6-4e44-8799-553012472c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:11.500692 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb599bdf-a0c6-4e44-8799-553012472c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:11.502923 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb599bdf-a0c6-4e44-8799-553012472c4a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:11.514119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1312/2630] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:11.518911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7c0a1-e61e-4274-9a51-b5b965954017 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:11.529248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7c0a1-e61e-4274-9a51-b5b965954017 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:11.534580 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cb9f3-bcbd-4d45-b656-6dbf9d0b8544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:11.535218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cb9f3-bcbd-4d45-b656-6dbf9d0b8544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:11.535557 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cb9f3-bcbd-4d45-b656-6dbf9d0b8544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:11.535969 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cb9f3-bcbd-4d45-b656-6dbf9d0b8544 admin admin] PATH_INFO: `/v3/projects/d14dc7f4ceb0409288f8c4b9d5198242/users/af8080d3b8304dcba8a17eedf5280949/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:11.552161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cb9f3-bcbd-4d45-b656-6dbf9d0b8544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14dc7f4ceb0409288f8c4b9d5198242, user_id=af8080d3b8304dcba8a17eedf5280949, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:11.554866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cb9f3-bcbd-4d45-b656-6dbf9d0b8544 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:11.639621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1319/2631] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:11 2022] PUT /identity/v3/projects/d14dc7f4ceb0409288f8c4b9d5198242/users/af8080d3b8304dcba8a17eedf5280949/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:11.651915 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b04dfe-5c5d-47e1-b50a-c1229b86a038 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:11.652194 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b04dfe-5c5d-47e1-b50a-c1229b86a038 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:11.652466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b04dfe-5c5d-47e1-b50a-c1229b86a038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:11.684699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-77b04dfe-5c5d-47e1-b50a-c1229b86a038 None None] MFA Rules not processed for user `af8080d3b8304dcba8a17eedf5280949`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:11.686023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-77b04dfe-5c5d-47e1-b50a-c1229b86a038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:11.753862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:11.762781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1313/2632] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:11.764051 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cb9f3-bcbd-4d45-b656-6dbf9d0b8544 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:11.791217 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:11.857418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cb9f3-bcbd-4d45-b656-6dbf9d0b8544 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:11.862921 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeba8c5-bab2-466d-b8b9-b5e8f9988d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:11.863664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeba8c5-bab2-466d-b8b9-b5e8f9988d41 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:11.863861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeba8c5-bab2-466d-b8b9-b5e8f9988d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:11.864126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeba8c5-bab2-466d-b8b9-b5e8f9988d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:11.864762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeba8c5-bab2-466d-b8b9-b5e8f9988d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:11.866911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeba8c5-bab2-466d-b8b9-b5e8f9988d41 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:12.057745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1320/2633] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:11 2022] POST /identity/v3/projects => generated 385 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:12.061761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b04dfe-5c5d-47e1-b50a-c1229b86a038 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:12.075641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b04dfe-5c5d-47e1-b50a-c1229b86a038 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:12.141738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d66f2-ee00-4e28-8671-23fc6310878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:12.142358 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d66f2-ee00-4e28-8671-23fc6310878d admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:12.142637 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d66f2-ee00-4e28-8671-23fc6310878d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:12.142908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d66f2-ee00-4e28-8671-23fc6310878d admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:12.143537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d66f2-ee00-4e28-8671-23fc6310878d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:12.145631 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d66f2-ee00-4e28-8671-23fc6310878d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:12.240480 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1314/2634] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:12 2022] POST /identity/v3/users => generated 299 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:12.244662 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeba8c5-bab2-466d-b8b9-b5e8f9988d41 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:12.255158 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeba8c5-bab2-466d-b8b9-b5e8f9988d41 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:12.259789 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d7bf4-a8de-4099-a543-427b0d1c9a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:12.260420 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d7bf4-a8de-4099-a543-427b0d1c9a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:12.260694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d7bf4-a8de-4099-a543-427b0d1c9a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:12.260962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d7bf4-a8de-4099-a543-427b0d1c9a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:12.261625 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d7bf4-a8de-4099-a543-427b0d1c9a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:12.263231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d7bf4-a8de-4099-a543-427b0d1c9a53 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:12.274515 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1321/2635] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:12.279187 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d66f2-ee00-4e28-8671-23fc6310878d admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:12.289717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d66f2-ee00-4e28-8671-23fc6310878d admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:12.298704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d382e-099f-4625-b772-6cd6ae5fe7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:12.298704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d382e-099f-4625-b772-6cd6ae5fe7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:12.298704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d382e-099f-4625-b772-6cd6ae5fe7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:12.298704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d382e-099f-4625-b772-6cd6ae5fe7e5 admin admin] PATH_INFO: `/v3/projects/5991f96e09644ed688b662be7b8a8b85/users/71754e26217f45c4bc240b4f753c6836/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:12.311362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d382e-099f-4625-b772-6cd6ae5fe7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5991f96e09644ed688b662be7b8a8b85, user_id=71754e26217f45c4bc240b4f753c6836, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:12.314150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d382e-099f-4625-b772-6cd6ae5fe7e5 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:12.391427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1315/2636] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:12 2022] PUT /identity/v3/projects/5991f96e09644ed688b662be7b8a8b85/users/71754e26217f45c4bc240b4f753c6836/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:12.395477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d7bf4-a8de-4099-a543-427b0d1c9a53 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:12.407389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d7bf4-a8de-4099-a543-427b0d1c9a53 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:12.467781 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dec197-86a2-44e6-a422-af6c5714451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:12.468399 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dec197-86a2-44e6-a422-af6c5714451e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:12.470275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dec197-86a2-44e6-a422-af6c5714451e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:12.470275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dec197-86a2-44e6-a422-af6c5714451e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:12.470801 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dec197-86a2-44e6-a422-af6c5714451e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:12.472431 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dec197-86a2-44e6-a422-af6c5714451e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:12.487397 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1322/2637] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:12.488573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d382e-099f-4625-b772-6cd6ae5fe7e5 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:12.499925 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d382e-099f-4625-b772-6cd6ae5fe7e5 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:12.505674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c65f8-1a8f-47e3-a9f3-529f8c9afcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:12.506704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c65f8-1a8f-47e3-a9f3-529f8c9afcf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:12.506975 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c65f8-1a8f-47e3-a9f3-529f8c9afcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:12.507485 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c65f8-1a8f-47e3-a9f3-529f8c9afcf0 admin admin] PATH_INFO: `/v3/projects/5991f96e09644ed688b662be7b8a8b85/users/71754e26217f45c4bc240b4f753c6836/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:12.509646 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c65f8-1a8f-47e3-a9f3-529f8c9afcf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5991f96e09644ed688b662be7b8a8b85, user_id=71754e26217f45c4bc240b4f753c6836, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:12.512577 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c65f8-1a8f-47e3-a9f3-529f8c9afcf0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:12.525050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1316/2638] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:12 2022] PUT /identity/v3/projects/5991f96e09644ed688b662be7b8a8b85/users/71754e26217f45c4bc240b4f753c6836/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:12.536683 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad8988-2595-445c-a71f-357474b17199 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:12.537092 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad8988-2595-445c-a71f-357474b17199 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:12.537371 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad8988-2595-445c-a71f-357474b17199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:12.567840 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1dad8988-2595-445c-a71f-357474b17199 None None] MFA Rules not processed for user `71754e26217f45c4bc240b4f753c6836`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:12.569076 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1dad8988-2595-445c-a71f-357474b17199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:12.639721 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1323/2639] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:12.651957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c65f8-1a8f-47e3-a9f3-529f8c9afcf0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:12.653691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9e4c65f8-1a8f-47e3-a9f3-529f8c9afcf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:12.713214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c65f8-1a8f-47e3-a9f3-529f8c9afcf0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:12.716937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceeac53-807a-4253-95d8-88d3854ecf20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:12.717579 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeac53-807a-4253-95d8-88d3854ecf20 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:12.717858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeac53-807a-4253-95d8-88d3854ecf20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:12.718129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeac53-807a-4253-95d8-88d3854ecf20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:12.728108 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceeac53-807a-4253-95d8-88d3854ecf20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:12.729716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceeac53-807a-4253-95d8-88d3854ecf20 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:12.740151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1317/2640] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:12.770988 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad8988-2595-445c-a71f-357474b17199 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:12.787020 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:12.840981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad8988-2595-445c-a71f-357474b17199 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:12.846219 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c8cc0-dbe9-41eb-8cf4-8c2a707de937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:12.846866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c8cc0-dbe9-41eb-8cf4-8c2a707de937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:12.847149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c8cc0-dbe9-41eb-8cf4-8c2a707de937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:12.847436 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c8cc0-dbe9-41eb-8cf4-8c2a707de937 admin admin] PATH_INFO: `/v3/users/af8080d3b8304dcba8a17eedf5280949` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:12.848633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c8cc0-dbe9-41eb-8cf4-8c2a707de937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8080d3b8304dcba8a17eedf5280949)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:12.850605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c8cc0-dbe9-41eb-8cf4-8c2a707de937 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:13.041831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-011c8cc0-dbe9-41eb-8cf4-8c2a707de937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8080d3b8304dcba8a17eedf5280949'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:13.049315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-011c8cc0-dbe9-41eb-8cf4-8c2a707de937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8080d3b8304dcba8a17eedf5280949'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:13.061302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-011c8cc0-dbe9-41eb-8cf4-8c2a707de937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8080d3b8304dcba8a17eedf5280949'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:13.153250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-011c8cc0-dbe9-41eb-8cf4-8c2a707de937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8080d3b8304dcba8a17eedf5280949'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:13.153895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-011c8cc0-dbe9-41eb-8cf4-8c2a707de937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8080d3b8304dcba8a17eedf5280949'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:13.162483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1324/2641] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:12 2022] DELETE /identity/v3/users/af8080d3b8304dcba8a17eedf5280949 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:13.166990 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53544cd2-ca99-4695-b9c3-c0132fc5849b None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:13.167470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53544cd2-ca99-4695-b9c3-c0132fc5849b None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:13.167578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53544cd2-ca99-4695-b9c3-c0132fc5849b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:13.187686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-53544cd2-ca99-4695-b9c3-c0132fc5849b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:13.189622 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-53544cd2-ca99-4695-b9c3-c0132fc5849b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:13.239417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:13.250928 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1318/2642] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:13.261590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c8cc0-dbe9-41eb-8cf4-8c2a707de937 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:13.263029 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-011c8cc0-dbe9-41eb-8cf4-8c2a707de937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:13.323636 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c8cc0-dbe9-41eb-8cf4-8c2a707de937 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:13.327582 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3cc18-a439-4667-92a2-7d11f9778dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:13.328179 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cc18-a439-4667-92a2-7d11f9778dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:13.328542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cc18-a439-4667-92a2-7d11f9778dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:13.328822 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cc18-a439-4667-92a2-7d11f9778dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:13.339900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3cc18-a439-4667-92a2-7d11f9778dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:13.341410 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3cc18-a439-4667-92a2-7d11f9778dd9 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:13.351191 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1325/2643] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:13.604848 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53544cd2-ca99-4695-b9c3-c0132fc5849b None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:13.604848 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-53544cd2-ca99-4695-b9c3-c0132fc5849b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:13.616839 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53544cd2-ca99-4695-b9c3-c0132fc5849b None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:13.621500 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d592-b99d-4cf9-b368-b7ffd6536514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:13.623391 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d592-b99d-4cf9-b368-b7ffd6536514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:13.623391 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d592-b99d-4cf9-b368-b7ffd6536514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:13.623391 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d592-b99d-4cf9-b368-b7ffd6536514 admin admin] PATH_INFO: `/v3/users/a443f1dd9d684affbbcb05d9300e35e8` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:13.623780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497d592-b99d-4cf9-b368-b7ffd6536514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a443f1dd9d684affbbcb05d9300e35e8)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:13.625741 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497d592-b99d-4cf9-b368-b7ffd6536514 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:13.807150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3cc18-a439-4667-92a2-7d11f9778dd9 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:13.808629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f4f3cc18-a439-4667-92a2-7d11f9778dd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:13.822590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3cc18-a439-4667-92a2-7d11f9778dd9 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:13.831009 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:13.831009 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:13.831009 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:13.831009 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] PATH_INFO: `/v3/projects/d14dc7f4ceb0409288f8c4b9d5198242` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:13.831890 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14dc7f4ceb0409288f8c4b9d5198242)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:13.833980 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:13.886872 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2497d592-b99d-4cf9-b368-b7ffd6536514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a443f1dd9d684affbbcb05d9300e35e8'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:13.921637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:13.936736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14dc7f4ceb0409288f8c4b9d5198242', 'request_id': 'req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:13.941449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2497d592-b99d-4cf9-b368-b7ffd6536514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a443f1dd9d684affbbcb05d9300e35e8'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:13.942104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2497d592-b99d-4cf9-b368-b7ffd6536514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a443f1dd9d684affbbcb05d9300e35e8'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:13.944215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14dc7f4ceb0409288f8c4b9d5198242', 'request_id': 'req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:13.950132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14dc7f4ceb0409288f8c4b9d5198242', 'request_id': 'req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:13.952146 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2497d592-b99d-4cf9-b368-b7ffd6536514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a443f1dd9d684affbbcb05d9300e35e8'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:13.966132 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2497d592-b99d-4cf9-b368-b7ffd6536514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a443f1dd9d684affbbcb05d9300e35e8'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:13.973552 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1319/2644] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:13 2022] DELETE /identity/v3/users/a443f1dd9d684affbbcb05d9300e35e8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:13.978029 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93821158-52ea-4a98-915f-9ee063a6a530 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:13.978315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93821158-52ea-4a98-915f-9ee063a6a530 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:13.978582 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93821158-52ea-4a98-915f-9ee063a6a530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:13.997449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-93821158-52ea-4a98-915f-9ee063a6a530 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:13.998680 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-93821158-52ea-4a98-915f-9ee063a6a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:14.027172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] The token cache is being invalidate because project d14dc7f4ceb0409288f8c4b9d5198242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:14.027447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:14.028014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:14.029698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1326/2645] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:13 2022] DELETE /identity/v3/projects/d14dc7f4ceb0409288f8c4b9d5198242 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:14.034814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:14.036716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:14.062662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1320/2646] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:14.072945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93821158-52ea-4a98-915f-9ee063a6a530 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:14.074338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-93821158-52ea-4a98-915f-9ee063a6a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:14.108248 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5105c01-ce5f-4bc8-9858-5ebdf4e1dcde admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:14.117135 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54851e-9f30-4a19-9e45-6699fcf4ef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:14.117787 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54851e-9f30-4a19-9e45-6699fcf4ef23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:14.118062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54851e-9f30-4a19-9e45-6699fcf4ef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:14.118330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54851e-9f30-4a19-9e45-6699fcf4ef23 admin admin] PATH_INFO: `/v3/users/71754e26217f45c4bc240b4f753c6836` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:14.119484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54851e-9f30-4a19-9e45-6699fcf4ef23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71754e26217f45c4bc240b4f753c6836)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:14.121495 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54851e-9f30-4a19-9e45-6699fcf4ef23 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:14.135206 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93821158-52ea-4a98-915f-9ee063a6a530 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:14.138896 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b1193-51ea-429b-a4fe-8ef7ba43520d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:14.144655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b1193-51ea-429b-a4fe-8ef7ba43520d service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:14.144655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b1193-51ea-429b-a4fe-8ef7ba43520d service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:14.144655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b1193-51ea-429b-a4fe-8ef7ba43520d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:14.150043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b1193-51ea-429b-a4fe-8ef7ba43520d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:14.151463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b1193-51ea-429b-a4fe-8ef7ba43520d service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:14.162138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1321/2647] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:48:14.333752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ee54851e-9f30-4a19-9e45-6699fcf4ef23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71754e26217f45c4bc240b4f753c6836'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:14.341333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ee54851e-9f30-4a19-9e45-6699fcf4ef23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71754e26217f45c4bc240b4f753c6836'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:14.353871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ee54851e-9f30-4a19-9e45-6699fcf4ef23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71754e26217f45c4bc240b4f753c6836'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:14.433302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ee54851e-9f30-4a19-9e45-6699fcf4ef23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71754e26217f45c4bc240b4f753c6836'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:14.434106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ee54851e-9f30-4a19-9e45-6699fcf4ef23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71754e26217f45c4bc240b4f753c6836'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:14.441795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1327/2648] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:14 2022] DELETE /identity/v3/users/71754e26217f45c4bc240b4f753c6836 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:14.632274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b1193-51ea-429b-a4fe-8ef7ba43520d service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:14.633912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a74b1193-51ea-429b-a4fe-8ef7ba43520d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:14.651798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b1193-51ea-429b-a4fe-8ef7ba43520d service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:14.662262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:14.714690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b987c-ca99-4453-9f01-7e107c9aac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:14.715328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b987c-ca99-4453-9f01-7e107c9aac60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:14.715604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b987c-ca99-4453-9f01-7e107c9aac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:14.715874 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b987c-ca99-4453-9f01-7e107c9aac60 admin admin] PATH_INFO: `/v3/projects/b335b9a73a0245fd8df77233a9a51ce7` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:14.717671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b987c-ca99-4453-9f01-7e107c9aac60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b335b9a73a0245fd8df77233a9a51ce7)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:14.719592 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b987c-ca99-4453-9f01-7e107c9aac60 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:14.839426 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ee8b987c-ca99-4453-9f01-7e107c9aac60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b335b9a73a0245fd8df77233a9a51ce7', 'request_id': 'req-ee8b987c-ca99-4453-9f01-7e107c9aac60'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:14.846026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ee8b987c-ca99-4453-9f01-7e107c9aac60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b335b9a73a0245fd8df77233a9a51ce7', 'request_id': 'req-ee8b987c-ca99-4453-9f01-7e107c9aac60'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:14.940387 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ee8b987c-ca99-4453-9f01-7e107c9aac60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b335b9a73a0245fd8df77233a9a51ce7', 'request_id': 'req-ee8b987c-ca99-4453-9f01-7e107c9aac60'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:14.952702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ee8b987c-ca99-4453-9f01-7e107c9aac60 admin admin] The token cache is being invalidate because project b335b9a73a0245fd8df77233a9a51ce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:14.953069 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ee8b987c-ca99-4453-9f01-7e107c9aac60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:14.959791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-ee8b987c-ca99-4453-9f01-7e107c9aac60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:14.959791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1322/2649] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:14 2022] DELETE /identity/v3/projects/b335b9a73a0245fd8df77233a9a51ce7 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:14.962439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54851e-9f30-4a19-9e45-6699fcf4ef23 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:14.964500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ee54851e-9f30-4a19-9e45-6699fcf4ef23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:14.964751 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d41ec-06c2-4335-ac2c-3db40c7ab334 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:14.965079 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d41ec-06c2-4335-ac2c-3db40c7ab334 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:14.965382 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d41ec-06c2-4335-ac2c-3db40c7ab334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:14.988842 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54851e-9f30-4a19-9e45-6699fcf4ef23 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:14.990025 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-773d41ec-06c2-4335-ac2c-3db40c7ab334 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:14.991328 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-773d41ec-06c2-4335-ac2c-3db40c7ab334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:15.023914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:15.053452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358048b-d590-4c4e-a187-cffc7c43d0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:15.054097 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358048b-d590-4c4e-a187-cffc7c43d0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.054381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358048b-d590-4c4e-a187-cffc7c43d0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.054781 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358048b-d590-4c4e-a187-cffc7c43d0e1 admin admin] PATH_INFO: `/v3/projects/5991f96e09644ed688b662be7b8a8b85` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.055931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358048b-d590-4c4e-a187-cffc7c43d0e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5991f96e09644ed688b662be7b8a8b85)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:15.057903 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358048b-d590-4c4e-a187-cffc7c43d0e1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:15.059297 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1323/2650] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:15.067831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f089c6-9e55-4682-b37b-975a3209979e None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.068165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f089c6-9e55-4682-b37b-975a3209979e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.068415 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f089c6-9e55-4682-b37b-975a3209979e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.090434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-b0f089c6-9e55-4682-b37b-975a3209979e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:15.097595 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b0f089c6-9e55-4682-b37b-975a3209979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:15.100881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1324/2651] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:15.105046 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f089c6-9e55-4682-b37b-975a3209979e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:15.115340 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f089c6-9e55-4682-b37b-975a3209979e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:15.120302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c32f85-c120-42a6-8a05-4b8f4dafa1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:15.126427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c32f85-c120-42a6-8a05-4b8f4dafa1bc admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.126427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c32f85-c120-42a6-8a05-4b8f4dafa1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.126427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c32f85-c120-42a6-8a05-4b8f4dafa1bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.126427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c32f85-c120-42a6-8a05-4b8f4dafa1bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:15.126427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c32f85-c120-42a6-8a05-4b8f4dafa1bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:15.126427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c32f85-c120-42a6-8a05-4b8f4dafa1bc admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:15.136486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1325/2652] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:48:15.140770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c32f85-c120-42a6-8a05-4b8f4dafa1bc admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:15.150539 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c32f85-c120-42a6-8a05-4b8f4dafa1bc admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:15.155287 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac20916-9ac8-46ea-ba15-9e725131ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:15.155871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20916-9ac8-46ea-ba15-9e725131ceb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.156147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20916-9ac8-46ea-ba15-9e725131ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.156417 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20916-9ac8-46ea-ba15-9e725131ceb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.157105 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac20916-9ac8-46ea-ba15-9e725131ceb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:15.159489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac20916-9ac8-46ea-ba15-9e725131ceb0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:15.216931 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e358048b-d590-4c4e-a187-cffc7c43d0e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5991f96e09644ed688b662be7b8a8b85', 'request_id': 'req-e358048b-d590-4c4e-a187-cffc7c43d0e1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:15.223960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e358048b-d590-4c4e-a187-cffc7c43d0e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5991f96e09644ed688b662be7b8a8b85', 'request_id': 'req-e358048b-d590-4c4e-a187-cffc7c43d0e1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:15.229481 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e358048b-d590-4c4e-a187-cffc7c43d0e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5991f96e09644ed688b662be7b8a8b85', 'request_id': 'req-e358048b-d590-4c4e-a187-cffc7c43d0e1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:15.257052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:15.263350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1326/2653] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:15 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:15.267307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac20916-9ac8-46ea-ba15-9e725131ceb0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:15.319372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e358048b-d590-4c4e-a187-cffc7c43d0e1 admin admin] The token cache is being invalidate because project 5991f96e09644ed688b662be7b8a8b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:15.319945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e358048b-d590-4c4e-a187-cffc7c43d0e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:15.320649 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e358048b-d590-4c4e-a187-cffc7c43d0e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:15.322180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1328/2654] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:14 2022] DELETE /identity/v3/projects/5991f96e09644ed688b662be7b8a8b85 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:15.326881 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa3929-4503-42e4-af95-8cd71feb4864 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.327292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa3929-4503-42e4-af95-8cd71feb4864 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.327631 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa3929-4503-42e4-af95-8cd71feb4864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.332774 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac20916-9ac8-46ea-ba15-9e725131ceb0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:15.337793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f49ecc-80e7-4040-a299-6e1ec2facfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:15.338425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f49ecc-80e7-4040-a299-6e1ec2facfde admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.338710 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f49ecc-80e7-4040-a299-6e1ec2facfde admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.338983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f49ecc-80e7-4040-a299-6e1ec2facfde admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.339610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f49ecc-80e7-4040-a299-6e1ec2facfde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:15.341580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f49ecc-80e7-4040-a299-6e1ec2facfde admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:15.350244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-63fa3929-4503-42e4-af95-8cd71feb4864 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:15.351459 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-63fa3929-4503-42e4-af95-8cd71feb4864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:15.359527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1329/2655] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:15.367441 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433a036-9a1d-410c-aed7-27cb094712f9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.367725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433a036-9a1d-410c-aed7-27cb094712f9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.367995 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433a036-9a1d-410c-aed7-27cb094712f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.387710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d433a036-9a1d-410c-aed7-27cb094712f9 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:15.388840 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d433a036-9a1d-410c-aed7-27cb094712f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:15.397549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1330/2656] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:15.401553 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433a036-9a1d-410c-aed7-27cb094712f9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:15.411186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433a036-9a1d-410c-aed7-27cb094712f9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:15.415807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb95e0-ef9d-434e-beea-005c8772c481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:15.416372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb95e0-ef9d-434e-beea-005c8772c481 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.416653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb95e0-ef9d-434e-beea-005c8772c481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.416925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb95e0-ef9d-434e-beea-005c8772c481 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.417615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb95e0-ef9d-434e-beea-005c8772c481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:15.417925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb95e0-ef9d-434e-beea-005c8772c481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:15.419510 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb95e0-ef9d-434e-beea-005c8772c481 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:15.431142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1331/2657] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:48:15.435228 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb95e0-ef9d-434e-beea-005c8772c481 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:15.444900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb95e0-ef9d-434e-beea-005c8772c481 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:15.449472 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd059f8-4235-49d7-80aa-543035002c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:15.450025 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd059f8-4235-49d7-80aa-543035002c62 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.450307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd059f8-4235-49d7-80aa-543035002c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.450582 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd059f8-4235-49d7-80aa-543035002c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.451196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd059f8-4235-49d7-80aa-543035002c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:15.453083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd059f8-4235-49d7-80aa-543035002c62 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:15.458656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1327/2658] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:15 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:15.466258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f49ecc-80e7-4040-a299-6e1ec2facfde admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:15.468111 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-64f49ecc-80e7-4040-a299-6e1ec2facfde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:15.482570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f49ecc-80e7-4040-a299-6e1ec2facfde admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:15.487601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9af7d-1438-482f-b1eb-6843af54c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:15.488199 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9af7d-1438-482f-b1eb-6843af54c0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.488491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9af7d-1438-482f-b1eb-6843af54c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.488738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9af7d-1438-482f-b1eb-6843af54c0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.489429 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9af7d-1438-482f-b1eb-6843af54c0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:15.491013 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9af7d-1438-482f-b1eb-6843af54c0e8 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:15.501464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1328/2659] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:15.505401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9af7d-1438-482f-b1eb-6843af54c0e8 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:15.515180 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9af7d-1438-482f-b1eb-6843af54c0e8 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:15.520671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2bd9f-45f0-430c-b28b-2d9435eeb0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:15.526364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2bd9f-45f0-430c-b28b-2d9435eeb0cb admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.526364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2bd9f-45f0-430c-b28b-2d9435eeb0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.526364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2bd9f-45f0-430c-b28b-2d9435eeb0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.526364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2bd9f-45f0-430c-b28b-2d9435eeb0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:15.526364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2bd9f-45f0-430c-b28b-2d9435eeb0cb admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:15.535584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1329/2660] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:15.539835 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2bd9f-45f0-430c-b28b-2d9435eeb0cb admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:15.550168 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2bd9f-45f0-430c-b28b-2d9435eeb0cb admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:15.554126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1332/2661] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:15 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:15.554862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ae1b1-54b3-40b6-8012-20e7767932c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:15.560688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ae1b1-54b3-40b6-8012-20e7767932c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.560688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ae1b1-54b3-40b6-8012-20e7767932c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.560688 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ae1b1-54b3-40b6-8012-20e7767932c6 admin admin] PATH_INFO: `/v3/projects/cdcfe61da7284e9fa42435305553a8b1/users/d5ade0ca835d4e8d8bcec7e37097881b/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.561710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd059f8-4235-49d7-80aa-543035002c62 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:15.572760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ae1b1-54b3-40b6-8012-20e7767932c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcfe61da7284e9fa42435305553a8b1, user_id=d5ade0ca835d4e8d8bcec7e37097881b, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:15.575525 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ae1b1-54b3-40b6-8012-20e7767932c6 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:15.623483 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd059f8-4235-49d7-80aa-543035002c62 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:15.629566 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0a1d2-e592-4465-9c5c-73573e87837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:15.630261 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0a1d2-e592-4465-9c5c-73573e87837b admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.630535 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0a1d2-e592-4465-9c5c-73573e87837b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.630809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0a1d2-e592-4465-9c5c-73573e87837b admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.631513 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0a1d2-e592-4465-9c5c-73573e87837b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:15.631640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1330/2662] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:15 2022] PUT /identity/v3/projects/cdcfe61da7284e9fa42435305553a8b1/users/d5ade0ca835d4e8d8bcec7e37097881b/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:15.633669 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0a1d2-e592-4465-9c5c-73573e87837b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:15.642395 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68323083-61e8-4e14-8751-931709f8937e None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.642951 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68323083-61e8-4e14-8751-931709f8937e None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.642951 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68323083-61e8-4e14-8751-931709f8937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.670228 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-68323083-61e8-4e14-8751-931709f8937e None None] MFA Rules not processed for user `d5ade0ca835d4e8d8bcec7e37097881b`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:15.671431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-68323083-61e8-4e14-8751-931709f8937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:15.716267 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1333/2663] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:15 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:15.717720 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0a1d2-e592-4465-9c5c-73573e87837b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:15.728615 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0a1d2-e592-4465-9c5c-73573e87837b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:15.732300 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:15.740829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1331/2664] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:15.745362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68323083-61e8-4e14-8751-931709f8937e None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:15.779277 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:15.787482 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f647f-0099-417a-967a-cc8baee8dfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:15.788101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f647f-0099-417a-967a-cc8baee8dfcc admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.788383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f647f-0099-417a-967a-cc8baee8dfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.788657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f647f-0099-417a-967a-cc8baee8dfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.789340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f647f-0099-417a-967a-cc8baee8dfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:15.791015 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f647f-0099-417a-967a-cc8baee8dfcc admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:15.802207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1334/2665] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:15.805952 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f647f-0099-417a-967a-cc8baee8dfcc admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:15.808834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68323083-61e8-4e14-8751-931709f8937e None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:15.814210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6015d8-06e5-4f9c-b546-897cac50f44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:15.814903 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6015d8-06e5-4f9c-b546-897cac50f44c admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.815179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6015d8-06e5-4f9c-b546-897cac50f44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.815449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6015d8-06e5-4f9c-b546-897cac50f44c admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.815958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f647f-0099-417a-967a-cc8baee8dfcc admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:15.816060 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6015d8-06e5-4f9c-b546-897cac50f44c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:15.818204 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6015d8-06e5-4f9c-b546-897cac50f44c admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:15.820657 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e6e19-4a1b-4769-8e61-c7d3df54304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:15.821284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e6e19-4a1b-4769-8e61-c7d3df54304c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.821568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e6e19-4a1b-4769-8e61-c7d3df54304c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.821866 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e6e19-4a1b-4769-8e61-c7d3df54304c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.822501 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e6e19-4a1b-4769-8e61-c7d3df54304c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:15.824220 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e6e19-4a1b-4769-8e61-c7d3df54304c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:15.835824 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1335/2666] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:15.841173 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e6e19-4a1b-4769-8e61-c7d3df54304c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:15.850047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e6e19-4a1b-4769-8e61-c7d3df54304c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:15.854892 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2da3fe-fb36-47f9-954e-324e757e51db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:15.855509 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2da3fe-fb36-47f9-954e-324e757e51db admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.855784 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2da3fe-fb36-47f9-954e-324e757e51db admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.856051 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2da3fe-fb36-47f9-954e-324e757e51db admin admin] PATH_INFO: `/v3/projects/dfe9601d811f4f54b56f5f6cb7991cbd/users/84beb9c398004c6c913ff855210df66d/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.871473 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2da3fe-fb36-47f9-954e-324e757e51db admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe9601d811f4f54b56f5f6cb7991cbd, user_id=84beb9c398004c6c913ff855210df66d, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:15.874231 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2da3fe-fb36-47f9-954e-324e757e51db admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:15.941252 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1332/2667] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:15 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:15.945752 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6015d8-06e5-4f9c-b546-897cac50f44c admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:15.963613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1336/2668] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:15 2022] PUT /identity/v3/projects/dfe9601d811f4f54b56f5f6cb7991cbd/users/84beb9c398004c6c913ff855210df66d/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:15.965920 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51492-150f-4cdd-b821-1a0961deeb7b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:15.966207 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51492-150f-4cdd-b821-1a0961deeb7b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:15.966480 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51492-150f-4cdd-b821-1a0961deeb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:15.997956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9dd51492-150f-4cdd-b821-1a0961deeb7b None None] MFA Rules not processed for user `84beb9c398004c6c913ff855210df66d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:15.999281 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9dd51492-150f-4cdd-b821-1a0961deeb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:16.023119 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6015d8-06e5-4f9c-b546-897cac50f44c admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:16.067344 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1337/2669] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:16.071820 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd51492-150f-4cdd-b821-1a0961deeb7b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:16.080905 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d559d2c-79e1-4570-a49f-a8f384d0ee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:16.081546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559d2c-79e1-4570-a49f-a8f384d0ee06 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.081831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559d2c-79e1-4570-a49f-a8f384d0ee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.082108 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559d2c-79e1-4570-a49f-a8f384d0ee06 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:16.083363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d559d2c-79e1-4570-a49f-a8f384d0ee06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:16.085317 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d559d2c-79e1-4570-a49f-a8f384d0ee06 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:16.130793 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:16.134958 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd51492-150f-4cdd-b821-1a0961deeb7b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:16.139718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f457dc-a0f2-448a-bc53-19a0728a9a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:16.140315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f457dc-a0f2-448a-bc53-19a0728a9a75 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.140590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f457dc-a0f2-448a-bc53-19a0728a9a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.140855 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f457dc-a0f2-448a-bc53-19a0728a9a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:16.141513 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f457dc-a0f2-448a-bc53-19a0728a9a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:16.143582 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f457dc-a0f2-448a-bc53-19a0728a9a75 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:16.165526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1333/2670] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:15 2022] POST /identity/v3/users => generated 295 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:16.175505 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d559d2c-79e1-4570-a49f-a8f384d0ee06 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:16.185470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d559d2c-79e1-4570-a49f-a8f384d0ee06 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:16.190853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe061d5-b9f1-433b-a12f-f182815b8ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:16.191483 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe061d5-b9f1-433b-a12f-f182815b8ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.191715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe061d5-b9f1-433b-a12f-f182815b8ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.191989 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe061d5-b9f1-433b-a12f-f182815b8ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:16.192627 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe061d5-b9f1-433b-a12f-f182815b8ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:16.194250 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe061d5-b9f1-433b-a12f-f182815b8ca3 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:16.204101 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1334/2671] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:16.208212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe061d5-b9f1-433b-a12f-f182815b8ca3 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:16.217672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe061d5-b9f1-433b-a12f-f182815b8ca3 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:16.222698 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857f2e5-fbbd-4f23-b1c8-0fa65fe3165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:16.223305 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857f2e5-fbbd-4f23-b1c8-0fa65fe3165a admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.223600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857f2e5-fbbd-4f23-b1c8-0fa65fe3165a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.223861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857f2e5-fbbd-4f23-b1c8-0fa65fe3165a admin admin] PATH_INFO: `/v3/projects/ba5dc83cdd7e43c28b78cc07ff674605/users/4a273431090a48008ca7c1074e25931b/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:16.238957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857f2e5-fbbd-4f23-b1c8-0fa65fe3165a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5dc83cdd7e43c28b78cc07ff674605, user_id=4a273431090a48008ca7c1074e25931b, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:16.241610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857f2e5-fbbd-4f23-b1c8-0fa65fe3165a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:16.258529 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1338/2672] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:16 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:16.262332 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f457dc-a0f2-448a-bc53-19a0728a9a75 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:16.323960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f457dc-a0f2-448a-bc53-19a0728a9a75 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:16.328595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da8883-4aaa-4851-be1f-2cacbb7a9989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:16.329227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da8883-4aaa-4851-be1f-2cacbb7a9989 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.329614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da8883-4aaa-4851-be1f-2cacbb7a9989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.329894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da8883-4aaa-4851-be1f-2cacbb7a9989 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:16.330528 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da8883-4aaa-4851-be1f-2cacbb7a9989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:16.332447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da8883-4aaa-4851-be1f-2cacbb7a9989 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:16.341894 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1335/2673] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:16 2022] PUT /identity/v3/projects/ba5dc83cdd7e43c28b78cc07ff674605/users/4a273431090a48008ca7c1074e25931b/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:16.346125 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857f2e5-fbbd-4f23-b1c8-0fa65fe3165a admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:16.367412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:16.407286 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857f2e5-fbbd-4f23-b1c8-0fa65fe3165a admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:16.412304 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872297d-4acc-4610-9d8b-1e1884b7b8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:16.412916 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872297d-4acc-4610-9d8b-1e1884b7b8ff admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.413237 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872297d-4acc-4610-9d8b-1e1884b7b8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.413507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872297d-4acc-4610-9d8b-1e1884b7b8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:16.414145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872297d-4acc-4610-9d8b-1e1884b7b8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:16.415747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872297d-4acc-4610-9d8b-1e1884b7b8ff admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:16.426943 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1336/2674] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:16.432136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872297d-4acc-4610-9d8b-1e1884b7b8ff admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:16.445226 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872297d-4acc-4610-9d8b-1e1884b7b8ff admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:16.447304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1339/2675] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:16 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:16.449011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99cf67-eac1-4380-9090-dfa68927a285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:16.449638 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99cf67-eac1-4380-9090-dfa68927a285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.449884 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99cf67-eac1-4380-9090-dfa68927a285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.450156 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99cf67-eac1-4380-9090-dfa68927a285 admin admin] PATH_INFO: `/v3/projects/ba5dc83cdd7e43c28b78cc07ff674605/users/4a273431090a48008ca7c1074e25931b/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:16.450878 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da8883-4aaa-4851-be1f-2cacbb7a9989 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:16.452186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99cf67-eac1-4380-9090-dfa68927a285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5dc83cdd7e43c28b78cc07ff674605, user_id=4a273431090a48008ca7c1074e25931b, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:16.455143 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99cf67-eac1-4380-9090-dfa68927a285 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:16.462942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da8883-4aaa-4851-be1f-2cacbb7a9989 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:16.467720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1337/2676] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:16 2022] PUT /identity/v3/projects/ba5dc83cdd7e43c28b78cc07ff674605/users/4a273431090a48008ca7c1074e25931b/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:16.479068 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00173287-eaae-4405-8c4c-eaa023deea66 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.479618 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00173287-eaae-4405-8c4c-eaa023deea66 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.479896 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00173287-eaae-4405-8c4c-eaa023deea66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:16.509982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-00173287-eaae-4405-8c4c-eaa023deea66 None None] MFA Rules not processed for user `4a273431090a48008ca7c1074e25931b`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:16.511189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-00173287-eaae-4405-8c4c-eaa023deea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:16.522060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843822c-acc5-4989-9607-101afdd030c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:16.522672 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843822c-acc5-4989-9607-101afdd030c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.522948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843822c-acc5-4989-9607-101afdd030c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.523239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843822c-acc5-4989-9607-101afdd030c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:16.523864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843822c-acc5-4989-9607-101afdd030c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:16.525498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843822c-acc5-4989-9607-101afdd030c2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:16.535779 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1340/2677] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:16.539814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843822c-acc5-4989-9607-101afdd030c2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:16.551112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843822c-acc5-4989-9607-101afdd030c2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:16.555929 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf8300-d31a-4b9f-b24d-e7b98edf6cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:16.556575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8300-d31a-4b9f-b24d-e7b98edf6cee admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.556856 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8300-d31a-4b9f-b24d-e7b98edf6cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.557164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8300-d31a-4b9f-b24d-e7b98edf6cee admin admin] PATH_INFO: `/v3/projects/088d1b35c6334415b26ec40f4c13b24f/users/9dc80493ca7d4169b10b920193c970cc/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:16.572204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf8300-d31a-4b9f-b24d-e7b98edf6cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=088d1b35c6334415b26ec40f4c13b24f, user_id=9dc80493ca7d4169b10b920193c970cc, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:16.575232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf8300-d31a-4b9f-b24d-e7b98edf6cee admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:16.582263 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1338/2678] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:16.592940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00173287-eaae-4405-8c4c-eaa023deea66 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:16.594290 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-00173287-eaae-4405-8c4c-eaa023deea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:16.644964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1341/2679] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:16 2022] PUT /identity/v3/projects/088d1b35c6334415b26ec40f4c13b24f/users/9dc80493ca7d4169b10b920193c970cc/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:16.648865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf8300-d31a-4b9f-b24d-e7b98edf6cee admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:16.655180 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00173287-eaae-4405-8c4c-eaa023deea66 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:16.696919 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:16.698387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:16.704520 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c9ae3-f57b-4a92-8756-4afcc2f22099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:16.705319 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c9ae3-f57b-4a92-8756-4afcc2f22099 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.705667 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c9ae3-f57b-4a92-8756-4afcc2f22099 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.705947 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c9ae3-f57b-4a92-8756-4afcc2f22099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:16.714560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf8300-d31a-4b9f-b24d-e7b98edf6cee admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:16.719584 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e4ccc-2fb9-4b3b-ab04-4e3121d6d7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:16.720943 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e4ccc-2fb9-4b3b-ab04-4e3121d6d7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.721359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e4ccc-2fb9-4b3b-ab04-4e3121d6d7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.721637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e4ccc-2fb9-4b3b-ab04-4e3121d6d7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:16.722278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e4ccc-2fb9-4b3b-ab04-4e3121d6d7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:16.723873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e4ccc-2fb9-4b3b-ab04-4e3121d6d7f2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:16.734688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1342/2680] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:16.739256 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e4ccc-2fb9-4b3b-ab04-4e3121d6d7f2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:16.748705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e4ccc-2fb9-4b3b-ab04-4e3121d6d7f2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:16.753644 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8769e4-10de-4349-8eb1-838452859fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:16.754284 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8769e4-10de-4349-8eb1-838452859fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.754559 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8769e4-10de-4349-8eb1-838452859fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.754829 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8769e4-10de-4349-8eb1-838452859fc3 admin admin] PATH_INFO: `/v3/projects/088d1b35c6334415b26ec40f4c13b24f/users/9dc80493ca7d4169b10b920193c970cc/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:16.756739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8769e4-10de-4349-8eb1-838452859fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=088d1b35c6334415b26ec40f4c13b24f, user_id=9dc80493ca7d4169b10b920193c970cc, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:16.759646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8769e4-10de-4349-8eb1-838452859fc3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:16.764381 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c9ae3-f57b-4a92-8756-4afcc2f22099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:16.765852 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c9ae3-f57b-4a92-8756-4afcc2f22099 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:16.771038 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1343/2681] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:16 2022] PUT /identity/v3/projects/088d1b35c6334415b26ec40f4c13b24f/users/9dc80493ca7d4169b10b920193c970cc/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:16.780138 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1339/2682] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:48:16.781779 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e9cae-8cd2-4b6a-b52c-6c2fb1dc4161 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.782068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e9cae-8cd2-4b6a-b52c-6c2fb1dc4161 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.782342 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e9cae-8cd2-4b6a-b52c-6c2fb1dc4161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:16.813396 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a73e9cae-8cd2-4b6a-b52c-6c2fb1dc4161 None None] MFA Rules not processed for user `9dc80493ca7d4169b10b920193c970cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:16.814388 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a73e9cae-8cd2-4b6a-b52c-6c2fb1dc4161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:16.887804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1344/2683] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:16.900216 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c9ae3-f57b-4a92-8756-4afcc2f22099 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:16.901734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1b0c9ae3-f57b-4a92-8756-4afcc2f22099 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:16.913808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c9ae3-f57b-4a92-8756-4afcc2f22099 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:16.962185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978df5a-63ac-4049-bb5e-0b520d80a96f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:16.962867 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978df5a-63ac-4049-bb5e-0b520d80a96f service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:16.963220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978df5a-63ac-4049-bb5e-0b520d80a96f service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:16.963553 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978df5a-63ac-4049-bb5e-0b520d80a96f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:17.021988 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978df5a-63ac-4049-bb5e-0b520d80a96f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:17.023410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978df5a-63ac-4049-bb5e-0b520d80a96f service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:17.032113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1340/2684] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:18.909690 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e9cae-8cd2-4b6a-b52c-6c2fb1dc4161 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:18.919425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e9cae-8cd2-4b6a-b52c-6c2fb1dc4161 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:18.923450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa309b4b-142a-434f-9e67-8d81aab91d3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:18.923864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa309b4b-142a-434f-9e67-8d81aab91d3c service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:18.924145 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa309b4b-142a-434f-9e67-8d81aab91d3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:18.924419 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa309b4b-142a-434f-9e67-8d81aab91d3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:18.933783 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa309b4b-142a-434f-9e67-8d81aab91d3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:18.935273 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa309b4b-142a-434f-9e67-8d81aab91d3c service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:18.946092 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1345/2685] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:20.218037 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978df5a-63ac-4049-bb5e-0b520d80a96f service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:20.227720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978df5a-63ac-4049-bb5e-0b520d80a96f service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:20.231573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d13c5-92e6-4966-9767-e37e41daddaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:20.232169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d13c5-92e6-4966-9767-e37e41daddaf service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:20.232519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d13c5-92e6-4966-9767-e37e41daddaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:20.232705 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d13c5-92e6-4966-9767-e37e41daddaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:20.282591 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:20.295695 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d13c5-92e6-4966-9767-e37e41daddaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:20.297230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d13c5-92e6-4966-9767-e37e41daddaf service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:20.307236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1341/2686] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:20.337191 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa309b4b-142a-434f-9e67-8d81aab91d3c service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:20.338923 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aa309b4b-142a-434f-9e67-8d81aab91d3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:20.407978 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa309b4b-142a-434f-9e67-8d81aab91d3c service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:20.413406 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33145abb-ba2e-4488-8523-6d63e5649ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:20.413648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33145abb-ba2e-4488-8523-6d63e5649ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:20.413925 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33145abb-ba2e-4488-8523-6d63e5649ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:20.414351 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33145abb-ba2e-4488-8523-6d63e5649ec3 admin admin] PATH_INFO: `/v3/users/54dad9824a6b4bf49f85b19d41b69576` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:20.415345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33145abb-ba2e-4488-8523-6d63e5649ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54dad9824a6b4bf49f85b19d41b69576)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:20.417937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33145abb-ba2e-4488-8523-6d63e5649ec3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:20.705840 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:20.710748 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-33145abb-ba2e-4488-8523-6d63e5649ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54dad9824a6b4bf49f85b19d41b69576'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:20.717469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-33145abb-ba2e-4488-8523-6d63e5649ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54dad9824a6b4bf49f85b19d41b69576'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:20.730150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-33145abb-ba2e-4488-8523-6d63e5649ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54dad9824a6b4bf49f85b19d41b69576'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:20.799838 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-33145abb-ba2e-4488-8523-6d63e5649ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54dad9824a6b4bf49f85b19d41b69576'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:20.800530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-33145abb-ba2e-4488-8523-6d63e5649ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54dad9824a6b4bf49f85b19d41b69576'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:20.806701 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1346/2687] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:20 2022] DELETE /identity/v3/users/54dad9824a6b4bf49f85b19d41b69576 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:20.811306 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e104-135f-4a47-8751-26f1ff8bacba None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:20.811588 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e104-135f-4a47-8751-26f1ff8bacba None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:20.811869 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e104-135f-4a47-8751-26f1ff8bacba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:20.833474 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-1924e104-135f-4a47-8751-26f1ff8bacba None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:20.834737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1924e104-135f-4a47-8751-26f1ff8bacba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:21.027724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1342/2688] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:21.038576 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33145abb-ba2e-4488-8523-6d63e5649ec3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:21.040421 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-33145abb-ba2e-4488-8523-6d63e5649ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:21.100780 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33145abb-ba2e-4488-8523-6d63e5649ec3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:21.104389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac719ef-ee5a-4396-a8ef-da6264cb8aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:21.105004 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac719ef-ee5a-4396-a8ef-da6264cb8aba service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:21.105292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac719ef-ee5a-4396-a8ef-da6264cb8aba service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:21.105558 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac719ef-ee5a-4396-a8ef-da6264cb8aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:21.114790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac719ef-ee5a-4396-a8ef-da6264cb8aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:21.116196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac719ef-ee5a-4396-a8ef-da6264cb8aba service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:21.127401 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1347/2689] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:21.556473 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e104-135f-4a47-8751-26f1ff8bacba None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:21.557974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1924e104-135f-4a47-8751-26f1ff8bacba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:21.572703 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e104-135f-4a47-8751-26f1ff8bacba None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:21.577664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506e95e-5380-4aa0-b5d2-02748b814511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:21.578324 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506e95e-5380-4aa0-b5d2-02748b814511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:21.578623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506e95e-5380-4aa0-b5d2-02748b814511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:21.578893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506e95e-5380-4aa0-b5d2-02748b814511 admin admin] PATH_INFO: `/v3/projects/52c079037d5943ecb71137c285132ecd` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:21.580121 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506e95e-5380-4aa0-b5d2-02748b814511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c079037d5943ecb71137c285132ecd)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:21.582081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506e95e-5380-4aa0-b5d2-02748b814511 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:21.760340 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2506e95e-5380-4aa0-b5d2-02748b814511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c079037d5943ecb71137c285132ecd', 'request_id': 'req-2506e95e-5380-4aa0-b5d2-02748b814511'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:21.766796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2506e95e-5380-4aa0-b5d2-02748b814511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c079037d5943ecb71137c285132ecd', 'request_id': 'req-2506e95e-5380-4aa0-b5d2-02748b814511'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:21.831244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2506e95e-5380-4aa0-b5d2-02748b814511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c079037d5943ecb71137c285132ecd', 'request_id': 'req-2506e95e-5380-4aa0-b5d2-02748b814511'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:21.842168 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2506e95e-5380-4aa0-b5d2-02748b814511 admin admin] The token cache is being invalidate because project 52c079037d5943ecb71137c285132ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:21.842449 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2506e95e-5380-4aa0-b5d2-02748b814511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:21.843070 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-2506e95e-5380-4aa0-b5d2-02748b814511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:21.844529 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1343/2690] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:21 2022] DELETE /identity/v3/projects/52c079037d5943ecb71137c285132ecd => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:21.850531 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1c61c-1bc9-45d9-9bf2-9df37a459d60 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:21.850995 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1c61c-1bc9-45d9-9bf2-9df37a459d60 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:21.851114 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1c61c-1bc9-45d9-9bf2-9df37a459d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:21.871747 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c8b1c61c-1bc9-45d9-9bf2-9df37a459d60 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:21.872947 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c8b1c61c-1bc9-45d9-9bf2-9df37a459d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:21.932941 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1348/2691] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:21.940679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace5aad-fe1f-4d6f-8950-492ca0f919cc None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:21.940956 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace5aad-fe1f-4d6f-8950-492ca0f919cc None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:21.941255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace5aad-fe1f-4d6f-8950-492ca0f919cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:21.960599 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-5ace5aad-fe1f-4d6f-8950-492ca0f919cc None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:21.961820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5ace5aad-fe1f-4d6f-8950-492ca0f919cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:21.969647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1344/2692] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:21.974646 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1c61c-1bc9-45d9-9bf2-9df37a459d60 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:21.984157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1c61c-1bc9-45d9-9bf2-9df37a459d60 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:21.989597 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3db88f-a0d0-4155-8036-bbb1448e9e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:21.990194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3db88f-a0d0-4155-8036-bbb1448e9e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:21.990470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3db88f-a0d0-4155-8036-bbb1448e9e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:21.990741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3db88f-a0d0-4155-8036-bbb1448e9e24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:21.991386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3db88f-a0d0-4155-8036-bbb1448e9e24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:21.991698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3db88f-a0d0-4155-8036-bbb1448e9e24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:21.993308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3db88f-a0d0-4155-8036-bbb1448e9e24 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:22.005644 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1349/2693] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:48:22.010001 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace5aad-fe1f-4d6f-8950-492ca0f919cc None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:22.023343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace5aad-fe1f-4d6f-8950-492ca0f919cc None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:22.028218 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbc796-0933-4c69-bc47-15ac09adac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:22.028811 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbc796-0933-4c69-bc47-15ac09adac1c admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:22.029128 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbc796-0933-4c69-bc47-15ac09adac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:22.029408 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbc796-0933-4c69-bc47-15ac09adac1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:22.030035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbc796-0933-4c69-bc47-15ac09adac1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:22.031980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbc796-0933-4c69-bc47-15ac09adac1c admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:22.132061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1345/2694] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:22 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:22.136289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3db88f-a0d0-4155-8036-bbb1448e9e24 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:22.146853 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3db88f-a0d0-4155-8036-bbb1448e9e24 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:22.194055 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:22.209865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95df30-2eed-4ff8-90e0-8eb5a8415012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:22.209865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95df30-2eed-4ff8-90e0-8eb5a8415012 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:22.209865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95df30-2eed-4ff8-90e0-8eb5a8415012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:22.209865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95df30-2eed-4ff8-90e0-8eb5a8415012 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:22.210240 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95df30-2eed-4ff8-90e0-8eb5a8415012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:22.211223 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95df30-2eed-4ff8-90e0-8eb5a8415012 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:22.298054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1350/2695] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:22 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:22.301977 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbc796-0933-4c69-bc47-15ac09adac1c admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:22.312892 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbc796-0933-4c69-bc47-15ac09adac1c admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:22.318139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb6c17-f955-4f56-9470-dd4848921457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:22.318837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb6c17-f955-4f56-9470-dd4848921457 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:22.319041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb6c17-f955-4f56-9470-dd4848921457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:22.319309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb6c17-f955-4f56-9470-dd4848921457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:22.320167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb6c17-f955-4f56-9470-dd4848921457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:22.321968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb6c17-f955-4f56-9470-dd4848921457 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:22.333234 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1346/2696] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:22.337559 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95df30-2eed-4ff8-90e0-8eb5a8415012 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:22.349182 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95df30-2eed-4ff8-90e0-8eb5a8415012 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:22.354681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f7048-966f-4988-a1c8-8cef94656aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:22.355687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f7048-966f-4988-a1c8-8cef94656aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:22.355687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f7048-966f-4988-a1c8-8cef94656aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:22.356016 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f7048-966f-4988-a1c8-8cef94656aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:22.356694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f7048-966f-4988-a1c8-8cef94656aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:22.358560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f7048-966f-4988-a1c8-8cef94656aa5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:22.371349 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1351/2697] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:22.375621 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb6c17-f955-4f56-9470-dd4848921457 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:22.386169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb6c17-f955-4f56-9470-dd4848921457 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:22.390828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acd377-6cd8-4a32-a8f7-368ed23000f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:22.391473 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acd377-6cd8-4a32-a8f7-368ed23000f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:22.391749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acd377-6cd8-4a32-a8f7-368ed23000f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:22.392021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acd377-6cd8-4a32-a8f7-368ed23000f9 admin admin] PATH_INFO: `/v3/projects/75098fba610c41998860f12de191a934/users/102a54cffc2043178b8a84c31eb9a22c/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:22.407679 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03acd377-6cd8-4a32-a8f7-368ed23000f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75098fba610c41998860f12de191a934, user_id=102a54cffc2043178b8a84c31eb9a22c, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:22.411103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03acd377-6cd8-4a32-a8f7-368ed23000f9 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:22.506814 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1347/2698] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:22 2022] PUT /identity/v3/projects/75098fba610c41998860f12de191a934/users/102a54cffc2043178b8a84c31eb9a22c/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:22.518130 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b518255-3e94-41f8-8431-aac208326bdc None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:22.518435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b518255-3e94-41f8-8431-aac208326bdc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:22.518733 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b518255-3e94-41f8-8431-aac208326bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:22.547067 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2b518255-3e94-41f8-8431-aac208326bdc None None] MFA Rules not processed for user `102a54cffc2043178b8a84c31eb9a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:22.549312 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2b518255-3e94-41f8-8431-aac208326bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:22.612701 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1352/2699] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:22.623633 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acd377-6cd8-4a32-a8f7-368ed23000f9 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:22.625561 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-03acd377-6cd8-4a32-a8f7-368ed23000f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:22.636479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:22.683272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acd377-6cd8-4a32-a8f7-368ed23000f9 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:22.686876 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142f63b-1def-45df-9622-953135e34b8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:22.687469 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142f63b-1def-45df-9622-953135e34b8e service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:22.687746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142f63b-1def-45df-9622-953135e34b8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:22.688015 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142f63b-1def-45df-9622-953135e34b8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:22.696625 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142f63b-1def-45df-9622-953135e34b8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:22.698076 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142f63b-1def-45df-9622-953135e34b8e service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:22.707349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1348/2700] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:23.402265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b518255-3e94-41f8-8431-aac208326bdc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:23.403721 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2b518255-3e94-41f8-8431-aac208326bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:23.471671 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b518255-3e94-41f8-8431-aac208326bdc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:23.476394 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f5fd3-bbb8-4177-8afd-9faa0d6a0e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:23.477052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f5fd3-bbb8-4177-8afd-9faa0d6a0e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:23.477331 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f5fd3-bbb8-4177-8afd-9faa0d6a0e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:23.477607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f5fd3-bbb8-4177-8afd-9faa0d6a0e03 admin admin] PATH_INFO: `/v3/users/84beb9c398004c6c913ff855210df66d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:23.478758 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f5fd3-bbb8-4177-8afd-9faa0d6a0e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84beb9c398004c6c913ff855210df66d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:23.480764 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f5fd3-bbb8-4177-8afd-9faa0d6a0e03 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:23.668583 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db6f5fd3-bbb8-4177-8afd-9faa0d6a0e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84beb9c398004c6c913ff855210df66d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:23.676409 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db6f5fd3-bbb8-4177-8afd-9faa0d6a0e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84beb9c398004c6c913ff855210df66d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:23.678285 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:23.688759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db6f5fd3-bbb8-4177-8afd-9faa0d6a0e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84beb9c398004c6c913ff855210df66d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:23.769511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db6f5fd3-bbb8-4177-8afd-9faa0d6a0e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84beb9c398004c6c913ff855210df66d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:23.772899 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db6f5fd3-bbb8-4177-8afd-9faa0d6a0e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84beb9c398004c6c913ff855210df66d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:23.777400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1353/2701] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:23 2022] DELETE /identity/v3/users/84beb9c398004c6c913ff855210df66d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:23.781912 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed29b9-c7e1-498b-9533-af53cb1cc1d0 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:23.782434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed29b9-c7e1-498b-9533-af53cb1cc1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:23.782434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed29b9-c7e1-498b-9533-af53cb1cc1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:23.801709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-06ed29b9-c7e1-498b-9533-af53cb1cc1d0 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:23.802897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-06ed29b9-c7e1-498b-9533-af53cb1cc1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:23.861808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1349/2702] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:23.872286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f5fd3-bbb8-4177-8afd-9faa0d6a0e03 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:23.874250 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-db6f5fd3-bbb8-4177-8afd-9faa0d6a0e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:23.932668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f5fd3-bbb8-4177-8afd-9faa0d6a0e03 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:23.936409 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c7cda-e1d7-4ae1-8d99-3334f60c5e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:23.937019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7cda-e1d7-4ae1-8d99-3334f60c5e17 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:23.937309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7cda-e1d7-4ae1-8d99-3334f60c5e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:23.937572 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7cda-e1d7-4ae1-8d99-3334f60c5e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:23.946913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c7cda-e1d7-4ae1-8d99-3334f60c5e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:23.948335 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c7cda-e1d7-4ae1-8d99-3334f60c5e17 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:23.962292 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1354/2703] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:24.673145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed29b9-c7e1-498b-9533-af53cb1cc1d0 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:24.673145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-06ed29b9-c7e1-498b-9533-af53cb1cc1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:24.682910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed29b9-c7e1-498b-9533-af53cb1cc1d0 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:24.693548 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:24.694406 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:24.694755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:24.695207 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] PATH_INFO: `/v3/projects/dfe9601d811f4f54b56f5f6cb7991cbd` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:24.696474 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe9601d811f4f54b56f5f6cb7991cbd)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:24.699205 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:24.826153 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe9601d811f4f54b56f5f6cb7991cbd', 'request_id': 'req-83638280-1487-44fb-b212-2621a914f01c'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:24.833467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe9601d811f4f54b56f5f6cb7991cbd', 'request_id': 'req-83638280-1487-44fb-b212-2621a914f01c'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:24.919476 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe9601d811f4f54b56f5f6cb7991cbd', 'request_id': 'req-83638280-1487-44fb-b212-2621a914f01c'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:24.930828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] The token cache is being invalidate because project dfe9601d811f4f54b56f5f6cb7991cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:24.935374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:24.935374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:24.935374 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1350/2704] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:24 2022] DELETE /identity/v3/projects/dfe9601d811f4f54b56f5f6cb7991cbd => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:24.937508 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c7cda-e1d7-4ae1-8d99-3334f60c5e17 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:24.947555 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c7cda-e1d7-4ae1-8d99-3334f60c5e17 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:25.019302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d38ba-30f9-469f-8cd3-b22d28f9c81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:25.019302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d38ba-30f9-469f-8cd3-b22d28f9c81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:25.019302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d38ba-30f9-469f-8cd3-b22d28f9c81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:25.019302 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d38ba-30f9-469f-8cd3-b22d28f9c81c admin admin] PATH_INFO: `/v3/users/9dc80493ca7d4169b10b920193c970cc` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:25.019883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d38ba-30f9-469f-8cd3-b22d28f9c81c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc80493ca7d4169b10b920193c970cc)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:25.019883 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d38ba-30f9-469f-8cd3-b22d28f9c81c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:25.164111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7b9d38ba-30f9-469f-8cd3-b22d28f9c81c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc80493ca7d4169b10b920193c970cc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:25.177644 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7b9d38ba-30f9-469f-8cd3-b22d28f9c81c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc80493ca7d4169b10b920193c970cc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:25.191924 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7b9d38ba-30f9-469f-8cd3-b22d28f9c81c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc80493ca7d4169b10b920193c970cc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:25.248575 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7b9d38ba-30f9-469f-8cd3-b22d28f9c81c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc80493ca7d4169b10b920193c970cc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:25.249235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7b9d38ba-30f9-469f-8cd3-b22d28f9c81c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc80493ca7d4169b10b920193c970cc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:25.250955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:25.257214 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1355/2705] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:24 2022] DELETE /identity/v3/users/9dc80493ca7d4169b10b920193c970cc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:25.726595 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:25.731190 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:25.741709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83638280-1487-44fb-b212-2621a914f01c admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:25.772778 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:25.798489 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d423c7-d588-4608-915f-8c409d053783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:25.799112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d423c7-d588-4608-915f-8c409d053783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:25.799391 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d423c7-d588-4608-915f-8c409d053783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:25.799661 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d423c7-d588-4608-915f-8c409d053783 admin admin] PATH_INFO: `/v3/projects/088d1b35c6334415b26ec40f4c13b24f` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:25.801296 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d423c7-d588-4608-915f-8c409d053783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=088d1b35c6334415b26ec40f4c13b24f)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:25.803310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d423c7-d588-4608-915f-8c409d053783 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:25.914509 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-94d423c7-d588-4608-915f-8c409d053783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088d1b35c6334415b26ec40f4c13b24f', 'request_id': 'req-94d423c7-d588-4608-915f-8c409d053783'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:25.920957 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-94d423c7-d588-4608-915f-8c409d053783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088d1b35c6334415b26ec40f4c13b24f', 'request_id': 'req-94d423c7-d588-4608-915f-8c409d053783'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:25.970134 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d38ba-30f9-469f-8cd3-b22d28f9c81c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:25.971815 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7b9d38ba-30f9-469f-8cd3-b22d28f9c81c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:25.985620 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d38ba-30f9-469f-8cd3-b22d28f9c81c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:25.987621 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-94d423c7-d588-4608-915f-8c409d053783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088d1b35c6334415b26ec40f4c13b24f', 'request_id': 'req-94d423c7-d588-4608-915f-8c409d053783'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:26.000167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-94d423c7-d588-4608-915f-8c409d053783 admin admin] The token cache is being invalidate because project 088d1b35c6334415b26ec40f4c13b24f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:26.000462 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-94d423c7-d588-4608-915f-8c409d053783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:26.001173 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-94d423c7-d588-4608-915f-8c409d053783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:26.002713 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1351/2706] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:25 2022] DELETE /identity/v3/projects/088d1b35c6334415b26ec40f4c13b24f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:26.007433 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48cd18-0935-400a-bf39-453bc77db398 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:26.007720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48cd18-0935-400a-bf39-453bc77db398 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:26.007997 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48cd18-0935-400a-bf39-453bc77db398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:26.027738 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2c48cd18-0935-400a-bf39-453bc77db398 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:26.028949 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2c48cd18-0935-400a-bf39-453bc77db398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:26.043818 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583140a6-f121-4bb6-b0f3-cd05072bf990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:26.044452 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583140a6-f121-4bb6-b0f3-cd05072bf990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:26.044732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583140a6-f121-4bb6-b0f3-cd05072bf990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:26.045015 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583140a6-f121-4bb6-b0f3-cd05072bf990 admin admin] PATH_INFO: `/v3/users/102a54cffc2043178b8a84c31eb9a22c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:26.046186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583140a6-f121-4bb6-b0f3-cd05072bf990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=102a54cffc2043178b8a84c31eb9a22c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:26.048104 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583140a6-f121-4bb6-b0f3-cd05072bf990 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:26.089590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1352/2707] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:26.097990 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f7fd5-89a5-48e7-b9f0-9e9a3eea3fec None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:26.098272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f7fd5-89a5-48e7-b9f0-9e9a3eea3fec None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:26.098545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f7fd5-89a5-48e7-b9f0-9e9a3eea3fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:26.118145 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-1c9f7fd5-89a5-48e7-b9f0-9e9a3eea3fec None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:26.119331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1c9f7fd5-89a5-48e7-b9f0-9e9a3eea3fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:26.127221 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1353/2708] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:26.131309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f7fd5-89a5-48e7-b9f0-9e9a3eea3fec None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:26.140052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f7fd5-89a5-48e7-b9f0-9e9a3eea3fec None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:26.145146 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b7c94-5aae-4209-b1ba-d12960c88ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:26.145702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b7c94-5aae-4209-b1ba-d12960c88ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:26.145994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b7c94-5aae-4209-b1ba-d12960c88ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:26.146256 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b7c94-5aae-4209-b1ba-d12960c88ca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:26.146877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b7c94-5aae-4209-b1ba-d12960c88ca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:26.147179 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b7c94-5aae-4209-b1ba-d12960c88ca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:26.148763 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b7c94-5aae-4209-b1ba-d12960c88ca9 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:26.163739 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1354/2709] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:48:26.167868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b7c94-5aae-4209-b1ba-d12960c88ca9 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:26.178041 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b7c94-5aae-4209-b1ba-d12960c88ca9 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:26.182660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d32f41-a1a9-4f90-9913-7a4aac421d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:26.183239 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d32f41-a1a9-4f90-9913-7a4aac421d1c admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:26.186945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d32f41-a1a9-4f90-9913-7a4aac421d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:26.186945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d32f41-a1a9-4f90-9913-7a4aac421d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:26.186945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d32f41-a1a9-4f90-9913-7a4aac421d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:26.186945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d32f41-a1a9-4f90-9913-7a4aac421d1c admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:26.281293 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-583140a6-f121-4bb6-b0f3-cd05072bf990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102a54cffc2043178b8a84c31eb9a22c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:26.290041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-583140a6-f121-4bb6-b0f3-cd05072bf990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102a54cffc2043178b8a84c31eb9a22c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:26.296630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1355/2710] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:26 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:26.302623 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d32f41-a1a9-4f90-9913-7a4aac421d1c admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:26.303413 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-583140a6-f121-4bb6-b0f3-cd05072bf990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102a54cffc2043178b8a84c31eb9a22c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:26.329118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:26.365615 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d32f41-a1a9-4f90-9913-7a4aac421d1c admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:26.370468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171997e6-80c7-48c4-9edc-97f7c14504de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:26.371163 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171997e6-80c7-48c4-9edc-97f7c14504de admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:26.371442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171997e6-80c7-48c4-9edc-97f7c14504de admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:26.371708 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171997e6-80c7-48c4-9edc-97f7c14504de admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:26.372332 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171997e6-80c7-48c4-9edc-97f7c14504de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:26.374350 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171997e6-80c7-48c4-9edc-97f7c14504de admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:26.380345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-583140a6-f121-4bb6-b0f3-cd05072bf990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102a54cffc2043178b8a84c31eb9a22c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:26.381195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-583140a6-f121-4bb6-b0f3-cd05072bf990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102a54cffc2043178b8a84c31eb9a22c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:26.398112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1356/2711] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:25 2022] DELETE /identity/v3/users/102a54cffc2043178b8a84c31eb9a22c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:26.399541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128004a-80be-4366-94b3-46d5a4403eef None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:26.399781 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128004a-80be-4366-94b3-46d5a4403eef None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:26.400057 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128004a-80be-4366-94b3-46d5a4403eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:26.426127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b128004a-80be-4366-94b3-46d5a4403eef None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:26.427461 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b128004a-80be-4366-94b3-46d5a4403eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:26.493050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1356/2712] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:26 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:26.493344 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1357/2713] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:26.496129 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171997e6-80c7-48c4-9edc-97f7c14504de admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:26.497791 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-171997e6-80c7-48c4-9edc-97f7c14504de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:26.502071 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128004a-80be-4366-94b3-46d5a4403eef None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:26.503447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b128004a-80be-4366-94b3-46d5a4403eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:26.510840 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171997e6-80c7-48c4-9edc-97f7c14504de admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:26.515559 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178404b-7343-413c-a164-1b82adf645ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:26.516219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178404b-7343-413c-a164-1b82adf645ac admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:26.516494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178404b-7343-413c-a164-1b82adf645ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:26.516758 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178404b-7343-413c-a164-1b82adf645ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:26.517425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178404b-7343-413c-a164-1b82adf645ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:26.519601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178404b-7343-413c-a164-1b82adf645ac admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:26.523956 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:26.530008 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1357/2714] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:26.533856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178404b-7343-413c-a164-1b82adf645ac admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:26.544847 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178404b-7343-413c-a164-1b82adf645ac admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:26.549604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf407c5-9300-4a3c-b17a-44ea999927b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:26.550427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf407c5-9300-4a3c-b17a-44ea999927b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:26.551039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf407c5-9300-4a3c-b17a-44ea999927b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:26.551039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf407c5-9300-4a3c-b17a-44ea999927b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:26.551684 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf407c5-9300-4a3c-b17a-44ea999927b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:26.553293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf407c5-9300-4a3c-b17a-44ea999927b8 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:26.562957 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128004a-80be-4366-94b3-46d5a4403eef None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:26.567877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1358/2715] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:26.568491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aadfcd-7b2a-4985-b2a2-14cdaecf6bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:26.569153 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadfcd-7b2a-4985-b2a2-14cdaecf6bda service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:26.569442 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadfcd-7b2a-4985-b2a2-14cdaecf6bda service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:26.569705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadfcd-7b2a-4985-b2a2-14cdaecf6bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:26.570413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf407c5-9300-4a3c-b17a-44ea999927b8 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:26.579147 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aadfcd-7b2a-4985-b2a2-14cdaecf6bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:26.580453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf407c5-9300-4a3c-b17a-44ea999927b8 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:26.580606 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aadfcd-7b2a-4985-b2a2-14cdaecf6bda service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:26.585647 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cfc72-6517-4b98-bc15-08d171a0e463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:26.586287 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cfc72-6517-4b98-bc15-08d171a0e463 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:26.586560 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cfc72-6517-4b98-bc15-08d171a0e463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:26.586831 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cfc72-6517-4b98-bc15-08d171a0e463 admin admin] PATH_INFO: `/v3/projects/97b96a54edb94c0b9bee3246df9cbf76/users/dea9af58b0134719bb151fe4ffbfc9d5/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:26.591749 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1358/2716] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:48:26.603686 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cfc72-6517-4b98-bc15-08d171a0e463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b96a54edb94c0b9bee3246df9cbf76, user_id=dea9af58b0134719bb151fe4ffbfc9d5, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:26.606419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cfc72-6517-4b98-bc15-08d171a0e463 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:26.762863 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1359/2717] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:26 2022] PUT /identity/v3/projects/97b96a54edb94c0b9bee3246df9cbf76/users/dea9af58b0134719bb151fe4ffbfc9d5/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:26.773304 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec637-3a6e-4ebe-934f-9ba8d1e4c716 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:26.773706 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec637-3a6e-4ebe-934f-9ba8d1e4c716 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:26.774067 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec637-3a6e-4ebe-934f-9ba8d1e4c716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:26.803948 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6ccec637-3a6e-4ebe-934f-9ba8d1e4c716 None None] MFA Rules not processed for user `dea9af58b0134719bb151fe4ffbfc9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:26.806487 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6ccec637-3a6e-4ebe-934f-9ba8d1e4c716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:26.890811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1359/2718] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:26.895272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cfc72-6517-4b98-bc15-08d171a0e463 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:26.960196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cfc72-6517-4b98-bc15-08d171a0e463 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:26.965113 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e1d8b-4091-4c0b-8737-655db3f8aacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:26.965748 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e1d8b-4091-4c0b-8737-655db3f8aacb admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:26.966026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e1d8b-4091-4c0b-8737-655db3f8aacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:26.966302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e1d8b-4091-4c0b-8737-655db3f8aacb admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:26.966939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e1d8b-4091-4c0b-8737-655db3f8aacb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:26.968848 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e1d8b-4091-4c0b-8737-655db3f8aacb admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:27.022918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccec637-3a6e-4ebe-934f-9ba8d1e4c716 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:27.024321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6ccec637-3a6e-4ebe-934f-9ba8d1e4c716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:27.045245 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccec637-3a6e-4ebe-934f-9ba8d1e4c716 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:27.053882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5613dd6-fbcb-484c-b502-d33fdde270bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:27.053882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5613dd6-fbcb-484c-b502-d33fdde270bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.053882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5613dd6-fbcb-484c-b502-d33fdde270bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.053882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5613dd6-fbcb-484c-b502-d33fdde270bb admin admin] PATH_INFO: `/v3/projects/75098fba610c41998860f12de191a934` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.054624 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5613dd6-fbcb-484c-b502-d33fdde270bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=75098fba610c41998860f12de191a934)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:27.055255 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5613dd6-fbcb-484c-b502-d33fdde270bb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:27.064272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1360/2719] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:26 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:27.068488 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e1d8b-4091-4c0b-8737-655db3f8aacb admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:27.122495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:27.133788 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e1d8b-4091-4c0b-8737-655db3f8aacb admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:27.138455 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a70d-35fe-4d20-965c-14db58e95383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:27.139053 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a70d-35fe-4d20-965c-14db58e95383 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.139355 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a70d-35fe-4d20-965c-14db58e95383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.139600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a70d-35fe-4d20-965c-14db58e95383 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.140218 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177a70d-35fe-4d20-965c-14db58e95383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:27.142160 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177a70d-35fe-4d20-965c-14db58e95383 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:27.175236 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f5613dd6-fbcb-484c-b502-d33fdde270bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75098fba610c41998860f12de191a934', 'request_id': 'req-f5613dd6-fbcb-484c-b502-d33fdde270bb'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:27.181687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f5613dd6-fbcb-484c-b502-d33fdde270bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75098fba610c41998860f12de191a934', 'request_id': 'req-f5613dd6-fbcb-484c-b502-d33fdde270bb'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:27.187510 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f5613dd6-fbcb-484c-b502-d33fdde270bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75098fba610c41998860f12de191a934', 'request_id': 'req-f5613dd6-fbcb-484c-b502-d33fdde270bb'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:27.211385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1361/2720] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:27 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:27.215418 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a70d-35fe-4d20-965c-14db58e95383 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:27.225824 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a70d-35fe-4d20-965c-14db58e95383 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:27.280757 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb09c6-60e3-404a-8465-fef23a06cb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:27.281313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb09c6-60e3-404a-8465-fef23a06cb66 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.281591 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb09c6-60e3-404a-8465-fef23a06cb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.281861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb09c6-60e3-404a-8465-fef23a06cb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.282552 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb09c6-60e3-404a-8465-fef23a06cb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:27.283422 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f5613dd6-fbcb-484c-b502-d33fdde270bb admin admin] The token cache is being invalidate because project 75098fba610c41998860f12de191a934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:27.283720 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f5613dd6-fbcb-484c-b502-d33fdde270bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:27.284196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb09c6-60e3-404a-8465-fef23a06cb66 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:27.284374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f5613dd6-fbcb-484c-b502-d33fdde270bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:27.286624 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1360/2721] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:27 2022] DELETE /identity/v3/projects/75098fba610c41998860f12de191a934 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:27.292376 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8effc8-e603-4f7c-aac1-0faee491c3b7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.292694 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8effc8-e603-4f7c-aac1-0faee491c3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.292968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8effc8-e603-4f7c-aac1-0faee491c3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.298635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1362/2722] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:27.299678 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb09c6-60e3-404a-8465-fef23a06cb66 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:27.301621 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b5fb09c6-60e3-404a-8465-fef23a06cb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:27.314080 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb09c6-60e3-404a-8465-fef23a06cb66 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:27.315430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5d8effc8-e603-4f7c-aac1-0faee491c3b7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:27.317180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5d8effc8-e603-4f7c-aac1-0faee491c3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:27.319533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b76f4e-5e2d-4943-b7f9-deaad58c836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:27.320230 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b76f4e-5e2d-4943-b7f9-deaad58c836e admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.320511 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b76f4e-5e2d-4943-b7f9-deaad58c836e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.320807 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b76f4e-5e2d-4943-b7f9-deaad58c836e admin admin] PATH_INFO: `/v3/projects/882326d8532b4c8fa7ccf56af80afbc2/users/cb0bb78e7a3047d48528ce9f5512ca8d/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.325377 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1361/2723] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:27.333872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5341bc-5213-4bd7-b2fa-32620b03a439 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.334180 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5341bc-5213-4bd7-b2fa-32620b03a439 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.334450 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5341bc-5213-4bd7-b2fa-32620b03a439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.337761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b76f4e-5e2d-4943-b7f9-deaad58c836e admin admin] RBAC: Authorizing `identity:create_grant(project_id=882326d8532b4c8fa7ccf56af80afbc2, user_id=cb0bb78e7a3047d48528ce9f5512ca8d, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:27.340580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b76f4e-5e2d-4943-b7f9-deaad58c836e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:27.354667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-db5341bc-5213-4bd7-b2fa-32620b03a439 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:27.355858 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-db5341bc-5213-4bd7-b2fa-32620b03a439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:27.363567 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1362/2724] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:27.367619 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5341bc-5213-4bd7-b2fa-32620b03a439 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:27.376622 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5341bc-5213-4bd7-b2fa-32620b03a439 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:27.382113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f9a73-26d4-4eff-9750-e69bb21f5ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:27.383006 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f9a73-26d4-4eff-9750-e69bb21f5ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.383006 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f9a73-26d4-4eff-9750-e69bb21f5ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.383253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f9a73-26d4-4eff-9750-e69bb21f5ed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.383968 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f9a73-26d4-4eff-9750-e69bb21f5ed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:27.384273 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f9a73-26d4-4eff-9750-e69bb21f5ed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:27.386035 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f9a73-26d4-4eff-9750-e69bb21f5ed9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:27.398746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1363/2725] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:48:27.402849 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f9a73-26d4-4eff-9750-e69bb21f5ed9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:27.412650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f9a73-26d4-4eff-9750-e69bb21f5ed9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:27.417353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4a97e-0eea-4666-8925-1218b207efa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:27.417951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4a97e-0eea-4666-8925-1218b207efa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.418226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4a97e-0eea-4666-8925-1218b207efa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.418856 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4a97e-0eea-4666-8925-1218b207efa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.419542 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4a97e-0eea-4666-8925-1218b207efa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:27.421466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4a97e-0eea-4666-8925-1218b207efa3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:27.426018 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:27.437717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1363/2726] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:27 2022] PUT /identity/v3/projects/882326d8532b4c8fa7ccf56af80afbc2/users/cb0bb78e7a3047d48528ce9f5512ca8d/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:27.442534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b76f4e-5e2d-4943-b7f9-deaad58c836e admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:27.504166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b76f4e-5e2d-4943-b7f9-deaad58c836e admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:27.508938 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d3f32-c53e-417d-b23b-fa264c417f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:27.509570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d3f32-c53e-417d-b23b-fa264c417f74 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.509879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d3f32-c53e-417d-b23b-fa264c417f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.510149 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d3f32-c53e-417d-b23b-fa264c417f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.510782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d3f32-c53e-417d-b23b-fa264c417f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:27.512365 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d3f32-c53e-417d-b23b-fa264c417f74 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:27.522699 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1364/2727] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:27.526877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d3f32-c53e-417d-b23b-fa264c417f74 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:27.536092 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d3f32-c53e-417d-b23b-fa264c417f74 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:27.540695 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d386917-86ac-4687-881d-57458cc2c50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:27.541355 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386917-86ac-4687-881d-57458cc2c50e admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.541861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386917-86ac-4687-881d-57458cc2c50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.541981 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1364/2728] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:27 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:27.542104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386917-86ac-4687-881d-57458cc2c50e admin admin] PATH_INFO: `/v3/projects/882326d8532b4c8fa7ccf56af80afbc2/users/cb0bb78e7a3047d48528ce9f5512ca8d/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.543964 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d386917-86ac-4687-881d-57458cc2c50e admin admin] RBAC: Authorizing `identity:create_grant(project_id=882326d8532b4c8fa7ccf56af80afbc2, user_id=cb0bb78e7a3047d48528ce9f5512ca8d, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:27.545742 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4a97e-0eea-4666-8925-1218b207efa3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:27.549849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d386917-86ac-4687-881d-57458cc2c50e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:27.557291 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1365/2729] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:27 2022] PUT /identity/v3/projects/882326d8532b4c8fa7ccf56af80afbc2/users/cb0bb78e7a3047d48528ce9f5512ca8d/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:27.567891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dcd7c-b446-43f0-9f79-0a42e0512107 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.568171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dcd7c-b446-43f0-9f79-0a42e0512107 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.568573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dcd7c-b446-43f0-9f79-0a42e0512107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.599318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-525dcd7c-b446-43f0-9f79-0a42e0512107 None None] MFA Rules not processed for user `cb0bb78e7a3047d48528ce9f5512ca8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:27.600558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-525dcd7c-b446-43f0-9f79-0a42e0512107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:27.675302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1366/2730] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:27.687094 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525dcd7c-b446-43f0-9f79-0a42e0512107 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:27.688492 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-525dcd7c-b446-43f0-9f79-0a42e0512107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:27.729750 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4a97e-0eea-4666-8925-1218b207efa3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:27.745595 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525dcd7c-b446-43f0-9f79-0a42e0512107 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:27.749448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7101f-19c7-4a6f-9aaf-f0e613f7bbf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:27.750076 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7101f-19c7-4a6f-9aaf-f0e613f7bbf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.750355 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7101f-19c7-4a6f-9aaf-f0e613f7bbf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.750628 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7101f-19c7-4a6f-9aaf-f0e613f7bbf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.760453 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7101f-19c7-4a6f-9aaf-f0e613f7bbf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:27.762051 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7101f-19c7-4a6f-9aaf-f0e613f7bbf0 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:27.771302 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1367/2731] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:48:27.785541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abef05-77d6-46e3-a0a4-e6da6e92338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:27.786201 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abef05-77d6-46e3-a0a4-e6da6e92338f admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.786508 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abef05-77d6-46e3-a0a4-e6da6e92338f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.786677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abef05-77d6-46e3-a0a4-e6da6e92338f admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.787307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abef05-77d6-46e3-a0a4-e6da6e92338f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:27.789228 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abef05-77d6-46e3-a0a4-e6da6e92338f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:27.792250 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:27.883944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7101f-19c7-4a6f-9aaf-f0e613f7bbf0 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:27.885560 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-60b7101f-19c7-4a6f-9aaf-f0e613f7bbf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:27.897523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7101f-19c7-4a6f-9aaf-f0e613f7bbf0 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:27.901282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40802ad-d49a-4cb3-831e-b87438d35eb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:27.901871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40802ad-d49a-4cb3-831e-b87438d35eb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.902142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40802ad-d49a-4cb3-831e-b87438d35eb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.902405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40802ad-d49a-4cb3-831e-b87438d35eb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.904103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d40802ad-d49a-4cb3-831e-b87438d35eb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:27.935648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1365/2732] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:27 2022] POST /identity/v3/users => generated 287 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:27.937111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abef05-77d6-46e3-a0a4-e6da6e92338f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:27.946941 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abef05-77d6-46e3-a0a4-e6da6e92338f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:27.952239 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69443385-26da-4725-aa85-8bfd7a4452c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:27.952837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69443385-26da-4725-aa85-8bfd7a4452c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.953155 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69443385-26da-4725-aa85-8bfd7a4452c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.953430 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69443385-26da-4725-aa85-8bfd7a4452c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.954068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69443385-26da-4725-aa85-8bfd7a4452c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:27.955663 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69443385-26da-4725-aa85-8bfd7a4452c3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:27.965025 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40802ad-d49a-4cb3-831e-b87438d35eb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:27.966465 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40802ad-d49a-4cb3-831e-b87438d35eb9 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:27.969583 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1366/2733] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:27.970851 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69443385-26da-4725-aa85-8bfd7a4452c3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:27.976208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1368/2734] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:27.981337 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69443385-26da-4725-aa85-8bfd7a4452c3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:27.986019 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819d3e2-464b-49c7-88ae-46d2164898cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:27.986653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819d3e2-464b-49c7-88ae-46d2164898cb admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:27.986937 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819d3e2-464b-49c7-88ae-46d2164898cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:27.987210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819d3e2-464b-49c7-88ae-46d2164898cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:27.987979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819d3e2-464b-49c7-88ae-46d2164898cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:27.989541 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819d3e2-464b-49c7-88ae-46d2164898cb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:27.999413 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1367/2735] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:28.003755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40802ad-d49a-4cb3-831e-b87438d35eb9 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:28.014280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40802ad-d49a-4cb3-831e-b87438d35eb9 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:28.019440 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98092df-61a4-400c-ba82-75675db7eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:28.020194 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98092df-61a4-400c-ba82-75675db7eafc admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:28.020475 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98092df-61a4-400c-ba82-75675db7eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:28.020749 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98092df-61a4-400c-ba82-75675db7eafc admin admin] PATH_INFO: `/v3/projects/7f55790082fd4576b33c35a571e455a7/users/a481726e59974db3a9c6200d6e4f7197/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:28.038486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98092df-61a4-400c-ba82-75675db7eafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f55790082fd4576b33c35a571e455a7, user_id=a481726e59974db3a9c6200d6e4f7197, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:28.041209 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98092df-61a4-400c-ba82-75675db7eafc admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:28.152519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1369/2736] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:28 2022] PUT /identity/v3/projects/7f55790082fd4576b33c35a571e455a7/users/a481726e59974db3a9c6200d6e4f7197/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:28.168424 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08dc1-f5b9-49d7-90d3-a3b5973c6b40 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:28.168830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08dc1-f5b9-49d7-90d3-a3b5973c6b40 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:28.168973 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08dc1-f5b9-49d7-90d3-a3b5973c6b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:28.196508 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2ca08dc1-f5b9-49d7-90d3-a3b5973c6b40 None None] MFA Rules not processed for user `a481726e59974db3a9c6200d6e4f7197`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:28.197734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2ca08dc1-f5b9-49d7-90d3-a3b5973c6b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:28.245625 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:28.263348 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1368/2737] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:28.274626 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98092df-61a4-400c-ba82-75675db7eafc admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:28.315178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:28.329196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98092df-61a4-400c-ba82-75675db7eafc admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:28.333516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116ab73-db87-48fa-ad52-df5293800f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:28.334112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ab73-db87-48fa-ad52-df5293800f98 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:28.334381 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ab73-db87-48fa-ad52-df5293800f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:28.334644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ab73-db87-48fa-ad52-df5293800f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:28.343079 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116ab73-db87-48fa-ad52-df5293800f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:28.344544 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116ab73-db87-48fa-ad52-df5293800f98 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:28.353373 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1370/2738] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:30.232240 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e276442-56ce-4612-a1ea-6b5c01d0d66b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:30.234664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e276442-56ce-4612-a1ea-6b5c01d0d66b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:30.234664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e276442-56ce-4612-a1ea-6b5c01d0d66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:30.252529 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1e276442-56ce-4612-a1ea-6b5c01d0d66b None None] MFA Rules not processed for user `a481726e59974db3a9c6200d6e4f7197`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:30.253964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1e276442-56ce-4612-a1ea-6b5c01d0d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:30.261960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1369/2739] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:31.466664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116ab73-db87-48fa-ad52-df5293800f98 service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:31.532768 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116ab73-db87-48fa-ad52-df5293800f98 service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:31.537539 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e51660-0435-451c-b192-748787768ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:31.538177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e51660-0435-451c-b192-748787768ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:31.538457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e51660-0435-451c-b192-748787768ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:31.538732 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e51660-0435-451c-b192-748787768ffc admin admin] PATH_INFO: `/v3/users/dea9af58b0134719bb151fe4ffbfc9d5` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:31.539866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e51660-0435-451c-b192-748787768ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea9af58b0134719bb151fe4ffbfc9d5)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:31.541876 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e51660-0435-451c-b192-748787768ffc admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:31.751601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-91e51660-0435-451c-b192-748787768ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea9af58b0134719bb151fe4ffbfc9d5'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:31.810794 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-91e51660-0435-451c-b192-748787768ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea9af58b0134719bb151fe4ffbfc9d5'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:31.811501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-91e51660-0435-451c-b192-748787768ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea9af58b0134719bb151fe4ffbfc9d5'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:31.819125 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-91e51660-0435-451c-b192-748787768ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea9af58b0134719bb151fe4ffbfc9d5'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:31.830998 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-91e51660-0435-451c-b192-748787768ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea9af58b0134719bb151fe4ffbfc9d5'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:31.837163 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1371/2740] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:31 2022] DELETE /identity/v3/users/dea9af58b0134719bb151fe4ffbfc9d5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:31.841633 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ba4cf-0022-426d-a6b9-a4bb1773f5bf None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:31.842094 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ba4cf-0022-426d-a6b9-a4bb1773f5bf None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:31.842185 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ba4cf-0022-426d-a6b9-a4bb1773f5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:31.861821 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ad1ba4cf-0022-426d-a6b9-a4bb1773f5bf None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:31.863032 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ad1ba4cf-0022-426d-a6b9-a4bb1773f5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:31.923305 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1370/2741] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:31.934325 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e51660-0435-451c-b192-748787768ffc admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:31.935799 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-91e51660-0435-451c-b192-748787768ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:31.994450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e51660-0435-451c-b192-748787768ffc admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:31.998058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52e726-7d75-4a1a-bbd4-270c9051217f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:31.998657 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52e726-7d75-4a1a-bbd4-270c9051217f service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:31.998924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52e726-7d75-4a1a-bbd4-270c9051217f service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:31.999196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52e726-7d75-4a1a-bbd4-270c9051217f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:32.008439 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52e726-7d75-4a1a-bbd4-270c9051217f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:32.009878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52e726-7d75-4a1a-bbd4-270c9051217f service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:32.020300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1372/2742] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:32.504683 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ba4cf-0022-426d-a6b9-a4bb1773f5bf None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:32.515998 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ad1ba4cf-0022-426d-a6b9-a4bb1773f5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:32.522790 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ba4cf-0022-426d-a6b9-a4bb1773f5bf None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:32.527816 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:32.528444 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:32.529315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:32.529315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] PATH_INFO: `/v3/projects/97b96a54edb94c0b9bee3246df9cbf76` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:32.530296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b96a54edb94c0b9bee3246df9cbf76)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:32.532238 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:32.690611 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b96a54edb94c0b9bee3246df9cbf76', 'request_id': 'req-cc9626ae-68a8-4ab6-9d6b-24868ee05576'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:32.700734 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b96a54edb94c0b9bee3246df9cbf76', 'request_id': 'req-cc9626ae-68a8-4ab6-9d6b-24868ee05576'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:32.707193 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b96a54edb94c0b9bee3246df9cbf76', 'request_id': 'req-cc9626ae-68a8-4ab6-9d6b-24868ee05576'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:32.788321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] The token cache is being invalidate because project 97b96a54edb94c0b9bee3246df9cbf76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:32.788607 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:32.789265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:32.790735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1371/2743] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:32 2022] DELETE /identity/v3/projects/97b96a54edb94c0b9bee3246df9cbf76 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:32.794713 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52e726-7d75-4a1a-bbd4-270c9051217f service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:32.799561 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:32.805335 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52e726-7d75-4a1a-bbd4-270c9051217f service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:32.864249 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dac51d-0f6f-4c7a-a8bd-4c986712a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:32.865362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dac51d-0f6f-4c7a-a8bd-4c986712a7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:32.865661 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dac51d-0f6f-4c7a-a8bd-4c986712a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:32.865931 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dac51d-0f6f-4c7a-a8bd-4c986712a7a7 admin admin] PATH_INFO: `/v3/users/cb0bb78e7a3047d48528ce9f5512ca8d` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:32.867133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dac51d-0f6f-4c7a-a8bd-4c986712a7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0bb78e7a3047d48528ce9f5512ca8d)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:32.869172 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dac51d-0f6f-4c7a-a8bd-4c986712a7a7 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:33.085861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-37dac51d-0f6f-4c7a-a8bd-4c986712a7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0bb78e7a3047d48528ce9f5512ca8d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:33.157864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-37dac51d-0f6f-4c7a-a8bd-4c986712a7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0bb78e7a3047d48528ce9f5512ca8d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:33.158564 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-37dac51d-0f6f-4c7a-a8bd-4c986712a7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0bb78e7a3047d48528ce9f5512ca8d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:33.166754 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-37dac51d-0f6f-4c7a-a8bd-4c986712a7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0bb78e7a3047d48528ce9f5512ca8d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:33.179169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-37dac51d-0f6f-4c7a-a8bd-4c986712a7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0bb78e7a3047d48528ce9f5512ca8d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:33.186634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1373/2744] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:32 2022] DELETE /identity/v3/users/cb0bb78e7a3047d48528ce9f5512ca8d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:33.825161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:33.826577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:33.840066 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9626ae-68a8-4ab6-9d6b-24868ee05576 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:33.900736 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e98af-2afd-4ce9-a771-917bf27a5986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:33.901393 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e98af-2afd-4ce9-a771-917bf27a5986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:33.901674 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e98af-2afd-4ce9-a771-917bf27a5986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:33.901976 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e98af-2afd-4ce9-a771-917bf27a5986 admin admin] PATH_INFO: `/v3/projects/882326d8532b4c8fa7ccf56af80afbc2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:33.903085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e98af-2afd-4ce9-a771-917bf27a5986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882326d8532b4c8fa7ccf56af80afbc2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:33.904979 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e98af-2afd-4ce9-a771-917bf27a5986 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:33.913949 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:34.039893 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e22e98af-2afd-4ce9-a771-917bf27a5986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882326d8532b4c8fa7ccf56af80afbc2', 'request_id': 'req-e22e98af-2afd-4ce9-a771-917bf27a5986'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:34.046149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e22e98af-2afd-4ce9-a771-917bf27a5986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882326d8532b4c8fa7ccf56af80afbc2', 'request_id': 'req-e22e98af-2afd-4ce9-a771-917bf27a5986'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:34.052428 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e22e98af-2afd-4ce9-a771-917bf27a5986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882326d8532b4c8fa7ccf56af80afbc2', 'request_id': 'req-e22e98af-2afd-4ce9-a771-917bf27a5986'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:34.169374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e22e98af-2afd-4ce9-a771-917bf27a5986 admin admin] The token cache is being invalidate because project 882326d8532b4c8fa7ccf56af80afbc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:34.169882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e22e98af-2afd-4ce9-a771-917bf27a5986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:34.170573 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e22e98af-2afd-4ce9-a771-917bf27a5986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:34.172194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1372/2745] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:33 2022] DELETE /identity/v3/projects/882326d8532b4c8fa7ccf56af80afbc2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:34.177746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bcdc4-c510-42c4-b018-b9db641e5357 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:34.178246 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bcdc4-c510-42c4-b018-b9db641e5357 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:34.178360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bcdc4-c510-42c4-b018-b9db641e5357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:34.199617 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-102bcdc4-c510-42c4-b018-b9db641e5357 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:34.201422 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-102bcdc4-c510-42c4-b018-b9db641e5357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:34.276245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1374/2746] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:34.278052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0259eaa-3a85-4a06-8846-15e7918f2a9b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:34.278338 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0259eaa-3a85-4a06-8846-15e7918f2a9b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:34.278614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0259eaa-3a85-4a06-8846-15e7918f2a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:34.298765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d0259eaa-3a85-4a06-8846-15e7918f2a9b None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:34.299962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d0259eaa-3a85-4a06-8846-15e7918f2a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:34.308474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1373/2747] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:34.312720 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bcdc4-c510-42c4-b018-b9db641e5357 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:34.323542 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bcdc4-c510-42c4-b018-b9db641e5357 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:34.328615 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e216776-0f16-44f7-a2d5-818fb9c94322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:34.332463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e216776-0f16-44f7-a2d5-818fb9c94322 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:34.332463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e216776-0f16-44f7-a2d5-818fb9c94322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:34.332463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e216776-0f16-44f7-a2d5-818fb9c94322 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:34.332463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e216776-0f16-44f7-a2d5-818fb9c94322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:34.332463 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e216776-0f16-44f7-a2d5-818fb9c94322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:34.333674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e216776-0f16-44f7-a2d5-818fb9c94322 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:34.346351 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1375/2748] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:48:34.352257 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0259eaa-3a85-4a06-8846-15e7918f2a9b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:34.362113 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0259eaa-3a85-4a06-8846-15e7918f2a9b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:34.367309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f65b38-20c4-4749-868e-393472f47cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:34.367935 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f65b38-20c4-4749-868e-393472f47cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:34.368299 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f65b38-20c4-4749-868e-393472f47cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:34.368527 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f65b38-20c4-4749-868e-393472f47cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:34.369188 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f65b38-20c4-4749-868e-393472f47cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:34.371114 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f65b38-20c4-4749-868e-393472f47cd5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:34.481887 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1374/2749] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:34 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:34.486059 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e216776-0f16-44f7-a2d5-818fb9c94322 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:34.497258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e216776-0f16-44f7-a2d5-818fb9c94322 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:34.502837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:34.594908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724d353-d2e8-4b29-925f-5c17c0a70ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:34.595520 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724d353-d2e8-4b29-925f-5c17c0a70ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:34.596050 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724d353-d2e8-4b29-925f-5c17c0a70ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:34.596318 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724d353-d2e8-4b29-925f-5c17c0a70ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:34.596945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724d353-d2e8-4b29-925f-5c17c0a70ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:34.598936 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724d353-d2e8-4b29-925f-5c17c0a70ca8 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:34.686076 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1376/2750] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:34 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:34.689774 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f65b38-20c4-4749-868e-393472f47cd5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:34.700850 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f65b38-20c4-4749-868e-393472f47cd5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:34.705548 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed892b1c-87ba-423d-9696-ba7ec5005c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:34.706263 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892b1c-87ba-423d-9696-ba7ec5005c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:34.706751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892b1c-87ba-423d-9696-ba7ec5005c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:34.712014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892b1c-87ba-423d-9696-ba7ec5005c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:34.712014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed892b1c-87ba-423d-9696-ba7ec5005c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:34.712014 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed892b1c-87ba-423d-9696-ba7ec5005c8c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:34.719560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1375/2751] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:34.723858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724d353-d2e8-4b29-925f-5c17c0a70ca8 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:34.733934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724d353-d2e8-4b29-925f-5c17c0a70ca8 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:34.738691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee2fe2-bd5d-4bbe-94d6-76a72993ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:34.739808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee2fe2-bd5d-4bbe-94d6-76a72993ce3e admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:34.740190 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee2fe2-bd5d-4bbe-94d6-76a72993ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:34.740476 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee2fe2-bd5d-4bbe-94d6-76a72993ce3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:34.741165 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee2fe2-bd5d-4bbe-94d6-76a72993ce3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:34.742761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee2fe2-bd5d-4bbe-94d6-76a72993ce3e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:34.754003 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1377/2752] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:34.758757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed892b1c-87ba-423d-9696-ba7ec5005c8c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:34.768649 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed892b1c-87ba-423d-9696-ba7ec5005c8c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:34.773854 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6ccd1-d3f5-426b-a831-84b74ac79f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:34.774601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6ccd1-d3f5-426b-a831-84b74ac79f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:34.774941 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6ccd1-d3f5-426b-a831-84b74ac79f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:34.775286 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6ccd1-d3f5-426b-a831-84b74ac79f49 admin admin] PATH_INFO: `/v3/projects/47dbc4b9af0a45c3ae749fca02e012ee/users/4f69cdc9480e4aef9e2a8af32b9b52fd/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:34.791202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6ccd1-d3f5-426b-a831-84b74ac79f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47dbc4b9af0a45c3ae749fca02e012ee, user_id=4f69cdc9480e4aef9e2a8af32b9b52fd, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:34.793986 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6ccd1-d3f5-426b-a831-84b74ac79f49 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:34.880174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1376/2753] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:34 2022] PUT /identity/v3/projects/47dbc4b9af0a45c3ae749fca02e012ee/users/4f69cdc9480e4aef9e2a8af32b9b52fd/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:34.890343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8ed10-5a5c-4568-9129-b2063611c718 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:34.890644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8ed10-5a5c-4568-9129-b2063611c718 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:34.890927 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8ed10-5a5c-4568-9129-b2063611c718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:34.919594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-d0e8ed10-5a5c-4568-9129-b2063611c718 None None] MFA Rules not processed for user `4f69cdc9480e4aef9e2a8af32b9b52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:34.920813 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d0e8ed10-5a5c-4568-9129-b2063611c718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:34.988130 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1378/2754] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:34.993283 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6ccd1-d3f5-426b-a831-84b74ac79f49 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:35.063296 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6ccd1-d3f5-426b-a831-84b74ac79f49 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:35.068740 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022827d-caf6-418e-821a-d37965094f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:35.069369 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022827d-caf6-418e-821a-d37965094f03 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:35.069640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022827d-caf6-418e-821a-d37965094f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:35.069905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022827d-caf6-418e-821a-d37965094f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:35.070545 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022827d-caf6-418e-821a-d37965094f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:35.072423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022827d-caf6-418e-821a-d37965094f03 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:35.162688 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1377/2755] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:34 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:35.166270 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8ed10-5a5c-4568-9129-b2063611c718 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:35.178850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8ed10-5a5c-4568-9129-b2063611c718 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:35.251555 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf5e59-8d82-45e3-925c-9c36b097b815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:35.252545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf5e59-8d82-45e3-925c-9c36b097b815 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:35.252981 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf5e59-8d82-45e3-925c-9c36b097b815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:35.253281 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf5e59-8d82-45e3-925c-9c36b097b815 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:35.253920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf5e59-8d82-45e3-925c-9c36b097b815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:35.256924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf5e59-8d82-45e3-925c-9c36b097b815 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:35.343468 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1379/2756] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:35 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:35.348290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022827d-caf6-418e-821a-d37965094f03 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:35.361721 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022827d-caf6-418e-821a-d37965094f03 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:35.368518 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111c459-0ba1-4df6-8535-8aa93ee29ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:35.369185 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111c459-0ba1-4df6-8535-8aa93ee29ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:35.369612 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111c459-0ba1-4df6-8535-8aa93ee29ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:35.369947 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111c459-0ba1-4df6-8535-8aa93ee29ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:35.370551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111c459-0ba1-4df6-8535-8aa93ee29ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:35.382208 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111c459-0ba1-4df6-8535-8aa93ee29ae3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:35.394228 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1378/2757] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:35.398750 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf5e59-8d82-45e3-925c-9c36b097b815 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:35.414035 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf5e59-8d82-45e3-925c-9c36b097b815 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:35.416242 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569afb1-d96e-4a38-89c7-a2af60ab449f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:35.416242 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569afb1-d96e-4a38-89c7-a2af60ab449f admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:35.416486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569afb1-d96e-4a38-89c7-a2af60ab449f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:35.416762 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569afb1-d96e-4a38-89c7-a2af60ab449f admin admin] PATH_INFO: `/v3/projects/26749b71a0334962b4c3e30b6a88b365/users/5632d1c355ab45d191c59cbaade4c4ed/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:35.419299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:35.434524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569afb1-d96e-4a38-89c7-a2af60ab449f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26749b71a0334962b4c3e30b6a88b365, user_id=5632d1c355ab45d191c59cbaade4c4ed, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:35.439247 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569afb1-d96e-4a38-89c7-a2af60ab449f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:35.526479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1380/2758] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:35 2022] PUT /identity/v3/projects/26749b71a0334962b4c3e30b6a88b365/users/5632d1c355ab45d191c59cbaade4c4ed/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:35.530746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111c459-0ba1-4df6-8535-8aa93ee29ae3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:35.541643 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111c459-0ba1-4df6-8535-8aa93ee29ae3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:35.545352 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:35.603128 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff15251-38fc-4bc2-b2c9-80ef6f08c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:35.605345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15251-38fc-4bc2-b2c9-80ef6f08c9ce admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:35.605345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15251-38fc-4bc2-b2c9-80ef6f08c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:35.605345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15251-38fc-4bc2-b2c9-80ef6f08c9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:35.605345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff15251-38fc-4bc2-b2c9-80ef6f08c9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:35.606645 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff15251-38fc-4bc2-b2c9-80ef6f08c9ce admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:35.615953 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569afb1-d96e-4a38-89c7-a2af60ab449f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:35.617959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-3569afb1-d96e-4a38-89c7-a2af60ab449f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:35.621647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1379/2759] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:35.625378 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff15251-38fc-4bc2-b2c9-80ef6f08c9ce admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:35.640210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff15251-38fc-4bc2-b2c9-80ef6f08c9ce admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:35.640326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569afb1-d96e-4a38-89c7-a2af60ab449f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:35.641970 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de0577-afcc-4cbe-89c2-ac30ce3fd2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:35.642629 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0577-afcc-4cbe-89c2-ac30ce3fd2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:35.642907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0577-afcc-4cbe-89c2-ac30ce3fd2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:35.643181 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0577-afcc-4cbe-89c2-ac30ce3fd2ea admin admin] PATH_INFO: `/v3/projects/26749b71a0334962b4c3e30b6a88b365/users/5632d1c355ab45d191c59cbaade4c4ed/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:35.644552 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563a2fa-e9b2-4844-b9e7-780131214f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:35.645186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de0577-afcc-4cbe-89c2-ac30ce3fd2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=26749b71a0334962b4c3e30b6a88b365, user_id=5632d1c355ab45d191c59cbaade4c4ed, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:35.645294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563a2fa-e9b2-4844-b9e7-780131214f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:35.645522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563a2fa-e9b2-4844-b9e7-780131214f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:35.645733 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563a2fa-e9b2-4844-b9e7-780131214f90 admin admin] PATH_INFO: `/v3/users/d5ade0ca835d4e8d8bcec7e37097881b` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:35.646908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563a2fa-e9b2-4844-b9e7-780131214f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ade0ca835d4e8d8bcec7e37097881b)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:35.647844 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de0577-afcc-4cbe-89c2-ac30ce3fd2ea admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:35.648798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563a2fa-e9b2-4844-b9e7-780131214f90 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:35.659876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1380/2760] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:35 2022] PUT /identity/v3/projects/26749b71a0334962b4c3e30b6a88b365/users/5632d1c355ab45d191c59cbaade4c4ed/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:35.674158 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715ce5e-ec15-4cb9-9189-9a8a8f68a858 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:35.674158 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715ce5e-ec15-4cb9-9189-9a8a8f68a858 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:35.674158 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715ce5e-ec15-4cb9-9189-9a8a8f68a858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:35.699839 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2715ce5e-ec15-4cb9-9189-9a8a8f68a858 None None] MFA Rules not processed for user `5632d1c355ab45d191c59cbaade4c4ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:35.701080 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2715ce5e-ec15-4cb9-9189-9a8a8f68a858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:35.776521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1381/2761] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:35.787247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715ce5e-ec15-4cb9-9189-9a8a8f68a858 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:35.788653 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2715ce5e-ec15-4cb9-9189-9a8a8f68a858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:35.846122 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715ce5e-ec15-4cb9-9189-9a8a8f68a858 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:35.850325 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325fd75-4c69-4241-a06f-239a4cc37424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:35.851025 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325fd75-4c69-4241-a06f-239a4cc37424 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:35.851313 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325fd75-4c69-4241-a06f-239a4cc37424 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:35.851589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325fd75-4c69-4241-a06f-239a4cc37424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:35.861331 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325fd75-4c69-4241-a06f-239a4cc37424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:35.863147 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325fd75-4c69-4241-a06f-239a4cc37424 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:35.874744 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1382/2762] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:48:35.875390 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-b563a2fa-e9b2-4844-b9e7-780131214f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ade0ca835d4e8d8bcec7e37097881b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:35.958808 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-b563a2fa-e9b2-4844-b9e7-780131214f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ade0ca835d4e8d8bcec7e37097881b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:35.959537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-b563a2fa-e9b2-4844-b9e7-780131214f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ade0ca835d4e8d8bcec7e37097881b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:35.967768 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-b563a2fa-e9b2-4844-b9e7-780131214f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ade0ca835d4e8d8bcec7e37097881b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:35.992693 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-b563a2fa-e9b2-4844-b9e7-780131214f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ade0ca835d4e8d8bcec7e37097881b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:35.999635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1381/2763] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:35 2022] DELETE /identity/v3/users/d5ade0ca835d4e8d8bcec7e37097881b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:36.005469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb724bc-aff0-40e6-8903-0a37b63c0dd4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:36.005966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb724bc-aff0-40e6-8903-0a37b63c0dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:36.006068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb724bc-aff0-40e6-8903-0a37b63c0dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:36.026111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1bb724bc-aff0-40e6-8903-0a37b63c0dd4 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:36.027432 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1bb724bc-aff0-40e6-8903-0a37b63c0dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:36.080837 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:36.088164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1383/2764] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:36.098103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563a2fa-e9b2-4844-b9e7-780131214f90 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:36.100351 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b563a2fa-e9b2-4844-b9e7-780131214f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:36.157838 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563a2fa-e9b2-4844-b9e7-780131214f90 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:36.169902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996126ef-5a44-4733-abbe-9a5f951decf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:36.169902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996126ef-5a44-4733-abbe-9a5f951decf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:36.169902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996126ef-5a44-4733-abbe-9a5f951decf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:36.169902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996126ef-5a44-4733-abbe-9a5f951decf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:36.177496 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996126ef-5a44-4733-abbe-9a5f951decf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:36.178921 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996126ef-5a44-4733-abbe-9a5f951decf3 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:36.189026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1382/2765] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:36.641468 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb724bc-aff0-40e6-8903-0a37b63c0dd4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:36.642989 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1bb724bc-aff0-40e6-8903-0a37b63c0dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:36.656745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb724bc-aff0-40e6-8903-0a37b63c0dd4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:36.662446 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:36.667698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:36.667698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:36.667698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] PATH_INFO: `/v3/projects/cdcfe61da7284e9fa42435305553a8b1` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:36.667698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdcfe61da7284e9fa42435305553a8b1)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:36.667698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:36.771676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdcfe61da7284e9fa42435305553a8b1', 'request_id': 'req-eff22f36-83c9-4550-bf73-8791c6134cf1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:36.777804 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdcfe61da7284e9fa42435305553a8b1', 'request_id': 'req-eff22f36-83c9-4550-bf73-8791c6134cf1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:36.783274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdcfe61da7284e9fa42435305553a8b1', 'request_id': 'req-eff22f36-83c9-4550-bf73-8791c6134cf1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:36.845462 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] The token cache is being invalidate because project cdcfe61da7284e9fa42435305553a8b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:36.852722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:36.852722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:36.852722 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1384/2766] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:36 2022] DELETE /identity/v3/projects/cdcfe61da7284e9fa42435305553a8b1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:36.853909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996126ef-5a44-4733-abbe-9a5f951decf3 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:36.863904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996126ef-5a44-4733-abbe-9a5f951decf3 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:36.917352 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:36.923431 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9c333-5f19-494b-9474-6a0a98fe645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:36.924058 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c333-5f19-494b-9474-6a0a98fe645c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:36.924338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c333-5f19-494b-9474-6a0a98fe645c admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:36.924608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c333-5f19-494b-9474-6a0a98fe645c admin admin] PATH_INFO: `/v3/users/4a273431090a48008ca7c1074e25931b` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:36.925784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9c333-5f19-494b-9474-6a0a98fe645c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a273431090a48008ca7c1074e25931b)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:36.927871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9c333-5f19-494b-9474-6a0a98fe645c admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:37.120071 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-aff9c333-5f19-494b-9474-6a0a98fe645c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a273431090a48008ca7c1074e25931b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.158111 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:37.159513 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:37.172951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff22f36-83c9-4550-bf73-8791c6134cf1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:37.177642 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0989df5-2941-4e41-9416-3f83c278efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:37.178255 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0989df5-2941-4e41-9416-3f83c278efaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:37.178525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0989df5-2941-4e41-9416-3f83c278efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:37.178788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0989df5-2941-4e41-9416-3f83c278efaa admin admin] PATH_INFO: `/v3/users/4f69cdc9480e4aef9e2a8af32b9b52fd` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:37.179897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0989df5-2941-4e41-9416-3f83c278efaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f69cdc9480e4aef9e2a8af32b9b52fd)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:37.181829 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0989df5-2941-4e41-9416-3f83c278efaa admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:37.187760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-aff9c333-5f19-494b-9474-6a0a98fe645c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a273431090a48008ca7c1074e25931b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.188393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-aff9c333-5f19-494b-9474-6a0a98fe645c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a273431090a48008ca7c1074e25931b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.197403 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-aff9c333-5f19-494b-9474-6a0a98fe645c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a273431090a48008ca7c1074e25931b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.210132 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-aff9c333-5f19-494b-9474-6a0a98fe645c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a273431090a48008ca7c1074e25931b'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.216543 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1383/2767] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:36 2022] DELETE /identity/v3/users/4a273431090a48008ca7c1074e25931b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:37.401037 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a0989df5-2941-4e41-9416-3f83c278efaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f69cdc9480e4aef9e2a8af32b9b52fd'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.407835 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a0989df5-2941-4e41-9416-3f83c278efaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f69cdc9480e4aef9e2a8af32b9b52fd'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.421367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a0989df5-2941-4e41-9416-3f83c278efaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f69cdc9480e4aef9e2a8af32b9b52fd'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.503165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a0989df5-2941-4e41-9416-3f83c278efaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f69cdc9480e4aef9e2a8af32b9b52fd'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.503874 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a0989df5-2941-4e41-9416-3f83c278efaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f69cdc9480e4aef9e2a8af32b9b52fd'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.511166 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1385/2768] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:37 2022] DELETE /identity/v3/users/4f69cdc9480e4aef9e2a8af32b9b52fd => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:37.515711 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ecacd-b766-40e7-8b1a-16ee762dd480 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:37.516005 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ecacd-b766-40e7-8b1a-16ee762dd480 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:37.516313 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ecacd-b766-40e7-8b1a-16ee762dd480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:37.536539 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-864ecacd-b766-40e7-8b1a-16ee762dd480 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:37.537860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-864ecacd-b766-40e7-8b1a-16ee762dd480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:37.599937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1384/2769] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:37.609677 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0989df5-2941-4e41-9416-3f83c278efaa admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:37.611121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a0989df5-2941-4e41-9416-3f83c278efaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:37.627404 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:37.670178 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ecacd-b766-40e7-8b1a-16ee762dd480 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:37.675516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-864ecacd-b766-40e7-8b1a-16ee762dd480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:37.685787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ecacd-b766-40e7-8b1a-16ee762dd480 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:37.691869 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0989df5-2941-4e41-9416-3f83c278efaa admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:37.692224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e117346-da11-4293-8afe-830b927534f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:37.692860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e117346-da11-4293-8afe-830b927534f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:37.694054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e117346-da11-4293-8afe-830b927534f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:37.694322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e117346-da11-4293-8afe-830b927534f6 admin admin] PATH_INFO: `/v3/projects/ba5dc83cdd7e43c28b78cc07ff674605` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:37.695500 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e117346-da11-4293-8afe-830b927534f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5dc83cdd7e43c28b78cc07ff674605)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:37.697590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e117346-da11-4293-8afe-830b927534f6 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:37.697825 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f47124-506d-4daa-b2e0-f159d2ef9c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:37.698446 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f47124-506d-4daa-b2e0-f159d2ef9c1f service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:37.698922 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f47124-506d-4daa-b2e0-f159d2ef9c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:37.699203 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f47124-506d-4daa-b2e0-f159d2ef9c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:37.709825 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f47124-506d-4daa-b2e0-f159d2ef9c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:37.711861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f47124-506d-4daa-b2e0-f159d2ef9c1f service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:37.724529 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1386/2770] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:48:37.826547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7e117346-da11-4293-8afe-830b927534f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5dc83cdd7e43c28b78cc07ff674605', 'request_id': 'req-7e117346-da11-4293-8afe-830b927534f6'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.834264 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7e117346-da11-4293-8afe-830b927534f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5dc83cdd7e43c28b78cc07ff674605', 'request_id': 'req-7e117346-da11-4293-8afe-830b927534f6'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.952508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7e117346-da11-4293-8afe-830b927534f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5dc83cdd7e43c28b78cc07ff674605', 'request_id': 'req-7e117346-da11-4293-8afe-830b927534f6'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.960495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:37.964888 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7e117346-da11-4293-8afe-830b927534f6 admin admin] The token cache is being invalidate because project ba5dc83cdd7e43c28b78cc07ff674605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:37.965217 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7e117346-da11-4293-8afe-830b927534f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.965904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-7e117346-da11-4293-8afe-830b927534f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:37.967598 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1385/2771] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:37 2022] DELETE /identity/v3/projects/ba5dc83cdd7e43c28b78cc07ff674605 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:37.972637 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6b720-47b8-42a4-9714-924349bef95d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:37.973387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6b720-47b8-42a4-9714-924349bef95d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:37.973387 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6b720-47b8-42a4-9714-924349bef95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:37.994510 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-97f6b720-47b8-42a4-9714-924349bef95d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:37.995718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-97f6b720-47b8-42a4-9714-924349bef95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:38.068157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1387/2772] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:38.076212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88961dff-5239-4c99-8fe8-251fe4677f95 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:38.076499 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88961dff-5239-4c99-8fe8-251fe4677f95 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:38.076772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88961dff-5239-4c99-8fe8-251fe4677f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:38.097345 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-88961dff-5239-4c99-8fe8-251fe4677f95 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:38.098541 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-88961dff-5239-4c99-8fe8-251fe4677f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:38.107538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1386/2773] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:38.112010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6b720-47b8-42a4-9714-924349bef95d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:38.122498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6b720-47b8-42a4-9714-924349bef95d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:38.127309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe70cb-ec94-4fb3-9c6d-54335eb25453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:38.127906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe70cb-ec94-4fb3-9c6d-54335eb25453 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:38.128177 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe70cb-ec94-4fb3-9c6d-54335eb25453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:38.128445 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe70cb-ec94-4fb3-9c6d-54335eb25453 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:38.129116 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe70cb-ec94-4fb3-9c6d-54335eb25453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:38.129415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe70cb-ec94-4fb3-9c6d-54335eb25453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:38.131194 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe70cb-ec94-4fb3-9c6d-54335eb25453 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:38.142676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1388/2774] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:48:38.147630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88961dff-5239-4c99-8fe8-251fe4677f95 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:38.163772 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88961dff-5239-4c99-8fe8-251fe4677f95 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:38.168509 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb236d-67c3-42dd-b4d1-0b3ecbfc5f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:38.169280 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb236d-67c3-42dd-b4d1-0b3ecbfc5f4e admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:38.169566 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb236d-67c3-42dd-b4d1-0b3ecbfc5f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:38.169839 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb236d-67c3-42dd-b4d1-0b3ecbfc5f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:38.170500 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb236d-67c3-42dd-b4d1-0b3ecbfc5f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:38.172393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb236d-67c3-42dd-b4d1-0b3ecbfc5f4e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:38.218761 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe70cb-ec94-4fb3-9c6d-54335eb25453 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:38.220573 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7abe70cb-ec94-4fb3-9c6d-54335eb25453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:38.236964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe70cb-ec94-4fb3-9c6d-54335eb25453 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:38.242133 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:38.248027 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:38.248027 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:38.248027 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] PATH_INFO: `/v3/projects/47dbc4b9af0a45c3ae749fca02e012ee` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:38.248027 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47dbc4b9af0a45c3ae749fca02e012ee)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:38.248027 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:38.305473 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1387/2775] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:38 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:38.309689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb236d-67c3-42dd-b4d1-0b3ecbfc5f4e admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:38.374190 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb236d-67c3-42dd-b4d1-0b3ecbfc5f4e admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:38.378917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc2696-33c0-4f23-93aa-257b4ca45616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:38.379513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc2696-33c0-4f23-93aa-257b4ca45616 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:38.379787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc2696-33c0-4f23-93aa-257b4ca45616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:38.380052 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc2696-33c0-4f23-93aa-257b4ca45616 admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:38.380758 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc2696-33c0-4f23-93aa-257b4ca45616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:38.382910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc2696-33c0-4f23-93aa-257b4ca45616 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:38.401189 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47dbc4b9af0a45c3ae749fca02e012ee', 'request_id': 'req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:38.407830 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47dbc4b9af0a45c3ae749fca02e012ee', 'request_id': 'req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:38.414386 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47dbc4b9af0a45c3ae749fca02e012ee', 'request_id': 'req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:38.492244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1388/2776] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:38 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:38.496563 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc2696-33c0-4f23-93aa-257b4ca45616 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:38.502368 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] The token cache is being invalidate because project 47dbc4b9af0a45c3ae749fca02e012ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:38.502664 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:38.503308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:38.504876 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1389/2777] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:38 2022] DELETE /identity/v3/projects/47dbc4b9af0a45c3ae749fca02e012ee => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:38.506805 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc2696-33c0-4f23-93aa-257b4ca45616 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:38.508581 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:38.509882 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:38.542418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:38.569917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3878aaa-3a11-48d9-8eec-6bb9922014b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:38.570519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3878aaa-3a11-48d9-8eec-6bb9922014b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:38.570793 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3878aaa-3a11-48d9-8eec-6bb9922014b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:38.571064 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3878aaa-3a11-48d9-8eec-6bb9922014b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:38.571706 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3878aaa-3a11-48d9-8eec-6bb9922014b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:38.573364 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3878aaa-3a11-48d9-8eec-6bb9922014b0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:38.578510 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52f25f-49a0-4ed1-b711-f0d94ebdffb8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:38.583125 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd7fe7-2a6f-47ea-bce3-1028db9aad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:38.583329 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1389/2778] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:38.587276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7fe7-2a6f-47ea-bce3-1028db9aad03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:38.587276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7fe7-2a6f-47ea-bce3-1028db9aad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:38.587276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7fe7-2a6f-47ea-bce3-1028db9aad03 admin admin] PATH_INFO: `/v3/users/5632d1c355ab45d191c59cbaade4c4ed` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:38.587276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd7fe7-2a6f-47ea-bce3-1028db9aad03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5632d1c355ab45d191c59cbaade4c4ed)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:38.588065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3878aaa-3a11-48d9-8eec-6bb9922014b0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:38.588604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd7fe7-2a6f-47ea-bce3-1028db9aad03 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:38.589758 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-b3878aaa-3a11-48d9-8eec-6bb9922014b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:38.603697 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3878aaa-3a11-48d9-8eec-6bb9922014b0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:38.608662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a7577-a5fc-4b77-b423-a26f01c06823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:38.609338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a7577-a5fc-4b77-b423-a26f01c06823 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:38.609771 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a7577-a5fc-4b77-b423-a26f01c06823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:38.610032 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a7577-a5fc-4b77-b423-a26f01c06823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:38.611330 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a7577-a5fc-4b77-b423-a26f01c06823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:38.613106 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a7577-a5fc-4b77-b423-a26f01c06823 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:38.624363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1390/2779] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:38.628560 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a7577-a5fc-4b77-b423-a26f01c06823 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:38.638996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a7577-a5fc-4b77-b423-a26f01c06823 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:38.643754 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e7b16-362d-445e-88b9-4a51a1c1ffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:38.644410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7b16-362d-445e-88b9-4a51a1c1ffbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:38.644690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7b16-362d-445e-88b9-4a51a1c1ffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:38.644961 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7b16-362d-445e-88b9-4a51a1c1ffbc admin admin] PATH_INFO: `/v3/projects/265a641e65284a98abf8be7eb09e3afd/users/88bcce5ebdc7403a89a84893cced59a7/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:38.659472 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e7b16-362d-445e-88b9-4a51a1c1ffbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=265a641e65284a98abf8be7eb09e3afd, user_id=88bcce5ebdc7403a89a84893cced59a7, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:38.662168 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e7b16-362d-445e-88b9-4a51a1c1ffbc admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:38.788376 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1391/2780] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:38 2022] PUT /identity/v3/projects/265a641e65284a98abf8be7eb09e3afd/users/88bcce5ebdc7403a89a84893cced59a7/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:38.799664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bf29b-3e0c-4ad1-88ec-487070dfaca6 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:38.799946 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bf29b-3e0c-4ad1-88ec-487070dfaca6 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:38.800215 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bf29b-3e0c-4ad1-88ec-487070dfaca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:38.826289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b5bd7fe7-2a6f-47ea-bce3-1028db9aad03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5632d1c355ab45d191c59cbaade4c4ed'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:38.827825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-1c1bf29b-3e0c-4ad1-88ec-487070dfaca6 None None] MFA Rules not processed for user `88bcce5ebdc7403a89a84893cced59a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:38.830572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1c1bf29b-3e0c-4ad1-88ec-487070dfaca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:38.834591 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b5bd7fe7-2a6f-47ea-bce3-1028db9aad03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5632d1c355ab45d191c59cbaade4c4ed'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:38.841217 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:38.849782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b5bd7fe7-2a6f-47ea-bce3-1028db9aad03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5632d1c355ab45d191c59cbaade4c4ed'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:38.904395 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1392/2781] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:38.907523 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bf29b-3e0c-4ad1-88ec-487070dfaca6 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:38.923912 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b5bd7fe7-2a6f-47ea-bce3-1028db9aad03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5632d1c355ab45d191c59cbaade4c4ed'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:38.924944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b5bd7fe7-2a6f-47ea-bce3-1028db9aad03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5632d1c355ab45d191c59cbaade4c4ed'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:38.932673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1390/2782] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:38 2022] DELETE /identity/v3/users/5632d1c355ab45d191c59cbaade4c4ed => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:38.978533 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bf29b-3e0c-4ad1-88ec-487070dfaca6 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:39.044084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffd65c-ec71-4d4f-a410-50b7e30890c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:39.044630 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd65c-ec71-4d4f-a410-50b7e30890c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:39.044908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd65c-ec71-4d4f-a410-50b7e30890c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:39.045208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd65c-ec71-4d4f-a410-50b7e30890c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:39.045849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffd65c-ec71-4d4f-a410-50b7e30890c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:39.047746 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffd65c-ec71-4d4f-a410-50b7e30890c8 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:39.142566 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1393/2783] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:38 2022] POST /identity/v3/projects => generated 375 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:39.147298 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd7fe7-2a6f-47ea-bce3-1028db9aad03 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:39.148859 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b5bd7fe7-2a6f-47ea-bce3-1028db9aad03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:39.173085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd7fe7-2a6f-47ea-bce3-1028db9aad03 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:39.234909 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130a119-06a4-4366-bd4a-e547b5fef452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:39.235549 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130a119-06a4-4366-bd4a-e547b5fef452 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:39.235782 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130a119-06a4-4366-bd4a-e547b5fef452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:39.236050 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130a119-06a4-4366-bd4a-e547b5fef452 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:39.236679 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130a119-06a4-4366-bd4a-e547b5fef452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:39.238718 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130a119-06a4-4366-bd4a-e547b5fef452 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:39.354586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1391/2784] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:39 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:39.358664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffd65c-ec71-4d4f-a410-50b7e30890c8 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:39.368790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffd65c-ec71-4d4f-a410-50b7e30890c8 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:39.373516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350d86e-dee6-4466-b0d2-0cc14d853fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:39.374112 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d86e-dee6-4466-b0d2-0cc14d853fcd admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:39.374388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d86e-dee6-4466-b0d2-0cc14d853fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:39.374660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d86e-dee6-4466-b0d2-0cc14d853fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:39.375293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350d86e-dee6-4466-b0d2-0cc14d853fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:39.376942 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350d86e-dee6-4466-b0d2-0cc14d853fcd admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:39.385984 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130a119-06a4-4366-bd4a-e547b5fef452 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:39.387783 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6130a119-06a4-4366-bd4a-e547b5fef452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:39.391062 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1394/2785] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:39.396104 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350d86e-dee6-4466-b0d2-0cc14d853fcd admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:39.403741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130a119-06a4-4366-bd4a-e547b5fef452 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:39.406285 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:39.406989 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:39.407364 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:39.407701 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505 admin admin] PATH_INFO: `/v3/projects/26749b71a0334962b4c3e30b6a88b365` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:39.408895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26749b71a0334962b4c3e30b6a88b365)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:39.410897 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:39.419787 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350d86e-dee6-4466-b0d2-0cc14d853fcd admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:39.424541 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77cb0f-8562-440f-8444-c2e610f9472f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:39.425224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77cb0f-8562-440f-8444-c2e610f9472f admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:39.425996 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77cb0f-8562-440f-8444-c2e610f9472f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:39.426295 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77cb0f-8562-440f-8444-c2e610f9472f admin admin] PATH_INFO: `/v3/projects/32c47d90a6044c7f977086c54840e2b0/users/d8c00cbdaef94e75b12add848b1b442b/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:39.444510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77cb0f-8562-440f-8444-c2e610f9472f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c47d90a6044c7f977086c54840e2b0, user_id=d8c00cbdaef94e75b12add848b1b442b, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:39.447267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77cb0f-8562-440f-8444-c2e610f9472f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:39.599913 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:39.605208 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1395/2786] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:39 2022] PUT /identity/v3/projects/32c47d90a6044c7f977086c54840e2b0/users/d8c00cbdaef94e75b12add848b1b442b/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:39.609267 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77cb0f-8562-440f-8444-c2e610f9472f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:39.612848 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26749b71a0334962b4c3e30b6a88b365', 'request_id': 'req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:39.619918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26749b71a0334962b4c3e30b6a88b365', 'request_id': 'req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:39.620899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:39.626502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26749b71a0334962b4c3e30b6a88b365', 'request_id': 'req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:39.673342 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77cb0f-8562-440f-8444-c2e610f9472f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:39.728860 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9fe9d-da89-4627-9817-71167061a183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:39.729500 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9fe9d-da89-4627-9817-71167061a183 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:39.729817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9fe9d-da89-4627-9817-71167061a183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:39.730082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9fe9d-da89-4627-9817-71167061a183 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:39.730725 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9fe9d-da89-4627-9817-71167061a183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:39.732434 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9fe9d-da89-4627-9817-71167061a183 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:39.737324 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505 admin admin] The token cache is being invalidate because project 26749b71a0334962b4c3e30b6a88b365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:39.737801 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:39.738477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6f7a852-8ccc-4518-9c11-d34ac2f5c505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:39.741124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1392/2787] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:39 2022] DELETE /identity/v3/projects/26749b71a0334962b4c3e30b6a88b365 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:39.746780 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1396/2788] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:39.746936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fccc87-7793-4c1a-a1d0-784bdb5f3e26 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:39.746936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fccc87-7793-4c1a-a1d0-784bdb5f3e26 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:39.747280 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fccc87-7793-4c1a-a1d0-784bdb5f3e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:39.749779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9fe9d-da89-4627-9817-71167061a183 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:39.751581 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-4ce9fe9d-da89-4627-9817-71167061a183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:39.765248 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9fe9d-da89-4627-9817-71167061a183 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:39.769309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-57fccc87-7793-4c1a-a1d0-784bdb5f3e26 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:39.770595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-57fccc87-7793-4c1a-a1d0-784bdb5f3e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:39.770950 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95224a-22a0-44f6-8634-d6fe4e567c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:39.771866 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95224a-22a0-44f6-8634-d6fe4e567c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:39.772151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95224a-22a0-44f6-8634-d6fe4e567c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:39.772457 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95224a-22a0-44f6-8634-d6fe4e567c84 admin admin] PATH_INFO: `/v3/projects/32c47d90a6044c7f977086c54840e2b0/users/d8c00cbdaef94e75b12add848b1b442b/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:39.774521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95224a-22a0-44f6-8634-d6fe4e567c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c47d90a6044c7f977086c54840e2b0, user_id=d8c00cbdaef94e75b12add848b1b442b, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:39.777199 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95224a-22a0-44f6-8634-d6fe4e567c84 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:39.778574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1393/2789] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:39.787740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1397/2790] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:39 2022] PUT /identity/v3/projects/32c47d90a6044c7f977086c54840e2b0/users/d8c00cbdaef94e75b12add848b1b442b/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:39.798511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490e21d-92c7-4f1b-928e-88a79d7fcff9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:39.804060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490e21d-92c7-4f1b-928e-88a79d7fcff9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:39.804060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490e21d-92c7-4f1b-928e-88a79d7fcff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:39.831163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f490e21d-92c7-4f1b-928e-88a79d7fcff9 None None] MFA Rules not processed for user `d8c00cbdaef94e75b12add848b1b442b`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:39.832417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f490e21d-92c7-4f1b-928e-88a79d7fcff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:39.844914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e95dd8-5825-4ccf-b96d-c1aefa6eac70 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:39.849862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e95dd8-5825-4ccf-b96d-c1aefa6eac70 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:39.849862 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e95dd8-5825-4ccf-b96d-c1aefa6eac70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:39.866147 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-d9e95dd8-5825-4ccf-b96d-c1aefa6eac70 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:39.867366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d9e95dd8-5825-4ccf-b96d-c1aefa6eac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:39.906402 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1394/2791] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:39.919493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490e21d-92c7-4f1b-928e-88a79d7fcff9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:39.920858 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f490e21d-92c7-4f1b-928e-88a79d7fcff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:39.937408 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1398/2792] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:39.941722 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e95dd8-5825-4ccf-b96d-c1aefa6eac70 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:39.951809 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e95dd8-5825-4ccf-b96d-c1aefa6eac70 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:39.961544 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15354b97-171c-43f2-afee-0a9986ae1b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:39.961544 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15354b97-171c-43f2-afee-0a9986ae1b27 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:39.961544 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15354b97-171c-43f2-afee-0a9986ae1b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:39.961544 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15354b97-171c-43f2-afee-0a9986ae1b27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:39.961893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15354b97-171c-43f2-afee-0a9986ae1b27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:39.961893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15354b97-171c-43f2-afee-0a9986ae1b27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:39.962055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15354b97-171c-43f2-afee-0a9986ae1b27 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:39.975806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1399/2793] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:48:39.979879 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15354b97-171c-43f2-afee-0a9986ae1b27 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:39.985264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490e21d-92c7-4f1b-928e-88a79d7fcff9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:39.990466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15354b97-171c-43f2-afee-0a9986ae1b27 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:39.990831 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b133e-4f00-4c16-be85-ed586a61b2e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:39.991900 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b133e-4f00-4c16-be85-ed586a61b2e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:39.992172 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b133e-4f00-4c16-be85-ed586a61b2e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:39.992498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b133e-4f00-4c16-be85-ed586a61b2e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:39.995730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f9691-4e54-4a82-822f-afd3ff830ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:39.996356 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f9691-4e54-4a82-822f-afd3ff830ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:39.996664 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f9691-4e54-4a82-822f-afd3ff830ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:39.996938 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f9691-4e54-4a82-822f-afd3ff830ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:39.997602 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f9691-4e54-4a82-822f-afd3ff830ad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:39.999834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f9691-4e54-4a82-822f-afd3ff830ad1 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:40.004449 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b133e-4f00-4c16-be85-ed586a61b2e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:40.006367 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b133e-4f00-4c16-be85-ed586a61b2e1 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:40.019982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1395/2794] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:48:40.138363 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1400/2795] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:39 2022] POST /identity/v3/projects => generated 365 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:40.139216 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b133e-4f00-4c16-be85-ed586a61b2e1 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:40.151579 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b133e-4f00-4c16-be85-ed586a61b2e1 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:40.202005 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:40.223994 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51950b8f-d6ce-4800-9eab-c8d8c46d1c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:40.225261 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51950b8f-d6ce-4800-9eab-c8d8c46d1c09 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:40.225604 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51950b8f-d6ce-4800-9eab-c8d8c46d1c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:40.225879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51950b8f-d6ce-4800-9eab-c8d8c46d1c09 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:40.226517 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51950b8f-d6ce-4800-9eab-c8d8c46d1c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:40.228500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51950b8f-d6ce-4800-9eab-c8d8c46d1c09 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:40.325487 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1396/2796] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:40 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:40.329792 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f9691-4e54-4a82-822f-afd3ff830ad1 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:40.337395 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:40.341212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f9691-4e54-4a82-822f-afd3ff830ad1 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:40.346308 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4155686-f79e-4647-8fe5-ab53f382923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:40.346999 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4155686-f79e-4647-8fe5-ab53f382923b admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:40.347278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4155686-f79e-4647-8fe5-ab53f382923b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:40.347547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4155686-f79e-4647-8fe5-ab53f382923b admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:40.348189 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4155686-f79e-4647-8fe5-ab53f382923b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:40.350002 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4155686-f79e-4647-8fe5-ab53f382923b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:40.360130 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1401/2797] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:40.364269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51950b8f-d6ce-4800-9eab-c8d8c46d1c09 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:40.374914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51950b8f-d6ce-4800-9eab-c8d8c46d1c09 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:40.380157 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10444e-d19d-449a-a68d-0cfd8312912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:40.381244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10444e-d19d-449a-a68d-0cfd8312912c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:40.381523 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10444e-d19d-449a-a68d-0cfd8312912c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:40.381911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10444e-d19d-449a-a68d-0cfd8312912c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:40.382589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10444e-d19d-449a-a68d-0cfd8312912c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:40.384185 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10444e-d19d-449a-a68d-0cfd8312912c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:40.394528 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1397/2798] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:40.399955 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4155686-f79e-4647-8fe5-ab53f382923b admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:40.410519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4155686-f79e-4647-8fe5-ab53f382923b admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:40.415796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e15024-89ca-4f7e-91f4-216d035cc990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:40.416510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e15024-89ca-4f7e-91f4-216d035cc990 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:40.424672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e15024-89ca-4f7e-91f4-216d035cc990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:40.424672 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e15024-89ca-4f7e-91f4-216d035cc990 admin admin] PATH_INFO: `/v3/projects/4642efecb548414ba7632bfa8a4e765c/users/3d66645c66454584b52fde16dac98594/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:40.433287 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e15024-89ca-4f7e-91f4-216d035cc990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4642efecb548414ba7632bfa8a4e765c, user_id=3d66645c66454584b52fde16dac98594, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:40.436061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e15024-89ca-4f7e-91f4-216d035cc990 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:40.543220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1402/2799] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:40 2022] PUT /identity/v3/projects/4642efecb548414ba7632bfa8a4e765c/users/3d66645c66454584b52fde16dac98594/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:40.554200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74560699-866b-4279-8cec-ec1ff58a38c6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:40.554488 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74560699-866b-4279-8cec-ec1ff58a38c6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:40.554764 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74560699-866b-4279-8cec-ec1ff58a38c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:40.584771 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-74560699-866b-4279-8cec-ec1ff58a38c6 None None] MFA Rules not processed for user `3d66645c66454584b52fde16dac98594`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:40.586017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-74560699-866b-4279-8cec-ec1ff58a38c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:40.654563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1398/2800] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:40.666159 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e15024-89ca-4f7e-91f4-216d035cc990 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:40.667920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-93e15024-89ca-4f7e-91f4-216d035cc990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:40.724864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e15024-89ca-4f7e-91f4-216d035cc990 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:40.728476 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc868932-eab6-4851-be1a-6db3626420cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ba9aba795f423a8ffabe419b64507a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:40.729110 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc868932-eab6-4851-be1a-6db3626420cb service glance] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:40.729388 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc868932-eab6-4851-be1a-6db3626420cb service glance] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:40.729662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc868932-eab6-4851-be1a-6db3626420cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:40.737850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc868932-eab6-4851-be1a-6db3626420cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:40.739262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc868932-eab6-4851-be1a-6db3626420cb service glance] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:40.748729 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1403/2801] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:41.236551 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74560699-866b-4279-8cec-ec1ff58a38c6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:41.316510 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74560699-866b-4279-8cec-ec1ff58a38c6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:41.321324 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c817b3-0785-4882-8d95-fa28601eecb1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c00cbdaef94e75b12add848b1b442b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32c47d90a6044c7f977086c54840e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:41.321927 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c817b3-0785-4882-8d95-fa28601eecb1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:41.322202 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c817b3-0785-4882-8d95-fa28601eecb1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:41.322468 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c817b3-0785-4882-8d95-fa28601eecb1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:41.323115 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c817b3-0785-4882-8d95-fa28601eecb1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:41.323438 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c817b3-0785-4882-8d95-fa28601eecb1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:41.325415 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c817b3-0785-4882-8d95-fa28601eecb1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:41.341289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1399/2802] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:48:41.348861 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc868932-eab6-4851-be1a-6db3626420cb service glance] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:41.354500 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc868932-eab6-4851-be1a-6db3626420cb service glance] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:41.359101 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710f368-848a-479f-ad42-5fe6f4e1a08c tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c00cbdaef94e75b12add848b1b442b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32c47d90a6044c7f977086c54840e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:41.359693 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710f368-848a-479f-ad42-5fe6f4e1a08c tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:41.359969 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710f368-848a-479f-ad42-5fe6f4e1a08c tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:41.360240 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710f368-848a-479f-ad42-5fe6f4e1a08c tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:41.361055 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710f368-848a-479f-ad42-5fe6f4e1a08c tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:41.362914 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710f368-848a-479f-ad42-5fe6f4e1a08c tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:41.514427 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1404/2803] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:41 2022] POST /identity/v3/projects => generated 352 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:41.518673 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c817b3-0785-4882-8d95-fa28601eecb1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:41.529044 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c817b3-0785-4882-8d95-fa28601eecb1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:41.570800 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:41.594344 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c391d6-216a-45b1-ba86-966152ce30ba tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c00cbdaef94e75b12add848b1b442b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32c47d90a6044c7f977086c54840e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:41.594960 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c391d6-216a-45b1-ba86-966152ce30ba tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:41.595289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c391d6-216a-45b1-ba86-966152ce30ba tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:41.595566 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c391d6-216a-45b1-ba86-966152ce30ba tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:41.596498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c391d6-216a-45b1-ba86-966152ce30ba tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:41.596917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c391d6-216a-45b1-ba86-966152ce30ba tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:41.602246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c391d6-216a-45b1-ba86-966152ce30ba tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:41.612150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1400/2804] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:48:41.667153 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710f368-848a-479f-ad42-5fe6f4e1a08c tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:41.677619 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710f368-848a-479f-ad42-5fe6f4e1a08c tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:41.682406 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c00cbdaef94e75b12add848b1b442b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32c47d90a6044c7f977086c54840e2b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:41.683039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:41.683322 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:41.683594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] PATH_INFO: `/v3/projects/1eebc432a62847a9b2aee3756a522eb5` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:41.684850 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1eebc432a62847a9b2aee3756a522eb5)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:41.687040 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:41.816656 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eebc432a62847a9b2aee3756a522eb5', 'request_id': 'req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:41.824609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eebc432a62847a9b2aee3756a522eb5', 'request_id': 'req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:41.908877 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eebc432a62847a9b2aee3756a522eb5', 'request_id': 'req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:41.920857 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] The token cache is being invalidate because project 1eebc432a62847a9b2aee3756a522eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:41.921066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:41.921682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4ce2a46e-a3b3-4647-97be-e7b41d950ab1 tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:41.923150 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1405/2805] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:41 2022] DELETE /identity/v3/projects/1eebc432a62847a9b2aee3756a522eb5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:42.595169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c391d6-216a-45b1-ba86-966152ce30ba tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:42.597277 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c9c391d6-216a-45b1-ba86-966152ce30ba tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:42.680665 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c391d6-216a-45b1-ba86-966152ce30ba tempest-VolumeQuotaClassesTest-8944350 tempest-VolumeQuotaClassesTest-8944350-project-admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:42.761298 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb547c33-fe38-43cd-96fb-3615de36e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:42.762009 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb547c33-fe38-43cd-96fb-3615de36e591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:42.762411 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb547c33-fe38-43cd-96fb-3615de36e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:42.762713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb547c33-fe38-43cd-96fb-3615de36e591 admin admin] PATH_INFO: `/v3/users/88bcce5ebdc7403a89a84893cced59a7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:42.764010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb547c33-fe38-43cd-96fb-3615de36e591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88bcce5ebdc7403a89a84893cced59a7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:42.766290 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb547c33-fe38-43cd-96fb-3615de36e591 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:43.328884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb547c33-fe38-43cd-96fb-3615de36e591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88bcce5ebdc7403a89a84893cced59a7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:43.336521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb547c33-fe38-43cd-96fb-3615de36e591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88bcce5ebdc7403a89a84893cced59a7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:43.348498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb547c33-fe38-43cd-96fb-3615de36e591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88bcce5ebdc7403a89a84893cced59a7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:43.451832 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb547c33-fe38-43cd-96fb-3615de36e591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88bcce5ebdc7403a89a84893cced59a7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:43.452493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb547c33-fe38-43cd-96fb-3615de36e591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88bcce5ebdc7403a89a84893cced59a7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:43.459333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1401/2806] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:42 2022] DELETE /identity/v3/users/88bcce5ebdc7403a89a84893cced59a7 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:43.464676 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bc988-b4e4-4ba6-bac5-85caca3113bf None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:43.465274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bc988-b4e4-4ba6-bac5-85caca3113bf None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:43.465734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bc988-b4e4-4ba6-bac5-85caca3113bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:43.487668 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-296bc988-b4e4-4ba6-bac5-85caca3113bf None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:43.488934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-296bc988-b4e4-4ba6-bac5-85caca3113bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:43.519578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:43.557755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1406/2807] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:43.568330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb547c33-fe38-43cd-96fb-3615de36e591 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:43.570875 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eb547c33-fe38-43cd-96fb-3615de36e591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:43.576162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:43.628428 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb547c33-fe38-43cd-96fb-3615de36e591 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:43.632906 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e5996-a392-449e-b36a-892ecd8f20c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:43.633554 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e5996-a392-449e-b36a-892ecd8f20c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:43.633833 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e5996-a392-449e-b36a-892ecd8f20c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:43.634104 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e5996-a392-449e-b36a-892ecd8f20c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:43.643034 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e5996-a392-449e-b36a-892ecd8f20c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:43.644476 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e5996-a392-449e-b36a-892ecd8f20c9 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:43.655164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1402/2808] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:44.076228 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bc988-b4e4-4ba6-bac5-85caca3113bf None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:44.078384 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-296bc988-b4e4-4ba6-bac5-85caca3113bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:44.090918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bc988-b4e4-4ba6-bac5-85caca3113bf None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:44.095655 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:44.096813 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:44.097262 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:44.097689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] PATH_INFO: `/v3/projects/265a641e65284a98abf8be7eb09e3afd` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:44.099048 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=265a641e65284a98abf8be7eb09e3afd)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:44.102298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:44.209236 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '265a641e65284a98abf8be7eb09e3afd', 'request_id': 'req-d57f38ca-3eb5-4739-8710-1d228fec9432'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:44.216451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '265a641e65284a98abf8be7eb09e3afd', 'request_id': 'req-d57f38ca-3eb5-4739-8710-1d228fec9432'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:44.291704 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '265a641e65284a98abf8be7eb09e3afd', 'request_id': 'req-d57f38ca-3eb5-4739-8710-1d228fec9432'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:44.302969 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] The token cache is being invalidate because project 265a641e65284a98abf8be7eb09e3afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:44.303253 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:44.304051 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:44.305562 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1407/2809] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:44 2022] DELETE /identity/v3/projects/265a641e65284a98abf8be7eb09e3afd => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:44.309752 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e5996-a392-449e-b36a-892ecd8f20c9 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:44.319389 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e5996-a392-449e-b36a-892ecd8f20c9 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:44.377321 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a29573-387f-4d3f-8ba1-d16ffb8cc321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:44.377953 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a29573-387f-4d3f-8ba1-d16ffb8cc321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:44.378233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a29573-387f-4d3f-8ba1-d16ffb8cc321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:44.378568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a29573-387f-4d3f-8ba1-d16ffb8cc321 admin admin] PATH_INFO: `/v3/users/d8c00cbdaef94e75b12add848b1b442b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:44.379762 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a29573-387f-4d3f-8ba1-d16ffb8cc321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c00cbdaef94e75b12add848b1b442b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:44.381773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a29573-387f-4d3f-8ba1-d16ffb8cc321 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:44.602365 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29a29573-387f-4d3f-8ba1-d16ffb8cc321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c00cbdaef94e75b12add848b1b442b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:44.610010 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29a29573-387f-4d3f-8ba1-d16ffb8cc321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c00cbdaef94e75b12add848b1b442b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:44.624200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29a29573-387f-4d3f-8ba1-d16ffb8cc321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c00cbdaef94e75b12add848b1b442b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:44.690204 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29a29573-387f-4d3f-8ba1-d16ffb8cc321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c00cbdaef94e75b12add848b1b442b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:44.690899 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29a29573-387f-4d3f-8ba1-d16ffb8cc321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c00cbdaef94e75b12add848b1b442b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:44.697853 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1403/2810] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:44 2022] DELETE /identity/v3/users/d8c00cbdaef94e75b12add848b1b442b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:45.323425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:45.325043 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:45.342616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f38ca-3eb5-4739-8710-1d228fec9432 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:45.408188 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:45.408764 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:45.409085 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:45.409362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f admin admin] PATH_INFO: `/v3/projects/32c47d90a6044c7f977086c54840e2b0` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:45.410514 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c47d90a6044c7f977086c54840e2b0)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:45.412414 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:45.590297 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c47d90a6044c7f977086c54840e2b0', 'request_id': 'req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:45.598608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c47d90a6044c7f977086c54840e2b0', 'request_id': 'req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:45.602665 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:45.692511 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c47d90a6044c7f977086c54840e2b0', 'request_id': 'req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:45.716925 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f admin admin] The token cache is being invalidate because project 32c47d90a6044c7f977086c54840e2b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:45.717310 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:45.717992 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-c214ce24-a6c4-4cd4-af9c-3baddd1ea75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:45.719734 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1408/2811] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:45 2022] DELETE /identity/v3/projects/32c47d90a6044c7f977086c54840e2b0 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:45.724640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74227ee-9600-41be-95d7-526c92066e5e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:45.730090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74227ee-9600-41be-95d7-526c92066e5e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:45.730090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74227ee-9600-41be-95d7-526c92066e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:45.747929 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a74227ee-9600-41be-95d7-526c92066e5e None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:45.749561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a74227ee-9600-41be-95d7-526c92066e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:45.776917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:45.832393 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1404/2812] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:45.848795 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b26d6-8496-449f-b214-052ba47e211d None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:45.849079 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b26d6-8496-449f-b214-052ba47e211d None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:45.849304 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b26d6-8496-449f-b214-052ba47e211d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:45.872294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-957b26d6-8496-449f-b214-052ba47e211d None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:45.872773 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-957b26d6-8496-449f-b214-052ba47e211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:45.887008 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1409/2813] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:45.891164 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74227ee-9600-41be-95d7-526c92066e5e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:45.901294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74227ee-9600-41be-95d7-526c92066e5e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:45.905868 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe548c-bd11-476e-a253-1e35138a6155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:45.906460 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe548c-bd11-476e-a253-1e35138a6155 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:45.906737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe548c-bd11-476e-a253-1e35138a6155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:45.907004 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe548c-bd11-476e-a253-1e35138a6155 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:45.907644 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe548c-bd11-476e-a253-1e35138a6155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:45.907945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe548c-bd11-476e-a253-1e35138a6155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:45.909568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe548c-bd11-476e-a253-1e35138a6155 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:45.920975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1405/2814] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:48:45.925906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b26d6-8496-449f-b214-052ba47e211d None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:45.937817 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b26d6-8496-449f-b214-052ba47e211d None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:45.942789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8341-d98d-46b4-86a4-ba64185053e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:45.943412 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8341-d98d-46b4-86a4-ba64185053e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:45.943783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8341-d98d-46b4-86a4-ba64185053e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:45.944127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8341-d98d-46b4-86a4-ba64185053e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:45.945444 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8341-d98d-46b4-86a4-ba64185053e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:45.947514 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8341-d98d-46b4-86a4-ba64185053e1 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:45.992503 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe548c-bd11-476e-a253-1e35138a6155 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:45.994222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-07fe548c-bd11-476e-a253-1e35138a6155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:46.076405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1410/2815] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:45 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:46.080447 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8341-d98d-46b4-86a4-ba64185053e1 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:46.086417 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe548c-bd11-476e-a253-1e35138a6155 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:46.151646 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8341-d98d-46b4-86a4-ba64185053e1 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:46.153699 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35da98-9b34-4a70-83ad-5f16c5fbdc05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931a947711a2468baaeef701bbee60c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:46.157196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35da98-9b34-4a70-83ad-5f16c5fbdc05 service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:46.157196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35da98-9b34-4a70-83ad-5f16c5fbdc05 service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:46.157196 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35da98-9b34-4a70-83ad-5f16c5fbdc05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:46.159174 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3e35da98-9b34-4a70-83ad-5f16c5fbdc05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:46.162983 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97538c-00bf-4d68-8312-ff24fea36e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:46.164269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97538c-00bf-4d68-8312-ff24fea36e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:46.164910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97538c-00bf-4d68-8312-ff24fea36e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:46.165601 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97538c-00bf-4d68-8312-ff24fea36e7b admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:46.165910 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97538c-00bf-4d68-8312-ff24fea36e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:46.167856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97538c-00bf-4d68-8312-ff24fea36e7b admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:46.172186 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35da98-9b34-4a70-83ad-5f16c5fbdc05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:46.173803 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35da98-9b34-4a70-83ad-5f16c5fbdc05 service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:46.184581 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1406/2816] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:48:46.256806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1411/2817] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:46 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:46.261106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35da98-9b34-4a70-83ad-5f16c5fbdc05 service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:46.271871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35da98-9b34-4a70-83ad-5f16c5fbdc05 service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:46.276632 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71ca49-5822-43aa-a123-1f93a3e0bba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:46.277355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71ca49-5822-43aa-a123-1f93a3e0bba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:46.277627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71ca49-5822-43aa-a123-1f93a3e0bba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:46.277895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71ca49-5822-43aa-a123-1f93a3e0bba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:46.278526 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71ca49-5822-43aa-a123-1f93a3e0bba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:46.280101 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71ca49-5822-43aa-a123-1f93a3e0bba2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:46.290819 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1407/2818] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:46.295219 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97538c-00bf-4d68-8312-ff24fea36e7b admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:46.306604 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97538c-00bf-4d68-8312-ff24fea36e7b admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:46.312479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1863e49-4b15-4ecf-b52d-931ca4afeb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:46.312479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1863e49-4b15-4ecf-b52d-931ca4afeb48 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:46.312479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1863e49-4b15-4ecf-b52d-931ca4afeb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:46.312479 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1863e49-4b15-4ecf-b52d-931ca4afeb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:46.313039 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1863e49-4b15-4ecf-b52d-931ca4afeb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:46.314639 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1863e49-4b15-4ecf-b52d-931ca4afeb48 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:46.324798 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1412/2819] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:46.329121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71ca49-5822-43aa-a123-1f93a3e0bba2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:46.339269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71ca49-5822-43aa-a123-1f93a3e0bba2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:46.343941 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730bda6-eafb-4129-9f91-d072076f5b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:46.344586 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730bda6-eafb-4129-9f91-d072076f5b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:46.344863 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730bda6-eafb-4129-9f91-d072076f5b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:46.345169 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730bda6-eafb-4129-9f91-d072076f5b67 admin admin] PATH_INFO: `/v3/projects/942152d3c5dc4997ac8cd764387d6baf/users/da68d7d097bb4b9785632489771fb7db/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:46.358050 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:46.362127 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730bda6-eafb-4129-9f91-d072076f5b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942152d3c5dc4997ac8cd764387d6baf, user_id=da68d7d097bb4b9785632489771fb7db, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:46.364792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730bda6-eafb-4129-9f91-d072076f5b67 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:46.472560 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1408/2820] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:46 2022] PUT /identity/v3/projects/942152d3c5dc4997ac8cd764387d6baf/users/da68d7d097bb4b9785632489771fb7db/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:46.483537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2697f-9412-483f-94ca-8eca392145d6 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:46.483820 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2697f-9412-483f-94ca-8eca392145d6 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:46.484116 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2697f-9412-483f-94ca-8eca392145d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:46.512834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-f2b2697f-9412-483f-94ca-8eca392145d6 None None] MFA Rules not processed for user `da68d7d097bb4b9785632489771fb7db`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:46.514115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f2b2697f-9412-483f-94ca-8eca392145d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:46.583900 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1413/2821] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:46.589494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730bda6-eafb-4129-9f91-d072076f5b67 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:46.657684 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730bda6-eafb-4129-9f91-d072076f5b67 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:46.662366 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9116e8-c939-44a2-9d7d-61cda9d50a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:46.662964 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9116e8-c939-44a2-9d7d-61cda9d50a70 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:46.666480 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9116e8-c939-44a2-9d7d-61cda9d50a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:46.666480 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9116e8-c939-44a2-9d7d-61cda9d50a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:46.666480 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9116e8-c939-44a2-9d7d-61cda9d50a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:46.666786 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9116e8-c939-44a2-9d7d-61cda9d50a70 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:46.784056 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1409/2822] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:46 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:48:46.787980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2697f-9412-483f-94ca-8eca392145d6 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:46.799849 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2697f-9412-483f-94ca-8eca392145d6 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:46.828913 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:46.862934 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451d8af-154c-4c39-96c4-5157d24c866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:46.863546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451d8af-154c-4c39-96c4-5157d24c866d admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:46.863827 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451d8af-154c-4c39-96c4-5157d24c866d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:46.864103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451d8af-154c-4c39-96c4-5157d24c866d admin admin] PATH_INFO: `/v3/users` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:46.864733 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451d8af-154c-4c39-96c4-5157d24c866d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:46.866726 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451d8af-154c-4c39-96c4-5157d24c866d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:46.978174 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1414/2823] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:46 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:46.982477 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9116e8-c939-44a2-9d7d-61cda9d50a70 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:46.995412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9116e8-c939-44a2-9d7d-61cda9d50a70 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:47.001307 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f76ff-1dea-4427-bbd3-8900764192ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:47.001915 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f76ff-1dea-4427-bbd3-8900764192ef admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:47.002226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f76ff-1dea-4427-bbd3-8900764192ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:47.002500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f76ff-1dea-4427-bbd3-8900764192ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:47.003179 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f76ff-1dea-4427-bbd3-8900764192ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:47.004772 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f76ff-1dea-4427-bbd3-8900764192ef admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:47.016112 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1410/2824] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:47.020635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451d8af-154c-4c39-96c4-5157d24c866d admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:47.031585 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451d8af-154c-4c39-96c4-5157d24c866d admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:47.036326 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38898aba-224c-4959-92ae-0d74711bf469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:47.036920 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898aba-224c-4959-92ae-0d74711bf469 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:47.037223 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898aba-224c-4959-92ae-0d74711bf469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:47.037492 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898aba-224c-4959-92ae-0d74711bf469 admin admin] PATH_INFO: `/v3/projects/01d4e00f991e42139f4ad6d9a7515595/users/59d9161277dc4f6585113e84c3a3fb66/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:47.053609 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38898aba-224c-4959-92ae-0d74711bf469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d4e00f991e42139f4ad6d9a7515595, user_id=59d9161277dc4f6585113e84c3a3fb66, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:47.056628 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38898aba-224c-4959-92ae-0d74711bf469 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:47.113323 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1415/2825] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:47 2022] PUT /identity/v3/projects/01d4e00f991e42139f4ad6d9a7515595/users/59d9161277dc4f6585113e84c3a3fb66/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:47.117921 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f76ff-1dea-4427-bbd3-8900764192ef admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:47.127737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f76ff-1dea-4427-bbd3-8900764192ef admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:47.186142 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba24b9-b7a1-4ecd-921a-bd6ec02f42cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:47.186744 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba24b9-b7a1-4ecd-921a-bd6ec02f42cb admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:47.187023 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba24b9-b7a1-4ecd-921a-bd6ec02f42cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:47.187288 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba24b9-b7a1-4ecd-921a-bd6ec02f42cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:47.187936 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba24b9-b7a1-4ecd-921a-bd6ec02f42cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:47.189550 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba24b9-b7a1-4ecd-921a-bd6ec02f42cb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:47.200496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1411/2826] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:47.207169 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38898aba-224c-4959-92ae-0d74711bf469 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:47.210282 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7173533-068a-48ec-bd15-f1e05f5fdf68 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:47.211065 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7173533-068a-48ec-bd15-f1e05f5fdf68 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:47.211357 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7173533-068a-48ec-bd15-f1e05f5fdf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:47.220968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38898aba-224c-4959-92ae-0d74711bf469 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:47.226114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c83f9-54e6-4c98-a90e-a9d45698fdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:47.226922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c83f9-54e6-4c98-a90e-a9d45698fdd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:47.227202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c83f9-54e6-4c98-a90e-a9d45698fdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:47.227473 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c83f9-54e6-4c98-a90e-a9d45698fdd2 admin admin] PATH_INFO: `/v3/projects/01d4e00f991e42139f4ad6d9a7515595/users/59d9161277dc4f6585113e84c3a3fb66/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:47.229441 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c83f9-54e6-4c98-a90e-a9d45698fdd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d4e00f991e42139f4ad6d9a7515595, user_id=59d9161277dc4f6585113e84c3a3fb66, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:47.231149 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e7173533-068a-48ec-bd15-f1e05f5fdf68 None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:47.232042 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c83f9-54e6-4c98-a90e-a9d45698fdd2 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:47.232316 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e7173533-068a-48ec-bd15-f1e05f5fdf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:47.243650 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1416/2827] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:47 2022] PUT /identity/v3/projects/01d4e00f991e42139f4ad6d9a7515595/users/59d9161277dc4f6585113e84c3a3fb66/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:47.254255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b8d06-ddc8-41ac-b3a1-34b01cd258f8 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:47.254535 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b8d06-ddc8-41ac-b3a1-34b01cd258f8 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:47.254806 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b8d06-ddc8-41ac-b3a1-34b01cd258f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:47.283464 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-694b8d06-ddc8-41ac-b3a1-34b01cd258f8 None None] MFA Rules not processed for user `59d9161277dc4f6585113e84c3a3fb66`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:47.284676 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-694b8d06-ddc8-41ac-b3a1-34b01cd258f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:47.287706 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:47.300148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1412/2828] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:48:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:47.359903 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1417/2829] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:47.371178 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7173533-068a-48ec-bd15-f1e05f5fdf68 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:47.372565 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e7173533-068a-48ec-bd15-f1e05f5fdf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:47.431264 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7173533-068a-48ec-bd15-f1e05f5fdf68 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:47.469789 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b8d06-ddc8-41ac-b3a1-34b01cd258f8 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:47.471176 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-694b8d06-ddc8-41ac-b3a1-34b01cd258f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:47.486421 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88ebe0-53b6-4940-b73c-323b57d10ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:47.487041 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88ebe0-53b6-4940-b73c-323b57d10ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:47.487319 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88ebe0-53b6-4940-b73c-323b57d10ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:47.487592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88ebe0-53b6-4940-b73c-323b57d10ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:47.498434 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88ebe0-53b6-4940-b73c-323b57d10ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:47.499991 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88ebe0-53b6-4940-b73c-323b57d10ac3 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:47.510242 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1413/2830] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:47.547505 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b8d06-ddc8-41ac-b3a1-34b01cd258f8 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:47.552644 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a27875-6341-42dd-a929-e4097a79c46d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:47.553355 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27875-6341-42dd-a929-e4097a79c46d service swift] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:47.553632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27875-6341-42dd-a929-e4097a79c46d service swift] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:47.555701 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27875-6341-42dd-a929-e4097a79c46d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:47.558795 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:47.612750 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a27875-6341-42dd-a929-e4097a79c46d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:47.614377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a27875-6341-42dd-a929-e4097a79c46d service swift] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:47.622986 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1418/2831] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:48:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 04:48:48.049375 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88ebe0-53b6-4940-b73c-323b57d10ac3 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:48.116015 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88ebe0-53b6-4940-b73c-323b57d10ac3 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:48.121315 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77c26a-514d-4749-be70-d303c2aee71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:48.121944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c26a-514d-4749-be70-d303c2aee71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:48.122222 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c26a-514d-4749-be70-d303c2aee71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:48.122494 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c26a-514d-4749-be70-d303c2aee71a admin admin] PATH_INFO: `/v3/users/da68d7d097bb4b9785632489771fb7db` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:48.123651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77c26a-514d-4749-be70-d303c2aee71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da68d7d097bb4b9785632489771fb7db)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:48.125601 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77c26a-514d-4749-be70-d303c2aee71a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:48.328195 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ce77c26a-514d-4749-be70-d303c2aee71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da68d7d097bb4b9785632489771fb7db'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:48.336085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ce77c26a-514d-4749-be70-d303c2aee71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da68d7d097bb4b9785632489771fb7db'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:48.339696 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:48.350788 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ce77c26a-514d-4749-be70-d303c2aee71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da68d7d097bb4b9785632489771fb7db'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:48.444232 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ce77c26a-514d-4749-be70-d303c2aee71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da68d7d097bb4b9785632489771fb7db'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:48.445532 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ce77c26a-514d-4749-be70-d303c2aee71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da68d7d097bb4b9785632489771fb7db'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:48.452045 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1414/2832] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:48 2022] DELETE /identity/v3/users/da68d7d097bb4b9785632489771fb7db => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:48.460249 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb3b8a-eb26-46f6-983c-b61f1d396aeb None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:48.460249 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb3b8a-eb26-46f6-983c-b61f1d396aeb None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:48.460249 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb3b8a-eb26-46f6-983c-b61f1d396aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:48.477723 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-5ddb3b8a-eb26-46f6-983c-b61f1d396aeb None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:48.479097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5ddb3b8a-eb26-46f6-983c-b61f1d396aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:48.525453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6ffb4-2051-43d3-a73d-de91667226e1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:48.529061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6ffb4-2051-43d3-a73d-de91667226e1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:48.529061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6ffb4-2051-43d3-a73d-de91667226e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:48.545661 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b0c6ffb4-2051-43d3-a73d-de91667226e1 None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:48.547182 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b0c6ffb4-2051-43d3-a73d-de91667226e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:48.547510 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1419/2833] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:48.561033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb3b8a-eb26-46f6-983c-b61f1d396aeb None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:48.562244 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-5ddb3b8a-eb26-46f6-983c-b61f1d396aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:48.614561 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1415/2834] 10.222.0.50 () {58 vars in 967 bytes} [Sat Sep 17 04:48:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:48.627523 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6ffb4-2051-43d3-a73d-de91667226e1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:48.629163 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b0c6ffb4-2051-43d3-a73d-de91667226e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:48.633272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb3b8a-eb26-46f6-983c-b61f1d396aeb None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:48.639314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3bc2f-ff1b-497c-b0e9-f011b1f1be08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:48.639960 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3bc2f-ff1b-497c-b0e9-f011b1f1be08 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:48.640248 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3bc2f-ff1b-497c-b0e9-f011b1f1be08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:48.640513 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3bc2f-ff1b-497c-b0e9-f011b1f1be08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:48.650506 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3bc2f-ff1b-497c-b0e9-f011b1f1be08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:48.651948 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3bc2f-ff1b-497c-b0e9-f011b1f1be08 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:48.661760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1420/2835] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:48:48.707750 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6ffb4-2051-43d3-a73d-de91667226e1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:48.713436 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76881504-8f15-45cd-8374-379e604cfbdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:48.714054 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881504-8f15-45cd-8374-379e604cfbdc service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:48.714331 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881504-8f15-45cd-8374-379e604cfbdc service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:48.714599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881504-8f15-45cd-8374-379e604cfbdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:48.729381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76881504-8f15-45cd-8374-379e604cfbdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:48.731121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76881504-8f15-45cd-8374-379e604cfbdc service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:48.739865 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1416/2836] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 04:48:49.078442 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3bc2f-ff1b-497c-b0e9-f011b1f1be08 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:49.079931 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c7a3bc2f-ff1b-497c-b0e9-f011b1f1be08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:49.093304 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3bc2f-ff1b-497c-b0e9-f011b1f1be08 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:49.107760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90535338-13a1-485d-a6f2-afeaa6c136fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:49.107760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90535338-13a1-485d-a6f2-afeaa6c136fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:49.107760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90535338-13a1-485d-a6f2-afeaa6c136fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:49.107760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90535338-13a1-485d-a6f2-afeaa6c136fa admin admin] PATH_INFO: `/v3/projects/942152d3c5dc4997ac8cd764387d6baf` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:49.108969 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90535338-13a1-485d-a6f2-afeaa6c136fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=942152d3c5dc4997ac8cd764387d6baf)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:49.111007 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90535338-13a1-485d-a6f2-afeaa6c136fa admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:49.225632 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:49.229871 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-90535338-13a1-485d-a6f2-afeaa6c136fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942152d3c5dc4997ac8cd764387d6baf', 'request_id': 'req-90535338-13a1-485d-a6f2-afeaa6c136fa'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:49.236177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-90535338-13a1-485d-a6f2-afeaa6c136fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942152d3c5dc4997ac8cd764387d6baf', 'request_id': 'req-90535338-13a1-485d-a6f2-afeaa6c136fa'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:49.320404 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-90535338-13a1-485d-a6f2-afeaa6c136fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942152d3c5dc4997ac8cd764387d6baf', 'request_id': 'req-90535338-13a1-485d-a6f2-afeaa6c136fa'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:49.331636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-90535338-13a1-485d-a6f2-afeaa6c136fa admin admin] The token cache is being invalidate because project 942152d3c5dc4997ac8cd764387d6baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:49.331927 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-90535338-13a1-485d-a6f2-afeaa6c136fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:49.333993 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-90535338-13a1-485d-a6f2-afeaa6c136fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:49.334115 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1421/2837] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:49 2022] DELETE /identity/v3/projects/942152d3c5dc4997ac8cd764387d6baf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:49.338247 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76881504-8f15-45cd-8374-379e604cfbdc service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:49.350052 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76881504-8f15-45cd-8374-379e604cfbdc service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:49.405386 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ebbb3-d945-420d-8957-485ee4fdd8c4 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:49.405716 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ebbb3-d945-420d-8957-485ee4fdd8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:49.405988 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ebbb3-d945-420d-8957-485ee4fdd8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:49.420078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852cc63-e302-4dbf-8ff7-7e959c3e1d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:49.420078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852cc63-e302-4dbf-8ff7-7e959c3e1d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:49.420078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852cc63-e302-4dbf-8ff7-7e959c3e1d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:49.420078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852cc63-e302-4dbf-8ff7-7e959c3e1d6e admin admin] PATH_INFO: `/v3/users/59d9161277dc4f6585113e84c3a3fb66` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:49.420568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852cc63-e302-4dbf-8ff7-7e959c3e1d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d9161277dc4f6585113e84c3a3fb66)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:49.420568 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852cc63-e302-4dbf-8ff7-7e959c3e1d6e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:49.427747 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-034ebbb3-d945-420d-8957-485ee4fdd8c4 None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:49.428968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-034ebbb3-d945-420d-8957-485ee4fdd8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:49.434650 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:49.496416 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1422/2838] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:48:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:48:49.508696 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ebbb3-d945-420d-8957-485ee4fdd8c4 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:49.510014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-034ebbb3-d945-420d-8957-485ee4fdd8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:49.583255 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ebbb3-d945-420d-8957-485ee4fdd8c4 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:49.589044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5261b-ceac-4dc5-b6f8-457c326763ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:49.589660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5261b-ceac-4dc5-b6f8-457c326763ca service swift] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:49.589938 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5261b-ceac-4dc5-b6f8-457c326763ca service swift] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:49.590210 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5261b-ceac-4dc5-b6f8-457c326763ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:49.599294 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5261b-ceac-4dc5-b6f8-457c326763ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:49.603803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5261b-ceac-4dc5-b6f8-457c326763ca service swift] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:49.609608 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1423/2839] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:48:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 04:48:49.660453 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a852cc63-e302-4dbf-8ff7-7e959c3e1d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d9161277dc4f6585113e84c3a3fb66'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:49.670682 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a852cc63-e302-4dbf-8ff7-7e959c3e1d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d9161277dc4f6585113e84c3a3fb66'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:49.683609 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a852cc63-e302-4dbf-8ff7-7e959c3e1d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d9161277dc4f6585113e84c3a3fb66'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:49.737728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a852cc63-e302-4dbf-8ff7-7e959c3e1d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d9161277dc4f6585113e84c3a3fb66'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:49.738351 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a852cc63-e302-4dbf-8ff7-7e959c3e1d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d9161277dc4f6585113e84c3a3fb66'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:49.745626 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1417/2840] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:49 2022] DELETE /identity/v3/users/59d9161277dc4f6585113e84c3a3fb66 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:50.173229 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5261b-ceac-4dc5-b6f8-457c326763ca service swift] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:50.174878 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-f7b5261b-ceac-4dc5-b6f8-457c326763ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:50.180592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3b4fe-c80d-4844-be17-af9f87067476 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:50.181176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3b4fe-c80d-4844-be17-af9f87067476 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:50.181503 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3b4fe-c80d-4844-be17-af9f87067476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:50.194944 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5261b-ceac-4dc5-b6f8-457c326763ca service swift] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:50.207061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-cdf3b4fe-c80d-4844-be17-af9f87067476 None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:50.208276 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cdf3b4fe-c80d-4844-be17-af9f87067476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:50.264683 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17546cd6-3435-4e4e-b0f4-b118e8b97f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:50.265715 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17546cd6-3435-4e4e-b0f4-b118e8b97f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:50.266163 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17546cd6-3435-4e4e-b0f4-b118e8b97f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:50.266696 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17546cd6-3435-4e4e-b0f4-b118e8b97f49 admin admin] PATH_INFO: `/v3/projects/01d4e00f991e42139f4ad6d9a7515595` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:50.268090 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17546cd6-3435-4e4e-b0f4-b118e8b97f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d4e00f991e42139f4ad6d9a7515595)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:50.270467 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17546cd6-3435-4e4e-b0f4-b118e8b97f49 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:50.277500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1418/2841] 10.222.0.50 () {58 vars in 967 bytes} [Sat Sep 17 04:48:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:50.279856 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:50.290062 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3b4fe-c80d-4844-be17-af9f87067476 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:50.291472 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cdf3b4fe-c80d-4844-be17-af9f87067476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:50.361828 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3b4fe-c80d-4844-be17-af9f87067476 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:50.368274 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a082e-6392-4ccd-9901-5d91240c1dea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:50.368971 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a082e-6392-4ccd-9901-5d91240c1dea service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:50.373655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a082e-6392-4ccd-9901-5d91240c1dea service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:50.373655 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a082e-6392-4ccd-9901-5d91240c1dea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:50.378309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a082e-6392-4ccd-9901-5d91240c1dea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:50.379901 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a082e-6392-4ccd-9901-5d91240c1dea service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:50.385547 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-17546cd6-3435-4e4e-b0f4-b118e8b97f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d4e00f991e42139f4ad6d9a7515595', 'request_id': 'req-17546cd6-3435-4e4e-b0f4-b118e8b97f49'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:50.389176 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1419/2842] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:48:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 04:48:50.392017 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-17546cd6-3435-4e4e-b0f4-b118e8b97f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d4e00f991e42139f4ad6d9a7515595', 'request_id': 'req-17546cd6-3435-4e4e-b0f4-b118e8b97f49'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:50.495937 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-17546cd6-3435-4e4e-b0f4-b118e8b97f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d4e00f991e42139f4ad6d9a7515595', 'request_id': 'req-17546cd6-3435-4e4e-b0f4-b118e8b97f49'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:50.513214 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-17546cd6-3435-4e4e-b0f4-b118e8b97f49 admin admin] The token cache is being invalidate because project 01d4e00f991e42139f4ad6d9a7515595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:50.513816 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-17546cd6-3435-4e4e-b0f4-b118e8b97f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:50.514151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-17546cd6-3435-4e4e-b0f4-b118e8b97f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:50.515671 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1424/2843] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:50 2022] DELETE /identity/v3/projects/01d4e00f991e42139f4ad6d9a7515595 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:50.520500 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152b613-d1ca-4bb3-9fb4-f1d6192011d7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:50.520867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152b613-d1ca-4bb3-9fb4-f1d6192011d7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:50.521190 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152b613-d1ca-4bb3-9fb4-f1d6192011d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:50.541651 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3152b613-d1ca-4bb3-9fb4-f1d6192011d7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:50.543060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3152b613-d1ca-4bb3-9fb4-f1d6192011d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:50.564841 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:50.608278 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1420/2844] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:50.616980 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8a97-2347-436d-939e-5a99006155a4 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:50.620014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8a97-2347-436d-939e-5a99006155a4 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:50.620014 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8a97-2347-436d-939e-5a99006155a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:50.638103 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-ce3e8a97-2347-436d-939e-5a99006155a4 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:50.639357 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ce3e8a97-2347-436d-939e-5a99006155a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:50.647470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1425/2845] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:50.652199 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152b613-d1ca-4bb3-9fb4-f1d6192011d7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:50.661881 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152b613-d1ca-4bb3-9fb4-f1d6192011d7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:50.667090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb93528-b77d-4244-a545-3cff9f4adb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:50.667739 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb93528-b77d-4244-a545-3cff9f4adb20 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:50.668236 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb93528-b77d-4244-a545-3cff9f4adb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:50.668676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb93528-b77d-4244-a545-3cff9f4adb20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:50.669721 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb93528-b77d-4244-a545-3cff9f4adb20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:48:50.670081 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb93528-b77d-4244-a545-3cff9f4adb20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:50.671665 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb93528-b77d-4244-a545-3cff9f4adb20 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:50.684053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1421/2846] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 04:48:50.688421 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e8a97-2347-436d-939e-5a99006155a4 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:50.698345 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e8a97-2347-436d-939e-5a99006155a4 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:50.702954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c811b8-afce-4d17-ae48-563f6949a6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:50.712073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c811b8-afce-4d17-ae48-563f6949a6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:50.712073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c811b8-afce-4d17-ae48-563f6949a6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:50.712073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c811b8-afce-4d17-ae48-563f6949a6d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:50.712073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c811b8-afce-4d17-ae48-563f6949a6d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:50.712073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c811b8-afce-4d17-ae48-563f6949a6d7 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:50.824398 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1426/2847] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:50 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:50.828949 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb93528-b77d-4244-a545-3cff9f4adb20 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:50.839353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb93528-b77d-4244-a545-3cff9f4adb20 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:50.915060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfff337-9d19-4b76-adcf-ed7b3ef8bf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:50.915060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfff337-9d19-4b76-adcf-ed7b3ef8bf30 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:50.915060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfff337-9d19-4b76-adcf-ed7b3ef8bf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:50.915060 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfff337-9d19-4b76-adcf-ed7b3ef8bf30 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:50.915552 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfff337-9d19-4b76-adcf-ed7b3ef8bf30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:50.916443 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfff337-9d19-4b76-adcf-ed7b3ef8bf30 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:50.988905 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1422/2848] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:50 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:50.989932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c811b8-afce-4d17-ae48-563f6949a6d7 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:51.001846 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c811b8-afce-4d17-ae48-563f6949a6d7 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:51.006924 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614dc5d-6d61-4977-b494-4f726474de79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:51.007674 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614dc5d-6d61-4977-b494-4f726474de79 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:51.008852 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614dc5d-6d61-4977-b494-4f726474de79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:51.009229 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614dc5d-6d61-4977-b494-4f726474de79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:51.009955 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614dc5d-6d61-4977-b494-4f726474de79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:51.011660 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614dc5d-6d61-4977-b494-4f726474de79 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:51.021939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1427/2849] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:51.026795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfff337-9d19-4b76-adcf-ed7b3ef8bf30 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:51.039813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfff337-9d19-4b76-adcf-ed7b3ef8bf30 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:51.044582 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c14fe4-8d0e-4573-a64c-00eb16e48948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:51.045252 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c14fe4-8d0e-4573-a64c-00eb16e48948 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:51.045530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c14fe4-8d0e-4573-a64c-00eb16e48948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:51.045823 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c14fe4-8d0e-4573-a64c-00eb16e48948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:51.046466 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c14fe4-8d0e-4573-a64c-00eb16e48948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:51.048090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c14fe4-8d0e-4573-a64c-00eb16e48948 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:51.061911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1423/2850] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:51.063594 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614dc5d-6d61-4977-b494-4f726474de79 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:51.074984 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614dc5d-6d61-4977-b494-4f726474de79 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:51.081141 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db2663-6e08-4f29-987c-f13c92c98b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:51.081959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2663-6e08-4f29-987c-f13c92c98b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:51.082238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2663-6e08-4f29-987c-f13c92c98b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:51.082508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2663-6e08-4f29-987c-f13c92c98b96 admin admin] PATH_INFO: `/v3/projects/96a42c8c24634759ae50c148aaeb3ced/users/597c199ef61c422fb409c9a31a1ab718/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:51.098243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db2663-6e08-4f29-987c-f13c92c98b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a42c8c24634759ae50c148aaeb3ced, user_id=597c199ef61c422fb409c9a31a1ab718, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:51.101038 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db2663-6e08-4f29-987c-f13c92c98b96 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:51.199690 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1428/2851] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:51 2022] PUT /identity/v3/projects/96a42c8c24634759ae50c148aaeb3ced/users/597c199ef61c422fb409c9a31a1ab718/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:51.275614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c98459-16d4-4363-b6ea-bb0644ec6778 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:51.276035 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c98459-16d4-4363-b6ea-bb0644ec6778 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:51.276435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c98459-16d4-4363-b6ea-bb0644ec6778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:51.306894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-00c98459-16d4-4363-b6ea-bb0644ec6778 None None] MFA Rules not processed for user `597c199ef61c422fb409c9a31a1ab718`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:51.308446 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-00c98459-16d4-4363-b6ea-bb0644ec6778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:51.379700 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1424/2852] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:51.385891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db2663-6e08-4f29-987c-f13c92c98b96 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:51.452976 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db2663-6e08-4f29-987c-f13c92c98b96 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:51.457714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d0aa8-5962-4ee8-9cd0-30b7d5622c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:51.458349 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d0aa8-5962-4ee8-9cd0-30b7d5622c85 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:51.458627 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d0aa8-5962-4ee8-9cd0-30b7d5622c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:51.458896 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d0aa8-5962-4ee8-9cd0-30b7d5622c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:51.459522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d0aa8-5962-4ee8-9cd0-30b7d5622c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:51.462507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d0aa8-5962-4ee8-9cd0-30b7d5622c85 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:51.583307 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1429/2853] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:48:51 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:51.587710 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c98459-16d4-4363-b6ea-bb0644ec6778 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:51.598914 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c98459-16d4-4363-b6ea-bb0644ec6778 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:51.615150 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:51.678638 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab083ad6-dc2f-4e06-b336-aae4c53033c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:51.679472 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab083ad6-dc2f-4e06-b336-aae4c53033c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:51.679605 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab083ad6-dc2f-4e06-b336-aae4c53033c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:51.680590 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab083ad6-dc2f-4e06-b336-aae4c53033c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:51.681337 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab083ad6-dc2f-4e06-b336-aae4c53033c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:51.683426 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab083ad6-dc2f-4e06-b336-aae4c53033c5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:51.764090 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1425/2854] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:48:51 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:48:51.777166 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d0aa8-5962-4ee8-9cd0-30b7d5622c85 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:51.781383 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d0aa8-5962-4ee8-9cd0-30b7d5622c85 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:51.787405 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607b09a-7d74-4d15-bf69-4f5d4a55a3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:51.788002 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607b09a-7d74-4d15-bf69-4f5d4a55a3ca admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:51.788285 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607b09a-7d74-4d15-bf69-4f5d4a55a3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:51.788559 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607b09a-7d74-4d15-bf69-4f5d4a55a3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:51.789994 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607b09a-7d74-4d15-bf69-4f5d4a55a3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:51.792395 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607b09a-7d74-4d15-bf69-4f5d4a55a3ca admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:51.805899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1430/2855] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:48:51.810226 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab083ad6-dc2f-4e06-b336-aae4c53033c5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:51.823467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab083ad6-dc2f-4e06-b336-aae4c53033c5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:51.833293 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312615fe-95a7-4e18-be6f-f7ce6e111390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:51.833293 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312615fe-95a7-4e18-be6f-f7ce6e111390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:51.833293 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312615fe-95a7-4e18-be6f-f7ce6e111390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:51.833293 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312615fe-95a7-4e18-be6f-f7ce6e111390 admin admin] PATH_INFO: `/v3/projects/53eef61bbfb6496bb8ca2c7134c5858c/users/352bb05aeac346bbb59a5b4f60d2a9d2/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:51.849903 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312615fe-95a7-4e18-be6f-f7ce6e111390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53eef61bbfb6496bb8ca2c7134c5858c, user_id=352bb05aeac346bbb59a5b4f60d2a9d2, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:51.852674 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312615fe-95a7-4e18-be6f-f7ce6e111390 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:51.922331 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1426/2856] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:51 2022] PUT /identity/v3/projects/53eef61bbfb6496bb8ca2c7134c5858c/users/352bb05aeac346bbb59a5b4f60d2a9d2/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:51.926423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607b09a-7d74-4d15-bf69-4f5d4a55a3ca admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:51.940451 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607b09a-7d74-4d15-bf69-4f5d4a55a3ca admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:51.949177 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:52.012190 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6602a-55d2-443e-8cfa-c302895f629a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:52.012801 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6602a-55d2-443e-8cfa-c302895f629a admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:52.013114 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6602a-55d2-443e-8cfa-c302895f629a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:52.013391 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6602a-55d2-443e-8cfa-c302895f629a admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:52.014047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6602a-55d2-443e-8cfa-c302895f629a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:52.015728 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6602a-55d2-443e-8cfa-c302895f629a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:52.026636 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1431/2857] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:48:52.030916 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312615fe-95a7-4e18-be6f-f7ce6e111390 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:52.042039 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312615fe-95a7-4e18-be6f-f7ce6e111390 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:52.046867 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc06d65-32e4-4cce-ad08-cdd81d37bff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:52.047518 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc06d65-32e4-4cce-ad08-cdd81d37bff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:52.047799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc06d65-32e4-4cce-ad08-cdd81d37bff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:52.048073 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc06d65-32e4-4cce-ad08-cdd81d37bff1 admin admin] PATH_INFO: `/v3/projects/53eef61bbfb6496bb8ca2c7134c5858c/users/352bb05aeac346bbb59a5b4f60d2a9d2/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:52.050077 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc06d65-32e4-4cce-ad08-cdd81d37bff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53eef61bbfb6496bb8ca2c7134c5858c, user_id=352bb05aeac346bbb59a5b4f60d2a9d2, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:52.052730 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc06d65-32e4-4cce-ad08-cdd81d37bff1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:52.064692 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1427/2858] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:48:52 2022] PUT /identity/v3/projects/53eef61bbfb6496bb8ca2c7134c5858c/users/352bb05aeac346bbb59a5b4f60d2a9d2/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:48:52.075606 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca89475-5219-4262-b4d7-7aab82cef69f None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:52.075891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca89475-5219-4262-b4d7-7aab82cef69f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:52.076167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca89475-5219-4262-b4d7-7aab82cef69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:52.108186 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-2ca89475-5219-4262-b4d7-7aab82cef69f None None] MFA Rules not processed for user `352bb05aeac346bbb59a5b4f60d2a9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:52.109858 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2ca89475-5219-4262-b4d7-7aab82cef69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:52.192256 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1432/2859] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:52.203711 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc06d65-32e4-4cce-ad08-cdd81d37bff1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:52.206137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8dc06d65-32e4-4cce-ad08-cdd81d37bff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:52.278244 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc06d65-32e4-4cce-ad08-cdd81d37bff1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:52.281474 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617773e-0b14-4c1b-a13b-fec77c339177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:52.282085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617773e-0b14-4c1b-a13b-fec77c339177 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:52.282383 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617773e-0b14-4c1b-a13b-fec77c339177 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:52.282649 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617773e-0b14-4c1b-a13b-fec77c339177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:52.348805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617773e-0b14-4c1b-a13b-fec77c339177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:52.351454 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617773e-0b14-4c1b-a13b-fec77c339177 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:52.362047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1428/2860] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:53.271876 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca89475-5219-4262-b4d7-7aab82cef69f None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:53.273360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-2ca89475-5219-4262-b4d7-7aab82cef69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:53.341981 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca89475-5219-4262-b4d7-7aab82cef69f None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:53.346906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00b9e7-25e9-48b7-b0b1-5f14b5640ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:53.347530 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00b9e7-25e9-48b7-b0b1-5f14b5640ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:53.347800 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00b9e7-25e9-48b7-b0b1-5f14b5640ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:53.348063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00b9e7-25e9-48b7-b0b1-5f14b5640ba2 admin admin] PATH_INFO: `/v3/users/a481726e59974db3a9c6200d6e4f7197` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:53.349238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00b9e7-25e9-48b7-b0b1-5f14b5640ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a481726e59974db3a9c6200d6e4f7197)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:53.351125 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00b9e7-25e9-48b7-b0b1-5f14b5640ba2 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:53.521341 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:53.535245 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4f00b9e7-25e9-48b7-b0b1-5f14b5640ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a481726e59974db3a9c6200d6e4f7197'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:53.616136 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4f00b9e7-25e9-48b7-b0b1-5f14b5640ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a481726e59974db3a9c6200d6e4f7197'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:53.616828 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4f00b9e7-25e9-48b7-b0b1-5f14b5640ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a481726e59974db3a9c6200d6e4f7197'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:53.624317 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4f00b9e7-25e9-48b7-b0b1-5f14b5640ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a481726e59974db3a9c6200d6e4f7197'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:53.636552 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-4f00b9e7-25e9-48b7-b0b1-5f14b5640ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a481726e59974db3a9c6200d6e4f7197'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:53.642450 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1433/2861] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:48:53 2022] DELETE /identity/v3/users/a481726e59974db3a9c6200d6e4f7197 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:53.646907 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70287b35-d2e1-4adc-be18-e4158e8be5d7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:53.647374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70287b35-d2e1-4adc-be18-e4158e8be5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:53.647491 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70287b35-d2e1-4adc-be18-e4158e8be5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:53.667824 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-70287b35-d2e1-4adc-be18-e4158e8be5d7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:48:53.669121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-70287b35-d2e1-4adc-be18-e4158e8be5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:53.688773 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:53.727359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1429/2862] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:48:53.737134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00b9e7-25e9-48b7-b0b1-5f14b5640ba2 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:53.738540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-4f00b9e7-25e9-48b7-b0b1-5f14b5640ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:53.796597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00b9e7-25e9-48b7-b0b1-5f14b5640ba2 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:53.800229 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a9ca8-aaf1-4908-ad19-4e997571ec1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:53.800954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a9ca8-aaf1-4908-ad19-4e997571ec1c service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:53.801263 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a9ca8-aaf1-4908-ad19-4e997571ec1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:53.801534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a9ca8-aaf1-4908-ad19-4e997571ec1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:53.810401 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a9ca8-aaf1-4908-ad19-4e997571ec1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:53.811882 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a9ca8-aaf1-4908-ad19-4e997571ec1c service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:53.821760 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1434/2863] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:48:54.036175 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70287b35-d2e1-4adc-be18-e4158e8be5d7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:54.037546 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-70287b35-d2e1-4adc-be18-e4158e8be5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:54.051861 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70287b35-d2e1-4adc-be18-e4158e8be5d7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:54.061246 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:54.062001 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:54.062273 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:54.062614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] PATH_INFO: `/v3/projects/7f55790082fd4576b33c35a571e455a7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:54.063798 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f55790082fd4576b33c35a571e455a7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:54.065801 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:54.161700 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f55790082fd4576b33c35a571e455a7', 'request_id': 'req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:54.169554 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f55790082fd4576b33c35a571e455a7', 'request_id': 'req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:54.175192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f55790082fd4576b33c35a571e455a7', 'request_id': 'req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:54.229353 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] The token cache is being invalidate because project 7f55790082fd4576b33c35a571e455a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:48:54.230340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:54.230340 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:48:54.232242 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1430/2864] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:48:54 2022] DELETE /identity/v3/projects/7f55790082fd4576b33c35a571e455a7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:48:57.664311 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a9ca8-aaf1-4908-ad19-4e997571ec1c service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:48:57.666446 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-ff5a9ca8-aaf1-4908-ad19-4e997571ec1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:57.724224 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a9ca8-aaf1-4908-ad19-4e997571ec1c service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:48:57.773272 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfa785-9427-4e21-a4af-98392c4499bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:48:57.774459 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfa785-9427-4e21-a4af-98392c4499bf service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:48:57.774657 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfa785-9427-4e21-a4af-98392c4499bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:48:57.774940 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfa785-9427-4e21-a4af-98392c4499bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:48:57.776687 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-19bfa785-9427-4e21-a4af-98392c4499bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:48:57.796470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:48:57.841904 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfa785-9427-4e21-a4af-98392c4499bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:48:57.843369 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfa785-9427-4e21-a4af-98392c4499bf service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:48:57.853790 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1435/2865] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:48:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:49:03.955795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:03.957215 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:04.021807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb087db0-d9d6-4fa3-83ae-ed698ab24b15 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:04.027544 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fa24b-b73f-4464-acd3-e6eb106fb971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:04.028166 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa24b-b73f-4464-acd3-e6eb106fb971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:04.028447 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa24b-b73f-4464-acd3-e6eb106fb971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:04.028765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa24b-b73f-4464-acd3-e6eb106fb971 admin admin] PATH_INFO: `/v3/users/597c199ef61c422fb409c9a31a1ab718` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:04.029966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fa24b-b73f-4464-acd3-e6eb106fb971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=597c199ef61c422fb409c9a31a1ab718)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:04.031871 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fa24b-b73f-4464-acd3-e6eb106fb971 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:04.289614 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b65fa24b-b73f-4464-acd3-e6eb106fb971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '597c199ef61c422fb409c9a31a1ab718'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:04.294511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:04.297616 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b65fa24b-b73f-4464-acd3-e6eb106fb971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '597c199ef61c422fb409c9a31a1ab718'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:04.309385 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b65fa24b-b73f-4464-acd3-e6eb106fb971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '597c199ef61c422fb409c9a31a1ab718'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:04.360920 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b65fa24b-b73f-4464-acd3-e6eb106fb971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '597c199ef61c422fb409c9a31a1ab718'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:04.361577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b65fa24b-b73f-4464-acd3-e6eb106fb971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '597c199ef61c422fb409c9a31a1ab718'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:04.367599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1431/2866] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:49:03 2022] DELETE /identity/v3/users/597c199ef61c422fb409c9a31a1ab718 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:49:04.372587 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea34a3-27fa-4c5b-b292-0986c6660ede None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:04.373073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea34a3-27fa-4c5b-b292-0986c6660ede None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:04.373199 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea34a3-27fa-4c5b-b292-0986c6660ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:04.392511 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-dfea34a3-27fa-4c5b-b292-0986c6660ede None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:04.396511 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-dfea34a3-27fa-4c5b-b292-0986c6660ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:04.452393 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1436/2867] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:49:04.462132 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fa24b-b73f-4464-acd3-e6eb106fb971 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:04.464348 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b65fa24b-b73f-4464-acd3-e6eb106fb971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:04.523230 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fa24b-b73f-4464-acd3-e6eb106fb971 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:04.527456 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3420ab-6200-4356-aaf3-a6c4a21e1a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:04.528053 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3420ab-6200-4356-aaf3-a6c4a21e1a97 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:04.528355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3420ab-6200-4356-aaf3-a6c4a21e1a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:04.528627 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3420ab-6200-4356-aaf3-a6c4a21e1a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:04.538183 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3420ab-6200-4356-aaf3-a6c4a21e1a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:04.539611 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3420ab-6200-4356-aaf3-a6c4a21e1a97 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:04.549121 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1432/2868] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:49:05.018354 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea34a3-27fa-4c5b-b292-0986c6660ede None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:05.020705 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-dfea34a3-27fa-4c5b-b292-0986c6660ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:05.031712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea34a3-27fa-4c5b-b292-0986c6660ede None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:05.036268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:05.036902 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:05.037226 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:05.037493 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] PATH_INFO: `/v3/projects/96a42c8c24634759ae50c148aaeb3ced` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:05.038635 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a42c8c24634759ae50c148aaeb3ced)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:05.041154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:05.160616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a42c8c24634759ae50c148aaeb3ced', 'request_id': 'req-76332767-c62f-4825-a6c4-b67befcfa44d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:05.168018 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a42c8c24634759ae50c148aaeb3ced', 'request_id': 'req-76332767-c62f-4825-a6c4-b67befcfa44d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:05.252175 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a42c8c24634759ae50c148aaeb3ced', 'request_id': 'req-76332767-c62f-4825-a6c4-b67befcfa44d'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:05.263906 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] The token cache is being invalidate because project 96a42c8c24634759ae50c148aaeb3ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:49:05.264134 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:05.264796 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:05.266340 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1437/2869] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:49:05 2022] DELETE /identity/v3/projects/96a42c8c24634759ae50c148aaeb3ced => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:49:05.270366 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3420ab-6200-4356-aaf3-a6c4a21e1a97 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:05.280435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3420ab-6200-4356-aaf3-a6c4a21e1a97 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:05.334622 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6c95a-370f-4cf2-91ff-34c5c8b5aa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:05.335233 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6c95a-370f-4cf2-91ff-34c5c8b5aa27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:05.335506 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6c95a-370f-4cf2-91ff-34c5c8b5aa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:05.335770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6c95a-370f-4cf2-91ff-34c5c8b5aa27 admin admin] PATH_INFO: `/v3/users/352bb05aeac346bbb59a5b4f60d2a9d2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:05.336918 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6c95a-370f-4cf2-91ff-34c5c8b5aa27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=352bb05aeac346bbb59a5b4f60d2a9d2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:05.342860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6c95a-370f-4cf2-91ff-34c5c8b5aa27 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:05.580326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e7a6c95a-370f-4cf2-91ff-34c5c8b5aa27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352bb05aeac346bbb59a5b4f60d2a9d2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:05.588330 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e7a6c95a-370f-4cf2-91ff-34c5c8b5aa27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352bb05aeac346bbb59a5b4f60d2a9d2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:05.600372 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e7a6c95a-370f-4cf2-91ff-34c5c8b5aa27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352bb05aeac346bbb59a5b4f60d2a9d2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:05.602067 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:05.669895 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e7a6c95a-370f-4cf2-91ff-34c5c8b5aa27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352bb05aeac346bbb59a5b4f60d2a9d2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:05.670567 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e7a6c95a-370f-4cf2-91ff-34c5c8b5aa27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352bb05aeac346bbb59a5b4f60d2a9d2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:05.676687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1433/2870] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:49:05 2022] DELETE /identity/v3/users/352bb05aeac346bbb59a5b4f60d2a9d2 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:49:05.970323 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:05.971752 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:05.984922 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76332767-c62f-4825-a6c4-b67befcfa44d admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:06.024389 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:06.043123 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150ff7c-2c77-4654-9123-211ca23ffe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:06.043844 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150ff7c-2c77-4654-9123-211ca23ffe1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:06.044193 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150ff7c-2c77-4654-9123-211ca23ffe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:06.044540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150ff7c-2c77-4654-9123-211ca23ffe1a admin admin] PATH_INFO: `/v3/users/3d66645c66454584b52fde16dac98594` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:06.045909 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150ff7c-2c77-4654-9123-211ca23ffe1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d66645c66454584b52fde16dac98594)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:06.047955 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150ff7c-2c77-4654-9123-211ca23ffe1a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:06.228738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6c95a-370f-4cf2-91ff-34c5c8b5aa27 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:06.228738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e7a6c95a-370f-4cf2-91ff-34c5c8b5aa27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:06.241333 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6c95a-370f-4cf2-91ff-34c5c8b5aa27 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:06.246746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3ecfa-a6c2-4570-9633-736e296027b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:06.247381 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3ecfa-a6c2-4570-9633-736e296027b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:06.247668 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3ecfa-a6c2-4570-9633-736e296027b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:06.247940 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3ecfa-a6c2-4570-9633-736e296027b7 admin admin] PATH_INFO: `/v3/projects/53eef61bbfb6496bb8ca2c7134c5858c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:06.249105 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3ecfa-a6c2-4570-9633-736e296027b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53eef61bbfb6496bb8ca2c7134c5858c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:06.251272 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3ecfa-a6c2-4570-9633-736e296027b7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:06.412056 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9150ff7c-2c77-4654-9123-211ca23ffe1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d66645c66454584b52fde16dac98594'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:06.417864 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3dd3ecfa-a6c2-4570-9633-736e296027b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53eef61bbfb6496bb8ca2c7134c5858c', 'request_id': 'req-3dd3ecfa-a6c2-4570-9633-736e296027b7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:06.424326 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3dd3ecfa-a6c2-4570-9633-736e296027b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53eef61bbfb6496bb8ca2c7134c5858c', 'request_id': 'req-3dd3ecfa-a6c2-4570-9633-736e296027b7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:06.429809 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3dd3ecfa-a6c2-4570-9633-736e296027b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53eef61bbfb6496bb8ca2c7134c5858c', 'request_id': 'req-3dd3ecfa-a6c2-4570-9633-736e296027b7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:06.515097 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9150ff7c-2c77-4654-9123-211ca23ffe1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d66645c66454584b52fde16dac98594'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:06.515730 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9150ff7c-2c77-4654-9123-211ca23ffe1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d66645c66454584b52fde16dac98594'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:06.523268 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9150ff7c-2c77-4654-9123-211ca23ffe1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d66645c66454584b52fde16dac98594'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:06.535702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-9150ff7c-2c77-4654-9123-211ca23ffe1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d66645c66454584b52fde16dac98594'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:06.542717 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1438/2871] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:49:05 2022] DELETE /identity/v3/users/3d66645c66454584b52fde16dac98594 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:49:06.547010 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d81b-4492-492e-8d40-0abc914384aa None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:06.547298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d81b-4492-492e-8d40-0abc914384aa None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:06.547600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d81b-4492-492e-8d40-0abc914384aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:06.567359 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-deb6d81b-4492-492e-8d40-0abc914384aa None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:06.568569 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-deb6d81b-4492-492e-8d40-0abc914384aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:06.577911 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3dd3ecfa-a6c2-4570-9633-736e296027b7 admin admin] The token cache is being invalidate because project 53eef61bbfb6496bb8ca2c7134c5858c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:49:06.578200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3dd3ecfa-a6c2-4570-9633-736e296027b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:06.578858 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3dd3ecfa-a6c2-4570-9633-736e296027b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:06.580532 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1434/2872] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:49:06 2022] DELETE /identity/v3/projects/53eef61bbfb6496bb8ca2c7134c5858c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:49:06.592707 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdce802-c2a5-48e3-95fd-d8ca36627816 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:06.593017 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdce802-c2a5-48e3-95fd-d8ca36627816 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:06.593341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdce802-c2a5-48e3-95fd-d8ca36627816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:06.614768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9fdce802-c2a5-48e3-95fd-d8ca36627816 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:06.616227 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9fdce802-c2a5-48e3-95fd-d8ca36627816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:06.635761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1439/2873] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:49:06.652600 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6d81b-4492-492e-8d40-0abc914384aa None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:06.654002 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-deb6d81b-4492-492e-8d40-0abc914384aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:06.685085 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1435/2874] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:49:06.694693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef637-3ae3-4a53-ab5c-dd9583810495 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:06.694971 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef637-3ae3-4a53-ab5c-dd9583810495 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:06.695235 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef637-3ae3-4a53-ab5c-dd9583810495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:06.713534 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6d81b-4492-492e-8d40-0abc914384aa None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:06.715298 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b16ef637-3ae3-4a53-ab5c-dd9583810495 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:06.716529 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b16ef637-3ae3-4a53-ab5c-dd9583810495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:06.717372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83861e-f7e4-443a-9e47-7ea7485a936b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:06.718003 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83861e-f7e4-443a-9e47-7ea7485a936b service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:06.718282 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83861e-f7e4-443a-9e47-7ea7485a936b service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:06.718603 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83861e-f7e4-443a-9e47-7ea7485a936b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:06.724525 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1436/2875] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:49:06.728959 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83861e-f7e4-443a-9e47-7ea7485a936b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:06.730519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83861e-f7e4-443a-9e47-7ea7485a936b service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:06.732339 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ef637-3ae3-4a53-ab5c-dd9583810495 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:06.740278 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1440/2876] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:49:06.741365 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ef637-3ae3-4a53-ab5c-dd9583810495 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:06.745940 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827c5ed-642e-4814-a943-ad69019d621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:06.746526 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827c5ed-642e-4814-a943-ad69019d621b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:06.746799 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827c5ed-642e-4814-a943-ad69019d621b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:06.747065 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827c5ed-642e-4814-a943-ad69019d621b admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:06.747704 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827c5ed-642e-4814-a943-ad69019d621b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:49:06.748004 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827c5ed-642e-4814-a943-ad69019d621b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:06.749757 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827c5ed-642e-4814-a943-ad69019d621b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:06.761199 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1437/2877] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:49:06.765653 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83861e-f7e4-443a-9e47-7ea7485a936b service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:06.770965 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:06.776470 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83861e-f7e4-443a-9e47-7ea7485a936b service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:06.781258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08564e-4130-4258-811b-9c59803e34d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:06.781853 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08564e-4130-4258-811b-9c59803e34d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:06.782126 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08564e-4130-4258-811b-9c59803e34d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:06.782395 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08564e-4130-4258-811b-9c59803e34d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:06.783034 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08564e-4130-4258-811b-9c59803e34d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:06.785584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08564e-4130-4258-811b-9c59803e34d9 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:06.923372 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1441/2878] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:49:06 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:49:06.927659 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827c5ed-642e-4814-a943-ad69019d621b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:06.938000 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827c5ed-642e-4814-a943-ad69019d621b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:06.988640 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:06.997961 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceb1d3-f283-48b3-85a9-8495b5626773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:06.998955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceb1d3-f283-48b3-85a9-8495b5626773 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:06.998955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceb1d3-f283-48b3-85a9-8495b5626773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:06.999192 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceb1d3-f283-48b3-85a9-8495b5626773 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:06.999919 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceb1d3-f283-48b3-85a9-8495b5626773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:07.001728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceb1d3-f283-48b3-85a9-8495b5626773 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:07.104639 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1438/2879] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:49:06 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:49:07.108863 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08564e-4130-4258-811b-9c59803e34d9 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:07.119452 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08564e-4130-4258-811b-9c59803e34d9 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:07.123990 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608fd9b-f6e1-4dc1-bd86-d0f5b9158d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:07.124584 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608fd9b-f6e1-4dc1-bd86-d0f5b9158d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:07.124897 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608fd9b-f6e1-4dc1-bd86-d0f5b9158d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:07.125202 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608fd9b-f6e1-4dc1-bd86-d0f5b9158d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:07.125837 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608fd9b-f6e1-4dc1-bd86-d0f5b9158d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:07.129819 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608fd9b-f6e1-4dc1-bd86-d0f5b9158d87 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:07.138019 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1442/2880] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:49:07.142091 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceb1d3-f283-48b3-85a9-8495b5626773 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:07.152373 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceb1d3-f283-48b3-85a9-8495b5626773 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:07.156966 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02163ed7-d47f-4985-a01f-1f173f67a5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:07.157625 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02163ed7-d47f-4985-a01f-1f173f67a5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:07.157894 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02163ed7-d47f-4985-a01f-1f173f67a5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:07.158160 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02163ed7-d47f-4985-a01f-1f173f67a5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:07.158797 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02163ed7-d47f-4985-a01f-1f173f67a5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:07.160374 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02163ed7-d47f-4985-a01f-1f173f67a5c8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:07.171554 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1439/2881] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:49:07.175648 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608fd9b-f6e1-4dc1-bd86-d0f5b9158d87 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:07.186082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608fd9b-f6e1-4dc1-bd86-d0f5b9158d87 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:07.190889 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfe0f6-1287-4faf-90ba-0edfa723192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:07.191508 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfe0f6-1287-4faf-90ba-0edfa723192d admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:07.191756 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02163ed7-d47f-4985-a01f-1f173f67a5c8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:07.191893 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfe0f6-1287-4faf-90ba-0edfa723192d admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:07.192047 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfe0f6-1287-4faf-90ba-0edfa723192d admin admin] PATH_INFO: `/v3/projects/0a5738a021be4094bde99f6461549347/users/f6ea6091523a4812a303b17af923b28f/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:07.199574 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-02163ed7-d47f-4985-a01f-1f173f67a5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:07.215138 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02163ed7-d47f-4985-a01f-1f173f67a5c8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:07.219360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfe0f6-1287-4faf-90ba-0edfa723192d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5738a021be4094bde99f6461549347, user_id=f6ea6091523a4812a303b17af923b28f, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:07.220975 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590fe50-c420-4bcf-8e67-9aea2711f651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:07.225577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590fe50-c420-4bcf-8e67-9aea2711f651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:07.225577 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590fe50-c420-4bcf-8e67-9aea2711f651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:07.225724 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfe0f6-1287-4faf-90ba-0edfa723192d admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:07.225817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590fe50-c420-4bcf-8e67-9aea2711f651 admin admin] PATH_INFO: `/v3/projects/4642efecb548414ba7632bfa8a4e765c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:07.225817 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590fe50-c420-4bcf-8e67-9aea2711f651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4642efecb548414ba7632bfa8a4e765c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:07.226511 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590fe50-c420-4bcf-8e67-9aea2711f651 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:07.292554 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1443/2882] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:49:07 2022] PUT /identity/v3/projects/0a5738a021be4094bde99f6461549347/users/f6ea6091523a4812a303b17af923b28f/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:49:07.303917 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370299e-6c20-444b-9a6d-bc95b0e37b88 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:07.304197 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370299e-6c20-444b-9a6d-bc95b0e37b88 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:07.304495 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370299e-6c20-444b-9a6d-bc95b0e37b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:07.333729 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b590fe50-c420-4bcf-8e67-9aea2711f651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4642efecb548414ba7632bfa8a4e765c', 'request_id': 'req-b590fe50-c420-4bcf-8e67-9aea2711f651'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:07.334223 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-1370299e-6c20-444b-9a6d-bc95b0e37b88 None None] MFA Rules not processed for user `f6ea6091523a4812a303b17af923b28f`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:07.335545 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1370299e-6c20-444b-9a6d-bc95b0e37b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:07.340909 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b590fe50-c420-4bcf-8e67-9aea2711f651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4642efecb548414ba7632bfa8a4e765c', 'request_id': 'req-b590fe50-c420-4bcf-8e67-9aea2711f651'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:07.346963 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b590fe50-c420-4bcf-8e67-9aea2711f651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4642efecb548414ba7632bfa8a4e765c', 'request_id': 'req-b590fe50-c420-4bcf-8e67-9aea2711f651'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:07.403659 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1444/2883] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:49:07.414810 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370299e-6c20-444b-9a6d-bc95b0e37b88 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:07.416366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-1370299e-6c20-444b-9a6d-bc95b0e37b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:07.427777 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b590fe50-c420-4bcf-8e67-9aea2711f651 admin admin] The token cache is being invalidate because project 4642efecb548414ba7632bfa8a4e765c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:49:07.428261 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b590fe50-c420-4bcf-8e67-9aea2711f651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:07.428751 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b590fe50-c420-4bcf-8e67-9aea2711f651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:07.430275 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1440/2884] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:49:07 2022] DELETE /identity/v3/projects/4642efecb548414ba7632bfa8a4e765c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:49:07.436724 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ef35-568c-4d98-9de0-e1a3faa92332 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:07.437128 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ef35-568c-4d98-9de0-e1a3faa92332 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:07.437489 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ef35-568c-4d98-9de0-e1a3faa92332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:07.458723 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a483ef35-568c-4d98-9de0-e1a3faa92332 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:07.460687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a483ef35-568c-4d98-9de0-e1a3faa92332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:07.478590 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370299e-6c20-444b-9a6d-bc95b0e37b88 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:07.482578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215709b3-75af-4cef-8aaf-2955fe402a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:07.483171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215709b3-75af-4cef-8aaf-2955fe402a64 service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:07.483448 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215709b3-75af-4cef-8aaf-2955fe402a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:07.483718 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215709b3-75af-4cef-8aaf-2955fe402a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:07.485501 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-215709b3-75af-4cef-8aaf-2955fe402a64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:07.497212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215709b3-75af-4cef-8aaf-2955fe402a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:07.498834 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215709b3-75af-4cef-8aaf-2955fe402a64 service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:07.508425 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1445/2885] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:49:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 04:49:07.522814 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1441/2886] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:49:07.530779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b503ff-fcba-4657-91c5-a7149b9ba051 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:07.531063 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b503ff-fcba-4657-91c5-a7149b9ba051 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:07.531338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b503ff-fcba-4657-91c5-a7149b9ba051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:07.552487 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-08b503ff-fcba-4657-91c5-a7149b9ba051 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:07.553784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-08b503ff-fcba-4657-91c5-a7149b9ba051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:07.562681 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1446/2887] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:49:07.567050 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483ef35-568c-4d98-9de0-e1a3faa92332 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:07.577265 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483ef35-568c-4d98-9de0-e1a3faa92332 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:07.582119 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2267aea-34e3-4855-a15e-f7f83196aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:07.582716 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2267aea-34e3-4855-a15e-f7f83196aad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:07.583035 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2267aea-34e3-4855-a15e-f7f83196aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:07.583308 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2267aea-34e3-4855-a15e-f7f83196aad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:07.583983 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2267aea-34e3-4855-a15e-f7f83196aad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:49:07.584289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2267aea-34e3-4855-a15e-f7f83196aad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:07.585949 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2267aea-34e3-4855-a15e-f7f83196aad6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:07.598987 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1442/2888] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:49:07.605258 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b503ff-fcba-4657-91c5-a7149b9ba051 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:07.614670 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b503ff-fcba-4657-91c5-a7149b9ba051 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:07.620033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77764669-d1c1-43e8-9a55-9c21d565ac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:07.620654 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77764669-d1c1-43e8-9a55-9c21d565ac85 admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:07.620930 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77764669-d1c1-43e8-9a55-9c21d565ac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:07.621233 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77764669-d1c1-43e8-9a55-9c21d565ac85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:07.621855 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77764669-d1c1-43e8-9a55-9c21d565ac85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:07.623737 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77764669-d1c1-43e8-9a55-9c21d565ac85 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:07.734483 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1447/2889] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:49:07 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:49:07.738496 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2267aea-34e3-4855-a15e-f7f83196aad6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:07.749075 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2267aea-34e3-4855-a15e-f7f83196aad6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:07.789070 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:07.804493 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65593092-bf90-4b5c-a7d2-50e0d2727c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:07.805131 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65593092-bf90-4b5c-a7d2-50e0d2727c36 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:07.805412 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65593092-bf90-4b5c-a7d2-50e0d2727c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:07.805685 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65593092-bf90-4b5c-a7d2-50e0d2727c36 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:07.807693 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65593092-bf90-4b5c-a7d2-50e0d2727c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:07.809780 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65593092-bf90-4b5c-a7d2-50e0d2727c36 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:07.932102 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1443/2890] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:49:07 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:49:07.936226 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77764669-d1c1-43e8-9a55-9c21d565ac85 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:07.946220 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77764669-d1c1-43e8-9a55-9c21d565ac85 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:07.950829 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d4b59-2009-4d6c-ad7e-2d141a4340c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:07.951423 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d4b59-2009-4d6c-ad7e-2d141a4340c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:07.951695 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d4b59-2009-4d6c-ad7e-2d141a4340c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:07.951960 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d4b59-2009-4d6c-ad7e-2d141a4340c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:07.952589 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d4b59-2009-4d6c-ad7e-2d141a4340c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:07.954206 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d4b59-2009-4d6c-ad7e-2d141a4340c0 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:07.956279 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:07.965755 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1448/2891] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:49:07.969674 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65593092-bf90-4b5c-a7d2-50e0d2727c36 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:07.980309 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65593092-bf90-4b5c-a7d2-50e0d2727c36 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:07.985117 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a41fe5-eb4a-41be-a446-08a90dc29a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:07.985647 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a41fe5-eb4a-41be-a446-08a90dc29a3c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:07.985920 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a41fe5-eb4a-41be-a446-08a90dc29a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:07.986185 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a41fe5-eb4a-41be-a446-08a90dc29a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:07.986813 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a41fe5-eb4a-41be-a446-08a90dc29a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:07.988465 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a41fe5-eb4a-41be-a446-08a90dc29a3c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:07.999416 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1444/2892] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 04:49:08.003556 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d4b59-2009-4d6c-ad7e-2d141a4340c0 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:08.013634 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d4b59-2009-4d6c-ad7e-2d141a4340c0 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:08.018133 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310466c9-f68e-442f-8393-8b8ca9827859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:08.018768 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310466c9-f68e-442f-8393-8b8ca9827859 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:08.019042 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310466c9-f68e-442f-8393-8b8ca9827859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:08.019320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310466c9-f68e-442f-8393-8b8ca9827859 admin admin] PATH_INFO: `/v3/projects/d5d5324aeea94a2ab497ad3046375821/users/af6e1c9552a04633a4196927311411a1/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:08.033540 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310466c9-f68e-442f-8393-8b8ca9827859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d5324aeea94a2ab497ad3046375821, user_id=af6e1c9552a04633a4196927311411a1, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:08.036266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310466c9-f68e-442f-8393-8b8ca9827859 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:08.159336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1449/2893] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:49:08 2022] PUT /identity/v3/projects/d5d5324aeea94a2ab497ad3046375821/users/af6e1c9552a04633a4196927311411a1/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:49:08.167078 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71043e50-7395-4f9b-bd74-6b3f9a74df06 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:08.167439 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71043e50-7395-4f9b-bd74-6b3f9a74df06 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:08.167770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71043e50-7395-4f9b-bd74-6b3f9a74df06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:08.188471 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-71043e50-7395-4f9b-bd74-6b3f9a74df06 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:08.189777 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-71043e50-7395-4f9b-bd74-6b3f9a74df06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:08.253469 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1445/2894] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:49:08.263089 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310466c9-f68e-442f-8393-8b8ca9827859 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:08.264784 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-310466c9-f68e-442f-8393-8b8ca9827859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:08.326028 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310466c9-f68e-442f-8393-8b8ca9827859 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:08.331066 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf72c8b-531e-495e-a4da-500eb723a57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:08.331641 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72c8b-531e-495e-a4da-500eb723a57c service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:08.331919 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72c8b-531e-495e-a4da-500eb723a57c service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:08.332191 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72c8b-531e-495e-a4da-500eb723a57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:08.342583 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf72c8b-531e-495e-a4da-500eb723a57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:08.344021 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf72c8b-531e-495e-a4da-500eb723a57c service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:08.354781 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1450/2895] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:49:13.870944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b90005-e508-497a-8b57-83d91b805ee5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:13.871599 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b90005-e508-497a-8b57-83d91b805ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:13.871753 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b90005-e508-497a-8b57-83d91b805ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:13.906898 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-74b90005-e508-497a-8b57-83d91b805ee5 None None] MFA Rules not processed for user `af6e1c9552a04633a4196927311411a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:13.908530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-74b90005-e508-497a-8b57-83d91b805ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:13.989004 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1446/2896] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:49:13.998168 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf72c8b-531e-495e-a4da-500eb723a57c service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:14.008572 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf72c8b-531e-495e-a4da-500eb723a57c service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:14.013385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9784b9-1fa3-4e58-a33b-2491a793bfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:14.013990 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9784b9-1fa3-4e58-a33b-2491a793bfbe admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:14.014491 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9784b9-1fa3-4e58-a33b-2491a793bfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:14.014621 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9784b9-1fa3-4e58-a33b-2491a793bfbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:14.015232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9784b9-1fa3-4e58-a33b-2491a793bfbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:14.017171 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9784b9-1fa3-4e58-a33b-2491a793bfbe admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:14.204082 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1451/2897] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:49:13 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:49:14.208530 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b90005-e508-497a-8b57-83d91b805ee5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:14.220464 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b90005-e508-497a-8b57-83d91b805ee5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:14.268072 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:14.277881 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432202a-8d79-4c60-b32b-c152ef5bfe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:14.278486 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432202a-8d79-4c60-b32b-c152ef5bfe0e admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:14.278765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432202a-8d79-4c60-b32b-c152ef5bfe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:14.279039 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432202a-8d79-4c60-b32b-c152ef5bfe0e admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:14.279683 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432202a-8d79-4c60-b32b-c152ef5bfe0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:14.281942 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432202a-8d79-4c60-b32b-c152ef5bfe0e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:14.378792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1447/2898] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:49:14 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:49:14.382721 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9784b9-1fa3-4e58-a33b-2491a793bfbe admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:14.393309 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9784b9-1fa3-4e58-a33b-2491a793bfbe admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:14.398023 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d05778-def0-482f-b0ff-88a41b0ccc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:14.398610 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d05778-def0-482f-b0ff-88a41b0ccc2e admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:14.398887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d05778-def0-482f-b0ff-88a41b0ccc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:14.399167 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d05778-def0-482f-b0ff-88a41b0ccc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:14.399975 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d05778-def0-482f-b0ff-88a41b0ccc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:14.402096 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d05778-def0-482f-b0ff-88a41b0ccc2e admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:14.413109 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1452/2899] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:49:14.418795 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432202a-8d79-4c60-b32b-c152ef5bfe0e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:14.429022 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432202a-8d79-4c60-b32b-c152ef5bfe0e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:14.433879 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df22d4-d9a3-4922-bfb2-3b704c020282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:14.443671 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df22d4-d9a3-4922-bfb2-3b704c020282 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:14.443671 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df22d4-d9a3-4922-bfb2-3b704c020282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:14.443671 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df22d4-d9a3-4922-bfb2-3b704c020282 admin admin] PATH_INFO: `/v3/projects/9f05651440804505ae1e2677b5b810b3/users/d8f79c9a79a34c769e719c2e7bd937c3/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:14.450564 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df22d4-d9a3-4922-bfb2-3b704c020282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f05651440804505ae1e2677b5b810b3, user_id=d8f79c9a79a34c769e719c2e7bd937c3, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:14.453322 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df22d4-d9a3-4922-bfb2-3b704c020282 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:14.560644 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1448/2900] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:49:14 2022] PUT /identity/v3/projects/9f05651440804505ae1e2677b5b810b3/users/d8f79c9a79a34c769e719c2e7bd937c3/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:49:14.564733 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d05778-def0-482f-b0ff-88a41b0ccc2e admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:14.575516 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d05778-def0-482f-b0ff-88a41b0ccc2e admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:14.637761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e5e50-3027-4566-9e7d-a1db16a2c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:14.638385 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e5e50-3027-4566-9e7d-a1db16a2c894 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:14.638662 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e5e50-3027-4566-9e7d-a1db16a2c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:14.638950 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e5e50-3027-4566-9e7d-a1db16a2c894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:14.639653 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e5e50-3027-4566-9e7d-a1db16a2c894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:14.641337 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e5e50-3027-4566-9e7d-a1db16a2c894 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:14.642945 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df22d4-d9a3-4922-bfb2-3b704c020282 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:14.644892 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-45df22d4-d9a3-4922-bfb2-3b704c020282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:14.656825 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1453/2901] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:49:14.658018 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e5e50-3027-4566-9e7d-a1db16a2c894 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:14.661337 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df22d4-d9a3-4922-bfb2-3b704c020282 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:14.668269 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc3f0-6b22-4a49-a76d-f896cc264c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:14.668507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e5e50-3027-4566-9e7d-a1db16a2c894 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:14.668904 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc3f0-6b22-4a49-a76d-f896cc264c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:14.669206 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc3f0-6b22-4a49-a76d-f896cc264c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:14.669476 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc3f0-6b22-4a49-a76d-f896cc264c9d admin admin] PATH_INFO: `/v3/users/f6ea6091523a4812a303b17af923b28f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:14.670643 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fc3f0-6b22-4a49-a76d-f896cc264c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ea6091523a4812a303b17af923b28f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:14.672578 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fc3f0-6b22-4a49-a76d-f896cc264c9d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:14.673065 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96fa56-6285-48d7-b3e3-09728b0cc1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:14.673713 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96fa56-6285-48d7-b3e3-09728b0cc1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:14.673990 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96fa56-6285-48d7-b3e3-09728b0cc1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:14.674266 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96fa56-6285-48d7-b3e3-09728b0cc1f7 admin admin] PATH_INFO: `/v3/projects/9f05651440804505ae1e2677b5b810b3/users/d8f79c9a79a34c769e719c2e7bd937c3/roles/d31c9bcceec14f299f8c48936cf25f63` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:14.676154 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96fa56-6285-48d7-b3e3-09728b0cc1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f05651440804505ae1e2677b5b810b3, user_id=d8f79c9a79a34c769e719c2e7bd937c3, role_id=d31c9bcceec14f299f8c48936cf25f63)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:14.678802 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96fa56-6285-48d7-b3e3-09728b0cc1f7 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:14.689759 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1454/2902] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:49:14 2022] PUT /identity/v3/projects/9f05651440804505ae1e2677b5b810b3/users/d8f79c9a79a34c769e719c2e7bd937c3/roles/d31c9bcceec14f299f8c48936cf25f63 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:49:14.862482 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3b8fc3f0-6b22-4a49-a76d-f896cc264c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ea6091523a4812a303b17af923b28f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:14.871872 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3b8fc3f0-6b22-4a49-a76d-f896cc264c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ea6091523a4812a303b17af923b28f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:14.889713 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3b8fc3f0-6b22-4a49-a76d-f896cc264c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ea6091523a4812a303b17af923b28f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:14.961972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3b8fc3f0-6b22-4a49-a76d-f896cc264c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ea6091523a4812a303b17af923b28f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:14.962728 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3b8fc3f0-6b22-4a49-a76d-f896cc264c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ea6091523a4812a303b17af923b28f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:14.970435 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1449/2903] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:49:14 2022] DELETE /identity/v3/users/f6ea6091523a4812a303b17af923b28f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 04:49:14.975232 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad775-5aef-4585-a63f-30755a6d920f None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:14.975522 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad775-5aef-4585-a63f-30755a6d920f None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:14.975826 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad775-5aef-4585-a63f-30755a6d920f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:14.997099 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-c18ad775-5aef-4585-a63f-30755a6d920f None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:14.999546 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c18ad775-5aef-4585-a63f-30755a6d920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:15.023616 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:15.073054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1455/2904] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 04:49:15.084003 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc3f0-6b22-4a49-a76d-f896cc264c9d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:15.091738 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3b8fc3f0-6b22-4a49-a76d-f896cc264c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:15.159877 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc3f0-6b22-4a49-a76d-f896cc264c9d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:15.163589 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04f06b-1ab5-47df-8b9c-e1ccea15c9f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:15.164223 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04f06b-1ab5-47df-8b9c-e1ccea15c9f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:15.164498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04f06b-1ab5-47df-8b9c-e1ccea15c9f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:15.164765 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04f06b-1ab5-47df-8b9c-e1ccea15c9f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:15.174972 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04f06b-1ab5-47df-8b9c-e1ccea15c9f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:15.176437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04f06b-1ab5-47df-8b9c-e1ccea15c9f7 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:15.186702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1450/2905] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:49:15.660580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ad775-5aef-4585-a63f-30755a6d920f None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:15.660580 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-c18ad775-5aef-4585-a63f-30755a6d920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:15.674460 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ad775-5aef-4585-a63f-30755a6d920f None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:15.681084 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e927b30-4309-466a-8088-2995811ba289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:15.684486 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e927b30-4309-466a-8088-2995811ba289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:15.685054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e927b30-4309-466a-8088-2995811ba289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:15.685342 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e927b30-4309-466a-8088-2995811ba289 admin admin] PATH_INFO: `/v3/projects/0a5738a021be4094bde99f6461549347` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:15.686702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e927b30-4309-466a-8088-2995811ba289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5738a021be4094bde99f6461549347)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:15.688652 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e927b30-4309-466a-8088-2995811ba289 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:15.860640 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-5e927b30-4309-466a-8088-2995811ba289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5738a021be4094bde99f6461549347', 'request_id': 'req-5e927b30-4309-466a-8088-2995811ba289'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:15.867196 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-5e927b30-4309-466a-8088-2995811ba289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5738a021be4094bde99f6461549347', 'request_id': 'req-5e927b30-4309-466a-8088-2995811ba289'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:16.035528 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-5e927b30-4309-466a-8088-2995811ba289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5738a021be4094bde99f6461549347', 'request_id': 'req-5e927b30-4309-466a-8088-2995811ba289'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:16.047900 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-5e927b30-4309-466a-8088-2995811ba289 admin admin] The token cache is being invalidate because project 0a5738a021be4094bde99f6461549347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:49:16.052712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-5e927b30-4309-466a-8088-2995811ba289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:16.052712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-5e927b30-4309-466a-8088-2995811ba289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:16.052712 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1456/2906] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:49:15 2022] DELETE /identity/v3/projects/0a5738a021be4094bde99f6461549347 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:49:16.055476 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2ad5-5155-48b0-a7dd-5b8a3d51dd5f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:16.055991 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2ad5-5155-48b0-a7dd-5b8a3d51dd5f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:16.055991 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2ad5-5155-48b0-a7dd-5b8a3d51dd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:16.075759 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c05c2ad5-5155-48b0-a7dd-5b8a3d51dd5f None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:16.076954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c05c2ad5-5155-48b0-a7dd-5b8a3d51dd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:16.107594 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:16.138770 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1451/2907] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:49:16.147526 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe92a6f-6d7c-42ff-932a-7760246065a7 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:16.147803 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe92a6f-6d7c-42ff-932a-7760246065a7 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:16.148274 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe92a6f-6d7c-42ff-932a-7760246065a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:16.169881 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-abe92a6f-6d7c-42ff-932a-7760246065a7 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:16.171087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-abe92a6f-6d7c-42ff-932a-7760246065a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:16.178939 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1457/2908] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:49:16.183735 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c2ad5-5155-48b0-a7dd-5b8a3d51dd5f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:16.197705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c2ad5-5155-48b0-a7dd-5b8a3d51dd5f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:16.202889 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c4016-289d-45f7-aa64-392d3f5d63e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:16.203526 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4016-289d-45f7-aa64-392d3f5d63e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:16.203806 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4016-289d-45f7-aa64-392d3f5d63e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:16.204120 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4016-289d-45f7-aa64-392d3f5d63e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:16.205418 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c4016-289d-45f7-aa64-392d3f5d63e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 04:49:16.205732 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c4016-289d-45f7-aa64-392d3f5d63e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:16.207421 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c4016-289d-45f7-aa64-392d3f5d63e2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:16.221537 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1452/2909] 10.222.0.50 () {58 vars in 1153 bytes} [Sat Sep 17 04:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 04:49:16.226494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe92a6f-6d7c-42ff-932a-7760246065a7 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:16.236044 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe92a6f-6d7c-42ff-932a-7760246065a7 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:16.241061 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153aa5f-25e2-4c09-8421-128874aca6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:16.241658 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153aa5f-25e2-4c09-8421-128874aca6da admin admin] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:16.241936 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153aa5f-25e2-4c09-8421-128874aca6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:16.242237 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153aa5f-25e2-4c09-8421-128874aca6da admin admin] PATH_INFO: `/v3/projects` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:16.242870 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153aa5f-25e2-4c09-8421-128874aca6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:16.244761 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153aa5f-25e2-4c09-8421-128874aca6da admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:16.322845 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1458/2910] 10.222.0.50 () {60 vars in 1153 bytes} [Sat Sep 17 04:49:16 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 04:49:16.327860 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c4016-289d-45f7-aa64-392d3f5d63e2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:16.337797 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c4016-289d-45f7-aa64-392d3f5d63e2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:16.398123 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ecfff-c4d6-4c52-af1d-9e92f2a0d6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:16.398746 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ecfff-c4d6-4c52-af1d-9e92f2a0d6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:16.399161 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ecfff-c4d6-4c52-af1d-9e92f2a0d6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:16.399441 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ecfff-c4d6-4c52-af1d-9e92f2a0d6d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:16.400083 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ecfff-c4d6-4c52-af1d-9e92f2a0d6d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:16.403200 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ecfff-c4d6-4c52-af1d-9e92f2a0d6d9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:16.504954 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1453/2911] 10.222.0.50 () {60 vars in 1144 bytes} [Sat Sep 17 04:49:16 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 04:49:16.508962 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153aa5f-25e2-4c09-8421-128874aca6da admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:16.519979 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153aa5f-25e2-4c09-8421-128874aca6da admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:16.524669 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71584572-cdc8-4009-bba3-5d23d6017419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:16.525312 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71584572-cdc8-4009-bba3-5d23d6017419 admin admin] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:16.525587 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71584572-cdc8-4009-bba3-5d23d6017419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:16.525854 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71584572-cdc8-4009-bba3-5d23d6017419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:16.526974 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71584572-cdc8-4009-bba3-5d23d6017419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:16.529597 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71584572-cdc8-4009-bba3-5d23d6017419 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:16.540379 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1459/2912] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:49:16.544792 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ecfff-c4d6-4c52-af1d-9e92f2a0d6d9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:16.554785 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ecfff-c4d6-4c52-af1d-9e92f2a0d6d9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:16.559737 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189675c-00d3-4ab8-988b-71cc6bb215ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:16.560499 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189675c-00d3-4ab8-988b-71cc6bb215ed admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:16.560955 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189675c-00d3-4ab8-988b-71cc6bb215ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:16.561124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189675c-00d3-4ab8-988b-71cc6bb215ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:16.561698 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189675c-00d3-4ab8-988b-71cc6bb215ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:16.563329 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189675c-00d3-4ab8-988b-71cc6bb215ed admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:16.576148 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1454/2913] 10.222.0.50 () {58 vars in 1122 bytes} [Sat Sep 17 04:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 04:49:16.580411 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71584572-cdc8-4009-bba3-5d23d6017419 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:16.593795 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71584572-cdc8-4009-bba3-5d23d6017419 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:16.599689 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5132fd1-60f0-4519-bcb7-d7de4afad68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:16.600762 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5132fd1-60f0-4519-bcb7-d7de4afad68a admin admin] REQUEST_METHOD: `PUT` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:16.601484 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5132fd1-60f0-4519-bcb7-d7de4afad68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:16.601968 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5132fd1-60f0-4519-bcb7-d7de4afad68a admin admin] PATH_INFO: `/v3/projects/55a28ebe050f47c18b3c4a15797c08da/users/ede52df161ca45b893dded41d6da680d/roles/28ebd5e6ebbc404e87ed29420b2f4254` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:16.620482 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5132fd1-60f0-4519-bcb7-d7de4afad68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a28ebe050f47c18b3c4a15797c08da, user_id=ede52df161ca45b893dded41d6da680d, role_id=28ebd5e6ebbc404e87ed29420b2f4254)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:16.623589 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5132fd1-60f0-4519-bcb7-d7de4afad68a admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:16.711118 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1460/2914] 10.222.0.50 () {60 vars in 1483 bytes} [Sat Sep 17 04:49:16 2022] PUT /identity/v3/projects/55a28ebe050f47c18b3c4a15797c08da/users/ede52df161ca45b893dded41d6da680d/roles/28ebd5e6ebbc404e87ed29420b2f4254 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:49:16.722153 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4996-481b-495c-8394-d0359c5c8e81 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:16.722433 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4996-481b-495c-8394-d0359c5c8e81 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:16.722959 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4996-481b-495c-8394-d0359c5c8e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:16.752903 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-016a4996-481b-495c-8394-d0359c5c8e81 None None] MFA Rules not processed for user `ede52df161ca45b893dded41d6da680d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:16.754218 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-016a4996-481b-495c-8394-d0359c5c8e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:16.822992 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1455/2915] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:49:16.838218 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5132fd1-60f0-4519-bcb7-d7de4afad68a admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:16.840982 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d5132fd1-60f0-4519-bcb7-d7de4afad68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:16.903709 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:16.909813 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5132fd1-60f0-4519-bcb7-d7de4afad68a admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:16.913524 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc448777-8995-4e90-97ef-521c9229480a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f50529feb44143b0627131d9aab8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:16.914366 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc448777-8995-4e90-97ef-521c9229480a service cinder] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:16.914521 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc448777-8995-4e90-97ef-521c9229480a service cinder] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:16.914702 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc448777-8995-4e90-97ef-521c9229480a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:16.925887 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc448777-8995-4e90-97ef-521c9229480a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:16.927402 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc448777-8995-4e90-97ef-521c9229480a service cinder] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:16.952575 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1461/2916] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:49:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:49:21.096345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f0376-3e66-466c-be3f-1b204e986e01 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:21.096842 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f0376-3e66-466c-be3f-1b204e986e01 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:21.096941 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f0376-3e66-466c-be3f-1b204e986e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:21.131856 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1c2f0376-3e66-466c-be3f-1b204e986e01 None None] MFA Rules not processed for user `d8f79c9a79a34c769e719c2e7bd937c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:21.133463 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1c2f0376-3e66-466c-be3f-1b204e986e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:21.165289 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:21.225873 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1456/2917] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:49:21.238954 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc448777-8995-4e90-97ef-521c9229480a service cinder] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:21.241362 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-fc448777-8995-4e90-97ef-521c9229480a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:21.308399 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc448777-8995-4e90-97ef-521c9229480a service cinder] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:21.312320 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa4609-1de4-4fb9-b983-5a7faa2aee99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ba9aba795f423a8ffabe419b64507a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:21.312932 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4609-1de4-4fb9-b983-5a7faa2aee99 service glance] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:21.315238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4609-1de4-4fb9-b983-5a7faa2aee99 service glance] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:21.315238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4609-1de4-4fb9-b983-5a7faa2aee99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:21.315238 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d2aa4609-1de4-4fb9-b983-5a7faa2aee99 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:21.380945 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa4609-1de4-4fb9-b983-5a7faa2aee99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:21.382494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa4609-1de4-4fb9-b983-5a7faa2aee99 service glance] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:21.391797 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1462/2918] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:49:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:49:21.688484 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70925cf-e514-4160-8766-185494509129 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:21.688772 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70925cf-e514-4160-8766-185494509129 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:21.689068 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70925cf-e514-4160-8766-185494509129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:21.709885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a70925cf-e514-4160-8766-185494509129 None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:21.711099 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a70925cf-e514-4160-8766-185494509129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:21.772768 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1457/2919] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:49:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:49:21.785377 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa4609-1de4-4fb9-b983-5a7faa2aee99 service glance] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:21.791782 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-d2aa4609-1de4-4fb9-b983-5a7faa2aee99 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:21.867092 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa4609-1de4-4fb9-b983-5a7faa2aee99 service glance] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:21.872591 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f06cea-3fff-4814-bde1-e36fa0399852 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:21.873235 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06cea-3fff-4814-bde1-e36fa0399852 service swift] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:21.873519 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06cea-3fff-4814-bde1-e36fa0399852 service swift] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:21.874011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06cea-3fff-4814-bde1-e36fa0399852 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:21.882833 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f06cea-3fff-4814-bde1-e36fa0399852 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:21.884481 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f06cea-3fff-4814-bde1-e36fa0399852 service swift] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:21.892684 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1463/2920] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:49:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 04:49:29.394701 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70925cf-e514-4160-8766-185494509129 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:29.470829 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70925cf-e514-4160-8766-185494509129 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:29.476137 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0d138-3426-4fcd-9741-840a3821cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:29.476776 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d138-3426-4fcd-9741-840a3821cfa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:29.477082 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d138-3426-4fcd-9741-840a3821cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:29.477359 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d138-3426-4fcd-9741-840a3821cfa0 admin admin] PATH_INFO: `/v3/users/ede52df161ca45b893dded41d6da680d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:29.478667 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0d138-3426-4fcd-9741-840a3821cfa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede52df161ca45b893dded41d6da680d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:29.481378 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0d138-3426-4fcd-9741-840a3821cfa0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:29.659345 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aef0d138-3426-4fcd-9741-840a3821cfa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede52df161ca45b893dded41d6da680d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:29.668266 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aef0d138-3426-4fcd-9741-840a3821cfa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede52df161ca45b893dded41d6da680d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:29.673621 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:29.682944 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aef0d138-3426-4fcd-9741-840a3821cfa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede52df161ca45b893dded41d6da680d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:29.733437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aef0d138-3426-4fcd-9741-840a3821cfa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede52df161ca45b893dded41d6da680d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:29.734153 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aef0d138-3426-4fcd-9741-840a3821cfa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede52df161ca45b893dded41d6da680d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:29.741059 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1458/2921] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:49:29 2022] DELETE /identity/v3/users/ede52df161ca45b893dded41d6da680d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:49:29.745643 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52961656-9404-45b0-8ad9-e30289a51368 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:29.746284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52961656-9404-45b0-8ad9-e30289a51368 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:29.746284 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52961656-9404-45b0-8ad9-e30289a51368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:29.771570 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-52961656-9404-45b0-8ad9-e30289a51368 None None] MFA Rules not processed for user `f003550e956b429a97e0675a2bc86b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:29.773269 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-52961656-9404-45b0-8ad9-e30289a51368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:29.806984 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=100 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:29.843891 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1464/2922] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:49:29.856425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0d138-3426-4fcd-9741-840a3821cfa0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:29.858114 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aef0d138-3426-4fcd-9741-840a3821cfa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:29.928094 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0d138-3426-4fcd-9741-840a3821cfa0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:29.935082 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b33c57-8a08-4358-9b88-dcefedb872bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:29.935705 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b33c57-8a08-4358-9b88-dcefedb872bd service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:29.935982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b33c57-8a08-4358-9b88-dcefedb872bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:29.936253 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b33c57-8a08-4358-9b88-dcefedb872bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:29.946045 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b33c57-8a08-4358-9b88-dcefedb872bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:29.947470 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b33c57-8a08-4358-9b88-dcefedb872bd service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:29.962009 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1459/2923] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:49:30.443756 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52961656-9404-45b0-8ad9-e30289a51368 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:30.445553 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-52961656-9404-45b0-8ad9-e30289a51368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:30.473582 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52961656-9404-45b0-8ad9-e30289a51368 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:30.488931 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaa586-465c-4f57-8ffb-09cba96d9b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:30.489770 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaa586-465c-4f57-8ffb-09cba96d9b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:30.490054 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaa586-465c-4f57-8ffb-09cba96d9b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:30.490336 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaa586-465c-4f57-8ffb-09cba96d9b29 admin admin] PATH_INFO: `/v3/projects/55a28ebe050f47c18b3c4a15797c08da` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:30.491490 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaa586-465c-4f57-8ffb-09cba96d9b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a28ebe050f47c18b3c4a15797c08da)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:30.496011 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaa586-465c-4f57-8ffb-09cba96d9b29 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:30.614085 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-20eaa586-465c-4f57-8ffb-09cba96d9b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a28ebe050f47c18b3c4a15797c08da', 'request_id': 'req-20eaa586-465c-4f57-8ffb-09cba96d9b29'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:30.618966 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-20eaa586-465c-4f57-8ffb-09cba96d9b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a28ebe050f47c18b3c4a15797c08da', 'request_id': 'req-20eaa586-465c-4f57-8ffb-09cba96d9b29'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:30.699428 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-20eaa586-465c-4f57-8ffb-09cba96d9b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a28ebe050f47c18b3c4a15797c08da', 'request_id': 'req-20eaa586-465c-4f57-8ffb-09cba96d9b29'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:30.711338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-20eaa586-465c-4f57-8ffb-09cba96d9b29 admin admin] The token cache is being invalidate because project 55a28ebe050f47c18b3c4a15797c08da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:49:30.712315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-20eaa586-465c-4f57-8ffb-09cba96d9b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:30.712315 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-20eaa586-465c-4f57-8ffb-09cba96d9b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:49:30.713908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1465/2924] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:49:30 2022] DELETE /identity/v3/projects/55a28ebe050f47c18b3c4a15797c08da => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:49:32.607745 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7c4d9-80b0-432d-a360-33050ae90bd2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:32.608267 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7c4d9-80b0-432d-a360-33050ae90bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:32.608267 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7c4d9-80b0-432d-a360-33050ae90bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:32.627884 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b8e7c4d9-80b0-432d-a360-33050ae90bd2 None None] MFA Rules not processed for user `af6e1c9552a04633a4196927311411a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:32.629126 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b8e7c4d9-80b0-432d-a360-33050ae90bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:32.682485 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1460/2925] 10.222.0.50 () {58 vars in 958 bytes} [Sat Sep 17 04:49:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:49:36.196666 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f0e92-8372-4f74-a5fc-678c54d17cfe None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:36.197195 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f0e92-8372-4f74-a5fc-678c54d17cfe None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:36.197293 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f0e92-8372-4f74-a5fc-678c54d17cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:36.218235 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-9a6f0e92-8372-4f74-a5fc-678c54d17cfe None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:49:36.219422 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9a6f0e92-8372-4f74-a5fc-678c54d17cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:36.276225 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1466/2926] 10.222.0.50 () {58 vars in 1009 bytes} [Sat Sep 17 04:49:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:49:36.288490 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7c4d9-80b0-432d-a360-33050ae90bd2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:49:36.290047 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b8e7c4d9-80b0-432d-a360-33050ae90bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:49:36.378796 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7c4d9-80b0-432d-a360-33050ae90bd2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:49:36.384314 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd0a3e-6bdb-446c-9007-2051c58310aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:49:36.384946 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd0a3e-6bdb-446c-9007-2051c58310aa service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:49:36.385249 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd0a3e-6bdb-446c-9007-2051c58310aa service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:49:36.385522 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd0a3e-6bdb-446c-9007-2051c58310aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:49:36.394951 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd0a3e-6bdb-446c-9007-2051c58310aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:49:36.396676 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd0a3e-6bdb-446c-9007-2051c58310aa service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:49:36.405714 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1461/2927] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:49:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 04:49:46.269299 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=64,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:49:46.416396 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=3,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:50:00.576288 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f0e92-8372-4f74-a5fc-678c54d17cfe None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:50:00.577810 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-9a6f0e92-8372-4f74-a5fc-678c54d17cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:50:00.634621 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f0e92-8372-4f74-a5fc-678c54d17cfe None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:50:00.638327 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f29e9-5311-4d7e-a003-c40aa7c68034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:50:00.638908 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f29e9-5311-4d7e-a003-c40aa7c68034 service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:50:00.639185 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f29e9-5311-4d7e-a003-c40aa7c68034 service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:50:00.639455 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f29e9-5311-4d7e-a003-c40aa7c68034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:50:00.641257 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-384f29e9-5311-4d7e-a003-c40aa7c68034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:50:00.703714 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f29e9-5311-4d7e-a003-c40aa7c68034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:50:00.705127 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f29e9-5311-4d7e-a003-c40aa7c68034 service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:50:00.714419 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1467/2928] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:50:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:50:10.710233 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=50 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:50:31.952772 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd0a3e-6bdb-446c-9007-2051c58310aa service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:50:31.954355 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d6fd0a3e-6bdb-446c-9007-2051c58310aa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:50:31.968093 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd0a3e-6bdb-446c-9007-2051c58310aa service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:50:31.971702 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b356963-2940-48d1-b15f-b2fc6c8a2cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:50:31.972294 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356963-2940-48d1-b15f-b2fc6c8a2cbc service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:50:31.972566 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356963-2940-48d1-b15f-b2fc6c8a2cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:50:31.972838 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356963-2940-48d1-b15f-b2fc6c8a2cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:50:31.975028 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2b356963-2940-48d1-b15f-b2fc6c8a2cbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:50:32.057891 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b356963-2940-48d1-b15f-b2fc6c8a2cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:50:32.059962 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b356963-2940-48d1-b15f-b2fc6c8a2cbc service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:50:32.080400 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1462/2929] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:50:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:50:33.270783 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f29e9-5311-4d7e-a003-c40aa7c68034 service neutron] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:50:33.280560 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f29e9-5311-4d7e-a003-c40aa7c68034 service neutron] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:50:33.284190 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0c0c1-a0b7-4e42-b75a-3e98237e478b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:50:33.284779 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c0c1-a0b7-4e42-b75a-3e98237e478b service neutron] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:50:33.285087 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c0c1-a0b7-4e42-b75a-3e98237e478b service neutron] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:50:33.285360 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c0c1-a0b7-4e42-b75a-3e98237e478b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:50:33.287098 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-e8a0c0c1-a0b7-4e42-b75a-3e98237e478b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:50:33.300298 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0c0c1-a0b7-4e42-b75a-3e98237e478b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:50:33.301740 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0c0c1-a0b7-4e42-b75a-3e98237e478b service neutron] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:50:33.312895 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1468/2930] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:50:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:50:42.077808 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=43 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:50:43.307573 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=6 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:51:19.167687 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b356963-2940-48d1-b15f-b2fc6c8a2cbc service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:51:19.178703 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b356963-2940-48d1-b15f-b2fc6c8a2cbc service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:51:19.183611 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a1b42-1d14-4f62-a418-bdf9a7f89e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6469c8860be943168b67ea7fa28bf19d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:51:19.184524 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a1b42-1d14-4f62-a418-bdf9a7f89e0d service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:51:19.185058 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a1b42-1d14-4f62-a418-bdf9a7f89e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:51:19.185563 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a1b42-1d14-4f62-a418-bdf9a7f89e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:51:19.187675 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ba5a1b42-1d14-4f62-a418-bdf9a7f89e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:51:19.200106 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a1b42-1d14-4f62-a418-bdf9a7f89e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:51:19.201692 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a1b42-1d14-4f62-a418-bdf9a7f89e0d service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:51:19.211210 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1463/2931] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:51:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:51:26.945544 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10898ed8-336a-4003-9f0d-36ee3cfc53d4 None None] REQUEST_METHOD: `POST` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:51:26.946040 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10898ed8-336a-4003-9f0d-36ee3cfc53d4 None None] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:51:26.946151 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10898ed8-336a-4003-9f0d-36ee3cfc53d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:51:26.995338 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.auth.core [None req-10898ed8-336a-4003-9f0d-36ee3cfc53d4 None None] MFA Rules not processed for user `597874ccdd284d9d88f3e743c4759d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 04:51:26.996538 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-10898ed8-336a-4003-9f0d-36ee3cfc53d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:51:27.014398 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1469/2932] 10.222.0.50 () {58 vars in 967 bytes} [Sat Sep 17 04:51:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 04:51:27.055002 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a1b42-1d14-4f62-a418-bdf9a7f89e0d service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:51:27.076791 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a1b42-1d14-4f62-a418-bdf9a7f89e0d service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:51:27.082717 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97796d-c922-4ed6-b885-eebe07a747a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c653cb8c86534dc2b963f39f5e1d3e0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:51:27.083318 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97796d-c922-4ed6-b885-eebe07a747a3 service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:51:27.083595 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97796d-c922-4ed6-b885-eebe07a747a3 service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:51:27.083887 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97796d-c922-4ed6-b885-eebe07a747a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:51:27.091811 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97796d-c922-4ed6-b885-eebe07a747a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:51:27.093425 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97796d-c922-4ed6-b885-eebe07a747a3 service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:51:27.101643 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1464/2933] 10.222.0.50 () {60 vars in 1384 bytes} [Sat Sep 17 04:51:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 04:51:35.125314 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10898ed8-336a-4003-9f0d-36ee3cfc53d4 None None] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:51:35.127875 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-10898ed8-336a-4003-9f0d-36ee3cfc53d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:51:35.194507 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10898ed8-336a-4003-9f0d-36ee3cfc53d4 None None] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:51:35.199120 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d6bfb-b13d-4ad5-abb1-14a0fedf9e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:51:35.199691 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d6bfb-b13d-4ad5-abb1-14a0fedf9e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:51:35.199970 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d6bfb-b13d-4ad5-abb1-14a0fedf9e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:51:35.200243 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d6bfb-b13d-4ad5-abb1-14a0fedf9e86 admin admin] PATH_INFO: `/v3/users/af6e1c9552a04633a4196927311411a1` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:51:35.201410 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d6bfb-b13d-4ad5-abb1-14a0fedf9e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6e1c9552a04633a4196927311411a1)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:51:35.203331 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d6bfb-b13d-4ad5-abb1-14a0fedf9e86 admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:51:35.390537 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-494d6bfb-b13d-4ad5-abb1-14a0fedf9e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6e1c9552a04633a4196927311411a1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:35.454620 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-494d6bfb-b13d-4ad5-abb1-14a0fedf9e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6e1c9552a04633a4196927311411a1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:35.455168 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-494d6bfb-b13d-4ad5-abb1-14a0fedf9e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6e1c9552a04633a4196927311411a1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:35.462593 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-494d6bfb-b13d-4ad5-abb1-14a0fedf9e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6e1c9552a04633a4196927311411a1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:35.474899 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-494d6bfb-b13d-4ad5-abb1-14a0fedf9e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6e1c9552a04633a4196927311411a1'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:35.481033 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1470/2934] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:51:35 2022] DELETE /identity/v3/users/af6e1c9552a04633a4196927311411a1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:51:35.725171 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97796d-c922-4ed6-b885-eebe07a747a3 service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:51:35.738467 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97796d-c922-4ed6-b885-eebe07a747a3 service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:51:35.796648 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:51:35.798228 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:51:35.798502 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:51:35.798767 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] PATH_INFO: `/v3/projects/d5d5324aeea94a2ab497ad3046375821` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:51:35.799885 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d5324aeea94a2ab497ad3046375821)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:51:35.801807 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:51:35.900613 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d5324aeea94a2ab497ad3046375821', 'request_id': 'req-49bde942-f810-49fc-90bc-abbc5462987b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:35.907592 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d5324aeea94a2ab497ad3046375821', 'request_id': 'req-49bde942-f810-49fc-90bc-abbc5462987b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:35.913437 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d5324aeea94a2ab497ad3046375821', 'request_id': 'req-49bde942-f810-49fc-90bc-abbc5462987b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:35.987805 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] The token cache is being invalidate because project d5d5324aeea94a2ab497ad3046375821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:51:35.988024 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:35.988681 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:35.990182 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1465/2935] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:51:35 2022] DELETE /identity/v3/projects/d5d5324aeea94a2ab497ad3046375821 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:51:35.994142 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d6bfb-b13d-4ad5-abb1-14a0fedf9e86 admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:51:35.995525 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-494d6bfb-b13d-4ad5-abb1-14a0fedf9e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:51:36.008918 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d6bfb-b13d-4ad5-abb1-14a0fedf9e86 admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:51:36.046343 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:51:36.065242 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8308c79-480a-435f-9c61-c9ae728dc00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:51:36.065868 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8308c79-480a-435f-9c61-c9ae728dc00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:51:36.066187 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8308c79-480a-435f-9c61-c9ae728dc00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:51:36.066456 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8308c79-480a-435f-9c61-c9ae728dc00f admin admin] PATH_INFO: `/v3/users/d8f79c9a79a34c769e719c2e7bd937c3` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:51:36.067595 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8308c79-480a-435f-9c61-c9ae728dc00f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f79c9a79a34c769e719c2e7bd937c3)` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:51:36.070578 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8308c79-480a-435f-9c61-c9ae728dc00f admin admin] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:51:36.264094 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a8308c79-480a-435f-9c61-c9ae728dc00f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f79c9a79a34c769e719c2e7bd937c3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:36.324558 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a8308c79-480a-435f-9c61-c9ae728dc00f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f79c9a79a34c769e719c2e7bd937c3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:36.325212 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a8308c79-480a-435f-9c61-c9ae728dc00f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f79c9a79a34c769e719c2e7bd937c3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:36.333122 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a8308c79-480a-435f-9c61-c9ae728dc00f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f79c9a79a34c769e719c2e7bd937c3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:36.346199 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.notifications [None req-a8308c79-480a-435f-9c61-c9ae728dc00f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f79c9a79a34c769e719c2e7bd937c3'} {{(pid=81614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:36.352494 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1471/2936] 10.222.0.50 () {58 vars in 1224 bytes} [Sat Sep 17 04:51:35 2022] DELETE /identity/v3/users/d8f79c9a79a34c769e719c2e7bd937c3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:51:36.566669 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:51:36.568124 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:51:36.581245 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bde942-f810-49fc-90bc-abbc5462987b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:51:36.632982 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:51:36.639917 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8ac06-827b-46f1-a06c-872cba55ab04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f003550e956b429a97e0675a2bc86b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18915dddeacb48718863511fb593fb67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:51:36.640540 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8ac06-827b-46f1-a06c-872cba55ab04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:51:36.642061 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8ac06-827b-46f1-a06c-872cba55ab04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:51:36.642423 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8ac06-827b-46f1-a06c-872cba55ab04 admin admin] PATH_INFO: `/v3/projects/9f05651440804505ae1e2677b5b810b3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:51:36.643690 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8ac06-827b-46f1-a06c-872cba55ab04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f05651440804505ae1e2677b5b810b3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:51:36.645741 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8ac06-827b-46f1-a06c-872cba55ab04 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:51:36.736165 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4ba8ac06-827b-46f1-a06c-872cba55ab04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f05651440804505ae1e2677b5b810b3', 'request_id': 'req-4ba8ac06-827b-46f1-a06c-872cba55ab04'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:36.742521 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4ba8ac06-827b-46f1-a06c-872cba55ab04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f05651440804505ae1e2677b5b810b3', 'request_id': 'req-4ba8ac06-827b-46f1-a06c-872cba55ab04'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:36.748904 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4ba8ac06-827b-46f1-a06c-872cba55ab04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f05651440804505ae1e2677b5b810b3', 'request_id': 'req-4ba8ac06-827b-46f1-a06c-872cba55ab04'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:36.833498 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4ba8ac06-827b-46f1-a06c-872cba55ab04 admin admin] The token cache is being invalidate because project 9f05651440804505ae1e2677b5b810b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 04:51:36.833725 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4ba8ac06-827b-46f1-a06c-872cba55ab04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:36.834341 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4ba8ac06-827b-46f1-a06c-872cba55ab04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 04:51:36.835847 dv-cinder-857993-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1466/2937] 10.222.0.50 () {58 vars in 1233 bytes} [Sat Sep 17 04:51:36 2022] DELETE /identity/v3/projects/9f05651440804505ae1e2677b5b810b3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 04:51:46.348682 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:51:46.830162 dv-cinder-857993-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 04:54:44.896016 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8308c79-480a-435f-9c61-c9ae728dc00f admin admin] Authenticating user token {{(pid=81614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 04:54:44.898413 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-a8308c79-480a-435f-9c61-c9ae728dc00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:54:44.967223 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8308c79-480a-435f-9c61-c9ae728dc00f admin admin] Validating token access rules against request {{(pid=81614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 04:54:45.026139 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a49742-bc79-4c27-b94b-b6f69b96f1e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931a947711a2468baaeef701bbee60c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd50a1cd322404bd4b0fa7a8c388dc217', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 04:54:45.026745 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a49742-bc79-4c27-b94b-b6f69b96f1e9 service placement] REQUEST_METHOD: `GET` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 04:54:45.027026 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a49742-bc79-4c27-b94b-b6f69b96f1e9 service placement] SCRIPT_NAME: `/identity` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 04:54:45.027300 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a49742-bc79-4c27-b94b-b6f69b96f1e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 04:54:45.029081 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.fernet_utils [None req-53a49742-bc79-4c27-b94b-b6f69b96f1e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 04:54:45.040864 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a49742-bc79-4c27-b94b-b6f69b96f1e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 04:54:45.042466 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a49742-bc79-4c27-b94b-b6f69b96f1e9 service placement] RBAC: Authorization granted {{(pid=81614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 04:54:45.052348 dv-cinder-857993-2-smb devstack@keystone.service[81614]: [pid: 81614|app: 0|req: 1472/2938] 10.222.0.50 () {60 vars in 1365 bytes} [Sat Sep 17 04:54:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 04:54:55.048073 dv-cinder-857993-2-smb devstack@keystone.service[81614]: DEBUG dbcounter [-] [81614] Writing DB stats keystone:SELECT=58 {{(pid=81614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}